2026-02-17T11:41:39.538 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T11:41:39.553 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:41:39.633 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51344' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: debuginfo: true flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial010.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEf/bQ1MNGU/QvYKo5aFg75PEXtp8roQTtlS12+yfEMeZh3MF6TY8pmHFlks3nxeGwsqcuNdTO4b+qG4tzKE3Q= trial071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPKBnTEuPh6HXl/sovLXhgNf1DsjmASOmiEtNUiHGWo99gs5IgPegV6ee51rQO1yVS2h6beQ2P/SXuef3fnp58= trial153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJRSXd4ODm0OaEPfAdo7UahGUwBBYoiD142C0lXYLpsYCZxC6baRuTuzAz1MBmPEjQ9pJdhQEdi6I3ArKain6ko= trial174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLSwfnKaXenQlDDb6CSnXutvikC48a3wiUb/9Dsd+A4fGDEANrMdXJwi/frujcKvoFRRZ9ny14Ii2uu0kb1hpY= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T11:41:39.633 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T11:41:39.634 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T11:41:39.634 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T11:41:39.635 INFO:teuthology.task.internal:Checking packages... 2026-02-17T11:41:39.635 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T11:41:39.635 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T11:41:39.635 INFO:teuthology.packaging:ref: None 2026-02-17T11:41:39.635 INFO:teuthology.packaging:tag: None 2026-02-17T11:41:39.635 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:41:39.636 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:41:39.636 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:41:39.762 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675.g3c96dfb3 2026-02-17T11:41:39.763 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T11:41:39.773 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T11:41:39.773 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T11:41:39.781 INFO:teuthology.task.internal:Saving configuration 2026-02-17T11:41:39.795 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T11:41:39.807 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T11:41:39.880 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial010.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:38:10.801979', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEf/bQ1MNGU/QvYKo5aFg75PEXtp8roQTtlS12+yfEMeZh3MF6TY8pmHFlks3nxeGwsqcuNdTO4b+qG4tzKE3Q='} 2026-02-17T11:41:39.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial071.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:38:10.801432', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPKBnTEuPh6HXl/sovLXhgNf1DsjmASOmiEtNUiHGWo99gs5IgPegV6ee51rQO1yVS2h6beQ2P/SXuef3fnp58='} 2026-02-17T11:41:39.993 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial153.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:38:10.802315', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJRSXd4ODm0OaEPfAdo7UahGUwBBYoiD142C0lXYLpsYCZxC6baRuTuzAz1MBmPEjQ9pJdhQEdi6I3ArKain6ko='} 2026-02-17T11:41:40.049 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial174.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:38:10.802646', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLSwfnKaXenQlDDb6CSnXutvikC48a3wiUb/9Dsd+A4fGDEANrMdXJwi/frujcKvoFRRZ9ny14Ii2uu0kb1hpY='} 2026-02-17T11:41:40.049 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T11:41:40.060 INFO:teuthology.task.internal:roles: ubuntu@trial010.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-17T11:41:40.060 INFO:teuthology.task.internal:roles: ubuntu@trial071.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-17T11:41:40.060 INFO:teuthology.task.internal:roles: ubuntu@trial153.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-17T11:41:40.060 INFO:teuthology.task.internal:roles: ubuntu@trial174.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-17T11:41:40.060 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T11:41:40.315 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7dc9fb1c9b20>, signals=[15]) 2026-02-17T11:41:40.315 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T11:41:40.330 INFO:teuthology.task.internal:Opening connections... 2026-02-17T11:41:40.330 DEBUG:teuthology.task.internal:connecting to ubuntu@trial010.front.sepia.ceph.com 2026-02-17T11:41:40.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:41:40.392 DEBUG:teuthology.task.internal:connecting to ubuntu@trial071.front.sepia.ceph.com 2026-02-17T11:41:40.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:41:40.453 DEBUG:teuthology.task.internal:connecting to ubuntu@trial153.front.sepia.ceph.com 2026-02-17T11:41:40.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:41:40.516 DEBUG:teuthology.task.internal:connecting to ubuntu@trial174.front.sepia.ceph.com 2026-02-17T11:41:40.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:41:40.580 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T11:41:40.591 DEBUG:teuthology.orchestra.run.trial010:> uname -m 2026-02-17T11:41:40.606 INFO:teuthology.orchestra.run.trial010.stdout:x86_64 2026-02-17T11:41:40.606 DEBUG:teuthology.orchestra.run.trial010:> cat /etc/os-release 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:NAME="CentOS Stream" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:VERSION="9" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:ID="centos" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:VERSION_ID="9" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:ANSI_COLOR="0;31" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:41:40.662 INFO:teuthology.orchestra.run.trial010.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:41:40.663 INFO:teuthology.lock.ops:Updating trial010.front.sepia.ceph.com on lock server 2026-02-17T11:41:40.722 DEBUG:teuthology.orchestra.run.trial071:> uname -m 2026-02-17T11:41:40.739 INFO:teuthology.orchestra.run.trial071.stdout:x86_64 2026-02-17T11:41:40.739 DEBUG:teuthology.orchestra.run.trial071:> cat /etc/os-release 2026-02-17T11:41:40.795 INFO:teuthology.orchestra.run.trial071.stdout:NAME="CentOS Stream" 2026-02-17T11:41:40.795 INFO:teuthology.orchestra.run.trial071.stdout:VERSION="9" 2026-02-17T11:41:40.795 INFO:teuthology.orchestra.run.trial071.stdout:ID="centos" 2026-02-17T11:41:40.795 INFO:teuthology.orchestra.run.trial071.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:VERSION_ID="9" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:ANSI_COLOR="0;31" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:41:40.796 INFO:teuthology.orchestra.run.trial071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:41:40.797 INFO:teuthology.lock.ops:Updating trial071.front.sepia.ceph.com on lock server 2026-02-17T11:41:40.873 DEBUG:teuthology.orchestra.run.trial153:> uname -m 2026-02-17T11:41:40.888 INFO:teuthology.orchestra.run.trial153.stdout:x86_64 2026-02-17T11:41:40.888 DEBUG:teuthology.orchestra.run.trial153:> cat /etc/os-release 2026-02-17T11:41:40.944 INFO:teuthology.orchestra.run.trial153.stdout:NAME="CentOS Stream" 2026-02-17T11:41:40.944 INFO:teuthology.orchestra.run.trial153.stdout:VERSION="9" 2026-02-17T11:41:40.944 INFO:teuthology.orchestra.run.trial153.stdout:ID="centos" 2026-02-17T11:41:40.944 INFO:teuthology.orchestra.run.trial153.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:41:40.944 INFO:teuthology.orchestra.run.trial153.stdout:VERSION_ID="9" 2026-02-17T11:41:40.944 INFO:teuthology.orchestra.run.trial153.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:41:40.944 INFO:teuthology.orchestra.run.trial153.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:41:40.945 INFO:teuthology.orchestra.run.trial153.stdout:ANSI_COLOR="0;31" 2026-02-17T11:41:40.945 INFO:teuthology.orchestra.run.trial153.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:41:40.945 INFO:teuthology.orchestra.run.trial153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:41:40.945 INFO:teuthology.orchestra.run.trial153.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:41:40.945 INFO:teuthology.orchestra.run.trial153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:41:40.945 INFO:teuthology.orchestra.run.trial153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:41:40.945 INFO:teuthology.orchestra.run.trial153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:41:40.945 INFO:teuthology.lock.ops:Updating trial153.front.sepia.ceph.com on lock server 2026-02-17T11:41:41.014 DEBUG:teuthology.orchestra.run.trial174:> uname -m 2026-02-17T11:41:41.031 INFO:teuthology.orchestra.run.trial174.stdout:x86_64 2026-02-17T11:41:41.032 DEBUG:teuthology.orchestra.run.trial174:> cat /etc/os-release 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:NAME="CentOS Stream" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:VERSION="9" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:ID="centos" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:VERSION_ID="9" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:ANSI_COLOR="0;31" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:41:41.089 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:41:41.089 INFO:teuthology.lock.ops:Updating trial174.front.sepia.ceph.com on lock server 2026-02-17T11:41:41.149 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T11:41:41.160 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T11:41:41.171 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T11:41:41.171 DEBUG:teuthology.orchestra.run.trial010:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:41:41.172 DEBUG:teuthology.orchestra.run.trial071:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:41:41.174 DEBUG:teuthology.orchestra.run.trial153:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:41:41.175 DEBUG:teuthology.orchestra.run.trial174:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:41:41.192 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T11:41:41.203 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T11:41:41.203 DEBUG:teuthology.orchestra.run.trial010:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:41:41.227 DEBUG:teuthology.orchestra.run.trial071:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:41:41.230 DEBUG:teuthology.orchestra.run.trial153:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:41:41.232 DEBUG:teuthology.orchestra.run.trial174:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:41:41.247 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T11:41:41.482 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T11:41:41.502 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T11:41:41.503 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T11:41:41.503 DEBUG:teuthology.orchestra.run.trial010:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:41:41.503 DEBUG:teuthology.orchestra.run.trial071:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:41:41.503 DEBUG:teuthology.orchestra.run.trial153:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:41:41.503 DEBUG:teuthology.orchestra.run.trial174:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:41:41.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:41:41.518 DEBUG:teuthology.orchestra.run.trial153:> uname -r 2026-02-17T11:41:41.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:41:41.518 DEBUG:teuthology.orchestra.run.trial010:> uname -r 2026-02-17T11:41:41.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:41:41.519 DEBUG:teuthology.orchestra.run.trial071:> uname -r 2026-02-17T11:41:41.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:41:41.520 DEBUG:teuthology.orchestra.run.trial174:> uname -r 2026-02-17T11:41:41.573 INFO:teuthology.orchestra.run.trial153.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:41:41.573 INFO:teuthology.task.kernel:Running kernel on trial153: 5.14.0-645.el9.x86_64 2026-02-17T11:41:41.573 DEBUG:teuthology.orchestra.run.trial153:> sudo yum install -y kernel 2026-02-17T11:41:41.574 INFO:teuthology.orchestra.run.trial010.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:41:41.574 INFO:teuthology.task.kernel:Running kernel on trial010: 5.14.0-645.el9.x86_64 2026-02-17T11:41:41.574 DEBUG:teuthology.orchestra.run.trial010:> sudo yum install -y kernel 2026-02-17T11:41:41.575 INFO:teuthology.orchestra.run.trial174.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:41:41.575 INFO:teuthology.task.kernel:Running kernel on trial174: 5.14.0-645.el9.x86_64 2026-02-17T11:41:41.575 DEBUG:teuthology.orchestra.run.trial174:> sudo yum install -y kernel 2026-02-17T11:41:41.575 INFO:teuthology.orchestra.run.trial071.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:41:41.575 INFO:teuthology.task.kernel:Running kernel on trial071: 5.14.0-645.el9.x86_64 2026-02-17T11:41:41.575 DEBUG:teuthology.orchestra.run.trial071:> sudo yum install -y kernel 2026-02-17T11:41:42.753 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-17T11:41:42.765 INFO:teuthology.orchestra.run.trial071.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-17T11:41:45.831 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.9 MB 00:03 2026-02-17T11:41:45.933 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T11:41:45.980 INFO:teuthology.orchestra.run.trial071.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T11:41:46.671 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - AppStream 85 MB/s | 27 MB 00:00 2026-02-17T11:41:47.396 INFO:teuthology.orchestra.run.trial010.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.9 MB 00:05 2026-02-17T11:41:49.407 INFO:teuthology.orchestra.run.trial071.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 7.8 MB 00:01 2026-02-17T11:41:49.605 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 7.8 MB 00:01 2026-02-17T11:41:50.301 INFO:teuthology.orchestra.run.trial071.stdout:CentOS Stream 9 - Extras packages 120 kB/s | 20 kB 00:00 2026-02-17T11:41:50.503 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 7.8 MB 00:01 2026-02-17T11:41:50.594 INFO:teuthology.orchestra.run.trial010.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T11:41:50.815 INFO:teuthology.orchestra.run.trial071.stdout:Extra Packages for Enterprise Linux 45 MB/s | 20 MB 00:00 2026-02-17T11:41:51.474 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-17T11:41:52.244 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-17T11:41:52.518 INFO:teuthology.orchestra.run.trial153.stdout:Extra Packages for Enterprise Linux 95 MB/s | 20 MB 00:00 2026-02-17T11:41:53.046 INFO:teuthology.orchestra.run.trial174.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-17T11:41:53.993 INFO:teuthology.orchestra.run.trial071.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T11:41:54.467 INFO:teuthology.orchestra.run.trial010.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-17T11:41:55.004 INFO:teuthology.orchestra.run.trial071.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:41:55.024 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout: Package Architecture Version Repository Size 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:Installing dependencies: 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:Install 4 Packages 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 88 M 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 135 M 2026-02-17T11:41:55.025 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:41:55.419 INFO:teuthology.orchestra.run.trial071.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2026-02-17T11:41:55.487 INFO:teuthology.orchestra.run.trial071.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 119 MB/s | 17 MB 00:00 2026-02-17T11:41:55.609 INFO:teuthology.orchestra.run.trial071.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 149 MB/s | 40 MB 00:00 2026-02-17T11:41:55.666 INFO:teuthology.orchestra.run.trial071.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 126 MB/s | 31 MB 00:00 2026-02-17T11:41:55.668 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:41:55.668 INFO:teuthology.orchestra.run.trial071.stdout:Total 137 MB/s | 88 MB 00:00 2026-02-17T11:41:55.693 INFO:teuthology.orchestra.run.trial010.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 20 kB 00:00 2026-02-17T11:41:55.732 INFO:teuthology.orchestra.run.trial153.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-17T11:41:55.858 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:41:56.070 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:41:56.070 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:41:56.210 INFO:teuthology.orchestra.run.trial174.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T11:41:56.417 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:41:56.417 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:41:56.743 INFO:teuthology.orchestra.run.trial153.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:41:56.763 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:41:56.764 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:41:56.764 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T11:41:56.764 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout:Install 4 Packages 2026-02-17T11:41:56.765 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:41:56.766 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 88 M 2026-02-17T11:41:56.766 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 135 M 2026-02-17T11:41:56.766 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:41:56.980 INFO:teuthology.orchestra.run.trial153.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2026-02-17T11:41:57.125 INFO:teuthology.orchestra.run.trial153.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 62 MB/s | 17 MB 00:00 2026-02-17T11:41:57.155 INFO:teuthology.orchestra.run.trial010.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-17T11:41:57.233 INFO:teuthology.orchestra.run.trial174.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:41:57.253 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:41:57.254 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout: Package Architecture Version Repository Size 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout:Install 4 Packages 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 88 M 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 135 M 2026-02-17T11:41:57.255 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:41:57.273 INFO:teuthology.orchestra.run.trial153.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 105 MB/s | 31 MB 00:00 2026-02-17T11:41:57.502 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:41:57.578 INFO:teuthology.orchestra.run.trial153.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 54 MB/s | 40 MB 00:00 2026-02-17T11:41:57.579 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:41:57.579 INFO:teuthology.orchestra.run.trial153.stdout:Total 108 MB/s | 88 MB 00:00 2026-02-17T11:41:57.768 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:41:57.783 INFO:teuthology.orchestra.run.trial071.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:41:57.802 INFO:teuthology.orchestra.run.trial071.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:41:57.948 INFO:teuthology.orchestra.run.trial174.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-17T11:41:57.970 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:41:57.970 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:41:58.316 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:41:58.316 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:41:58.489 INFO:teuthology.orchestra.run.trial174.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 15 MB/s | 17 MB 00:01 2026-02-17T11:41:59.017 INFO:teuthology.orchestra.run.trial174.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-17T11:41:59.229 INFO:teuthology.orchestra.run.trial174.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-17T11:41:59.229 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:41:59.229 INFO:teuthology.orchestra.run.trial174.stdout:Total 45 MB/s | 88 MB 00:01 2026-02-17T11:41:59.408 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:41:59.421 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:41:59.591 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:41:59.618 INFO:teuthology.orchestra.run.trial071.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:41:59.625 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:41:59.625 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:41:59.694 INFO:teuthology.orchestra.run.trial153.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:41:59.713 INFO:teuthology.orchestra.run.trial153.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:41:59.970 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:41:59.971 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:42:00.290 INFO:teuthology.orchestra.run.trial010.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-17T11:42:01.055 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:42:01.308 INFO:teuthology.orchestra.run.trial010.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:42:01.328 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:42:01.329 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:42:01.329 INFO:teuthology.orchestra.run.trial010.stdout: Package Architecture Version Repository Size 2026-02-17T11:42:01.329 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:42:01.329 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:42:01.329 INFO:teuthology.orchestra.run.trial010.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:42:01.329 INFO:teuthology.orchestra.run.trial010.stdout:Installing dependencies: 2026-02-17T11:42:01.329 INFO:teuthology.orchestra.run.trial010.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:42:01.330 INFO:teuthology.orchestra.run.trial010.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:42:01.330 INFO:teuthology.orchestra.run.trial010.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:42:01.330 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:42:01.330 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:42:01.330 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:42:01.330 INFO:teuthology.orchestra.run.trial010.stdout:Install 4 Packages 2026-02-17T11:42:01.330 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:42:01.330 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 88 M 2026-02-17T11:42:01.331 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 135 M 2026-02-17T11:42:01.331 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:42:01.340 INFO:teuthology.orchestra.run.trial174.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:42:01.359 INFO:teuthology.orchestra.run.trial174.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:42:01.499 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:42:01.528 INFO:teuthology.orchestra.run.trial153.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:01.832 INFO:teuthology.orchestra.run.trial010.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2026-02-17T11:42:01.960 INFO:teuthology.orchestra.run.trial010.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 90 MB/s | 17 MB 00:00 2026-02-17T11:42:02.329 INFO:teuthology.orchestra.run.trial010.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 71 MB/s | 40 MB 00:00 2026-02-17T11:42:02.703 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:02.709 INFO:teuthology.orchestra.run.trial071.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:02.912 INFO:teuthology.orchestra.run.trial010.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-17T11:42:02.912 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:42:02.912 INFO:teuthology.orchestra.run.trial010.stdout:Total 56 MB/s | 88 MB 00:01 2026-02-17T11:42:03.102 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:42:03.147 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:42:03.176 INFO:teuthology.orchestra.run.trial174.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:03.306 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:42:03.307 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:42:03.652 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:42:03.653 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:42:04.617 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:04.624 INFO:teuthology.orchestra.run.trial153.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:04.740 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:42:05.021 INFO:teuthology.orchestra.run.trial010.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:42:05.040 INFO:teuthology.orchestra.run.trial010.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:42:05.744 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:06.201 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:06.208 INFO:teuthology.orchestra.run.trial174.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:06.825 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:42:06.853 INFO:teuthology.orchestra.run.trial010.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:07.658 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:09.244 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:09.876 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:09.882 INFO:teuthology.orchestra.run.trial010.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:12.916 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:36.328 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:36.349 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:36.412 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:36.413 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:42:36.413 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:42:36.413 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:36.467 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:36.467 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:42:36.467 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:42:36.467 INFO:teuthology.orchestra.run.trial071.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:36.468 INFO:teuthology.orchestra.run.trial071.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:42:36.468 INFO:teuthology.orchestra.run.trial071.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:42:36.468 INFO:teuthology.orchestra.run.trial071.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:42:36.468 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:42:36.468 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:42:36.526 DEBUG:teuthology.orchestra.run.trial071:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:42:36.551 INFO:teuthology.orchestra.run.trial071.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:36.553 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:42:36.553 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:42:36.553 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:42:36.553 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:42:36.553 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-17T11:42:36.553 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial071.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:42:36.553 DEBUG:teuthology.orchestra.run.trial071:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:42:36.617 INFO:teuthology.orchestra.run.trial071.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:36.618 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:42:36.618 DEBUG:teuthology.orchestra.run.trial071:> sudo rpm -qi grub2-tools 2026-02-17T11:42:36.685 INFO:teuthology.orchestra.run.trial071.stdout:Name : grub2-tools 2026-02-17T11:42:36.686 INFO:teuthology.orchestra.run.trial071.stdout:Epoch : 1 2026-02-17T11:42:36.686 INFO:teuthology.orchestra.run.trial071.stdout:Version : 2.06 2026-02-17T11:42:36.686 INFO:teuthology.orchestra.run.trial071.stdout:Release : 118.el9 2026-02-17T11:42:36.686 INFO:teuthology.orchestra.run.trial071.stdout:Architecture: x86_64 2026-02-17T11:42:36.686 INFO:teuthology.orchestra.run.trial071.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:42:36.686 INFO:teuthology.orchestra.run.trial071.stdout:Group : Unspecified 2026-02-17T11:42:36.686 INFO:teuthology.orchestra.run.trial071.stdout:Size : 8393909 2026-02-17T11:42:36.686 INFO:teuthology.orchestra.run.trial071.stdout:License : GPLv3+ 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:Packager : builder@centos.org 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:Vendor : CentOS 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:Summary : Support tools for GRUB. 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:Description : 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:42:36.687 INFO:teuthology.orchestra.run.trial071.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:42:36.688 INFO:teuthology.orchestra.run.trial071.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:42:36.688 INFO:teuthology.orchestra.run.trial071.stdout:hardware devices. 2026-02-17T11:42:36.688 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:42:36.688 INFO:teuthology.orchestra.run.trial071.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:42:36.689 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:42:36.689 INFO:teuthology.task.kernel:Updating grub on trial071 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:42:36.689 DEBUG:teuthology.orchestra.run.trial071:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:42:36.752 INFO:teuthology.orchestra.run.trial071.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:42:36.754 DEBUG:teuthology.orchestra.run.trial071:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:42:36.817 INFO:teuthology.orchestra.run.trial071.stdout:/sbin/grubby 2026-02-17T11:42:36.819 INFO:teuthology.orchestra.run.trial071.stdout:yes 2026-02-17T11:42:36.819 DEBUG:teuthology.orchestra.run.trial071:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:42:36.883 INFO:teuthology.orchestra.run.trial071.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:42:36.884 DEBUG:teuthology.orchestra.run.trial071:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:42:36.956 DEBUG:teuthology.orchestra.run.trial071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:42:37.164 INFO:teuthology.orchestra.run.trial071.stderr:Generating grub configuration file ... 2026-02-17T11:42:37.227 INFO:teuthology.orchestra.run.trial071.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:42:37.234 INFO:teuthology.orchestra.run.trial071.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:42:37.488 INFO:teuthology.orchestra.run.trial071.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:42:37.494 INFO:teuthology.orchestra.run.trial071.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:42:37.526 INFO:teuthology.orchestra.run.trial071.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:42:37.533 INFO:teuthology.orchestra.run.trial071.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:42:37.556 INFO:teuthology.orchestra.run.trial071.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:42:37.563 INFO:teuthology.orchestra.run.trial071.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:42:37.644 INFO:teuthology.orchestra.run.trial071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:42:37.653 INFO:teuthology.orchestra.run.trial071.stderr:done 2026-02-17T11:42:37.655 DEBUG:teuthology.orchestra.run.trial071:> test -d /sys/firmware/efi 2026-02-17T11:42:37.670 DEBUG:teuthology.orchestra.run.trial071:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:42:37.735 INFO:teuthology.orchestra.run.trial071.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:42:37.735 INFO:teuthology.orchestra.run.trial071.stdout:/boot/efi/EFI/centos 2026-02-17T11:42:37.737 DEBUG:teuthology.orchestra.run.trial071:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:42:37.800 INFO:teuthology.orchestra.run.trial071.stdout:no 2026-02-17T11:42:37.801 DEBUG:teuthology.orchestra.run.trial071:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:42:37.866 INFO:teuthology.orchestra.run.trial071.stdout:yes 2026-02-17T11:42:37.866 DEBUG:teuthology.orchestra.run.trial071:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:42:37.931 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial071 2026-02-17T11:42:37.931 DEBUG:teuthology.orchestra.run.trial071:> sudo bash -c ' 2026-02-17T11:42:37.931 DEBUG:teuthology.orchestra.run.trial071:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:42:37.931 DEBUG:teuthology.orchestra.run.trial071:> ' 2026-02-17T11:42:38.210 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:38.231 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:38.294 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:38.294 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:42:38.294 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:42:38.294 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:38.346 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:38.346 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:42:38.347 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:42:38.347 INFO:teuthology.orchestra.run.trial153.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:38.347 INFO:teuthology.orchestra.run.trial153.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:42:38.347 INFO:teuthology.orchestra.run.trial153.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:42:38.347 INFO:teuthology.orchestra.run.trial153.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:42:38.347 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:42:38.347 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:42:38.404 DEBUG:teuthology.orchestra.run.trial153:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:42:38.430 INFO:teuthology.orchestra.run.trial153.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:38.430 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:42:38.430 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:42:38.430 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:42:38.430 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:42:38.430 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-17T11:42:38.430 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial153.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:42:38.430 DEBUG:teuthology.orchestra.run.trial153:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:42:38.493 INFO:teuthology.orchestra.run.trial153.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:38.494 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:42:38.494 DEBUG:teuthology.orchestra.run.trial153:> sudo rpm -qi grub2-tools 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Name : grub2-tools 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Epoch : 1 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Version : 2.06 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Release : 118.el9 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Architecture: x86_64 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Group : Unspecified 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Size : 8393909 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:License : GPLv3+ 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Packager : builder@centos.org 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Vendor : CentOS 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Summary : Support tools for GRUB. 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout:Description : 2026-02-17T11:42:38.562 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:42:38.563 INFO:teuthology.orchestra.run.trial153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:42:38.563 INFO:teuthology.orchestra.run.trial153.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:42:38.563 INFO:teuthology.orchestra.run.trial153.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:42:38.563 INFO:teuthology.orchestra.run.trial153.stdout:hardware devices. 2026-02-17T11:42:38.563 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:42:38.563 INFO:teuthology.orchestra.run.trial153.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:42:38.564 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:42:38.564 INFO:teuthology.task.kernel:Updating grub on trial153 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:42:38.564 DEBUG:teuthology.orchestra.run.trial153:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:42:38.627 INFO:teuthology.orchestra.run.trial153.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:42:38.628 DEBUG:teuthology.orchestra.run.trial153:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:42:38.691 INFO:teuthology.orchestra.run.trial153.stdout:/sbin/grubby 2026-02-17T11:42:38.692 INFO:teuthology.orchestra.run.trial153.stdout:yes 2026-02-17T11:42:38.693 DEBUG:teuthology.orchestra.run.trial153:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:42:38.758 INFO:teuthology.orchestra.run.trial153.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:42:38.758 DEBUG:teuthology.orchestra.run.trial153:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:42:38.831 DEBUG:teuthology.orchestra.run.trial153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:42:39.040 INFO:teuthology.orchestra.run.trial153.stderr:Generating grub configuration file ... 2026-02-17T11:42:39.103 INFO:teuthology.orchestra.run.trial153.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:42:39.110 INFO:teuthology.orchestra.run.trial153.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:42:39.359 INFO:teuthology.orchestra.run.trial153.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:42:39.365 INFO:teuthology.orchestra.run.trial153.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:42:39.397 INFO:teuthology.orchestra.run.trial153.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:42:39.404 INFO:teuthology.orchestra.run.trial153.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:42:39.428 INFO:teuthology.orchestra.run.trial153.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:42:39.435 INFO:teuthology.orchestra.run.trial153.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:42:39.516 INFO:teuthology.orchestra.run.trial153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:42:39.524 INFO:teuthology.orchestra.run.trial153.stderr:done 2026-02-17T11:42:39.526 DEBUG:teuthology.orchestra.run.trial153:> test -d /sys/firmware/efi 2026-02-17T11:42:39.541 DEBUG:teuthology.orchestra.run.trial153:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:42:39.606 INFO:teuthology.orchestra.run.trial153.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:42:39.606 INFO:teuthology.orchestra.run.trial153.stdout:/boot/efi/EFI/centos 2026-02-17T11:42:39.608 DEBUG:teuthology.orchestra.run.trial153:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:42:39.697 INFO:teuthology.orchestra.run.trial153.stdout:no 2026-02-17T11:42:39.697 DEBUG:teuthology.orchestra.run.trial153:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:42:39.718 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:39.739 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:39.773 INFO:teuthology.orchestra.run.trial153.stdout:yes 2026-02-17T11:42:39.773 DEBUG:teuthology.orchestra.run.trial153:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:42:39.806 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:39.807 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:42:39.807 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:42:39.807 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:39.839 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial153 2026-02-17T11:42:39.839 DEBUG:teuthology.orchestra.run.trial153:> sudo bash -c ' 2026-02-17T11:42:39.839 DEBUG:teuthology.orchestra.run.trial153:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:42:39.839 DEBUG:teuthology.orchestra.run.trial153:> ' 2026-02-17T11:42:39.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:39.860 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:42:39.860 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:42:39.860 INFO:teuthology.orchestra.run.trial174.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:39.860 INFO:teuthology.orchestra.run.trial174.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:42:39.860 INFO:teuthology.orchestra.run.trial174.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:42:39.860 INFO:teuthology.orchestra.run.trial174.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:42:39.860 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:42:39.860 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:42:39.919 DEBUG:teuthology.orchestra.run.trial174:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:42:39.946 INFO:teuthology.orchestra.run.trial174.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:39.946 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:42:39.946 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:42:39.947 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:42:39.947 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:42:39.947 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-17T11:42:39.947 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial174.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:42:39.947 DEBUG:teuthology.orchestra.run.trial174:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:42:40.008 INFO:teuthology.orchestra.run.trial174.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:40.010 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:42:40.010 DEBUG:teuthology.orchestra.run.trial174:> sudo rpm -qi grub2-tools 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Name : grub2-tools 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Epoch : 1 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Version : 2.06 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Release : 118.el9 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Architecture: x86_64 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Group : Unspecified 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Size : 8393909 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:License : GPLv3+ 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:42:40.078 INFO:teuthology.orchestra.run.trial174.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:Packager : builder@centos.org 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:Vendor : CentOS 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:Summary : Support tools for GRUB. 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:Description : 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:hardware devices. 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:42:40.079 INFO:teuthology.orchestra.run.trial174.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:42:40.080 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:42:40.080 INFO:teuthology.task.kernel:Updating grub on trial174 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:42:40.080 DEBUG:teuthology.orchestra.run.trial174:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:42:40.143 INFO:teuthology.orchestra.run.trial174.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:42:40.144 DEBUG:teuthology.orchestra.run.trial174:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:42:40.207 INFO:teuthology.orchestra.run.trial174.stdout:/sbin/grubby 2026-02-17T11:42:40.208 INFO:teuthology.orchestra.run.trial174.stdout:yes 2026-02-17T11:42:40.208 DEBUG:teuthology.orchestra.run.trial174:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:42:40.273 INFO:teuthology.orchestra.run.trial174.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:42:40.273 DEBUG:teuthology.orchestra.run.trial174:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:42:40.346 DEBUG:teuthology.orchestra.run.trial174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:42:40.550 INFO:teuthology.orchestra.run.trial174.stderr:Generating grub configuration file ... 2026-02-17T11:42:40.614 INFO:teuthology.orchestra.run.trial174.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:42:40.620 INFO:teuthology.orchestra.run.trial174.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:42:40.871 INFO:teuthology.orchestra.run.trial174.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:42:40.877 INFO:teuthology.orchestra.run.trial174.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:42:40.909 INFO:teuthology.orchestra.run.trial174.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:42:40.915 INFO:teuthology.orchestra.run.trial174.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:42:40.938 INFO:teuthology.orchestra.run.trial174.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:42:40.945 INFO:teuthology.orchestra.run.trial174.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:42:41.027 INFO:teuthology.orchestra.run.trial174.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:42:41.035 INFO:teuthology.orchestra.run.trial174.stderr:done 2026-02-17T11:42:41.037 DEBUG:teuthology.orchestra.run.trial174:> test -d /sys/firmware/efi 2026-02-17T11:42:41.053 DEBUG:teuthology.orchestra.run.trial174:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:42:41.118 INFO:teuthology.orchestra.run.trial174.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:42:41.118 INFO:teuthology.orchestra.run.trial174.stdout:/boot/efi/EFI/centos 2026-02-17T11:42:41.120 DEBUG:teuthology.orchestra.run.trial174:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:42:41.185 INFO:teuthology.orchestra.run.trial174.stdout:no 2026-02-17T11:42:41.186 DEBUG:teuthology.orchestra.run.trial174:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:42:41.249 INFO:teuthology.orchestra.run.trial174.stdout:yes 2026-02-17T11:42:41.250 DEBUG:teuthology.orchestra.run.trial174:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:42:41.313 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial174 2026-02-17T11:42:41.314 DEBUG:teuthology.orchestra.run.trial174:> sudo bash -c ' 2026-02-17T11:42:41.314 DEBUG:teuthology.orchestra.run.trial174:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:42:41.314 DEBUG:teuthology.orchestra.run.trial174:> ' 2026-02-17T11:42:43.445 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:43.465 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:43.636 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:43.637 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:42:43.637 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:42:43.637 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:42:43.687 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:42:43.687 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:42:43.687 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:42:43.687 INFO:teuthology.orchestra.run.trial010.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:43.687 INFO:teuthology.orchestra.run.trial010.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:42:43.687 INFO:teuthology.orchestra.run.trial010.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:42:43.687 INFO:teuthology.orchestra.run.trial010.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:42:43.687 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:42:43.687 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:42:43.744 DEBUG:teuthology.orchestra.run.trial010:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:42:43.771 INFO:teuthology.orchestra.run.trial010.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:43.771 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:42:43.772 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:42:43.772 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:42:43.772 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:42:43.772 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T11:42:43.772 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial010.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:42:43.772 DEBUG:teuthology.orchestra.run.trial010:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:42:43.833 INFO:teuthology.orchestra.run.trial010.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:42:43.834 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:42:43.834 DEBUG:teuthology.orchestra.run.trial010:> sudo rpm -qi grub2-tools 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Name : grub2-tools 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Epoch : 1 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Version : 2.06 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Release : 118.el9 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Architecture: x86_64 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Group : Unspecified 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Size : 8393909 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:License : GPLv3+ 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Packager : builder@centos.org 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Vendor : CentOS 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Summary : Support tools for GRUB. 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:Description : 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:42:43.902 INFO:teuthology.orchestra.run.trial010.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:42:43.903 INFO:teuthology.orchestra.run.trial010.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:42:43.903 INFO:teuthology.orchestra.run.trial010.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:42:43.903 INFO:teuthology.orchestra.run.trial010.stdout:hardware devices. 2026-02-17T11:42:43.903 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:42:43.903 INFO:teuthology.orchestra.run.trial010.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:42:43.903 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:42:43.903 INFO:teuthology.task.kernel:Updating grub on trial010 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:42:43.903 DEBUG:teuthology.orchestra.run.trial010:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:42:43.967 INFO:teuthology.orchestra.run.trial010.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:42:43.968 DEBUG:teuthology.orchestra.run.trial010:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:42:44.031 INFO:teuthology.orchestra.run.trial010.stdout:/sbin/grubby 2026-02-17T11:42:44.033 INFO:teuthology.orchestra.run.trial010.stdout:yes 2026-02-17T11:42:44.033 DEBUG:teuthology.orchestra.run.trial010:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:42:44.098 INFO:teuthology.orchestra.run.trial010.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:42:44.099 DEBUG:teuthology.orchestra.run.trial010:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:42:44.171 DEBUG:teuthology.orchestra.run.trial010:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:42:44.380 INFO:teuthology.orchestra.run.trial010.stderr:Generating grub configuration file ... 2026-02-17T11:42:44.443 INFO:teuthology.orchestra.run.trial010.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:42:44.449 INFO:teuthology.orchestra.run.trial010.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:42:44.702 INFO:teuthology.orchestra.run.trial010.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:42:44.708 INFO:teuthology.orchestra.run.trial010.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:42:44.740 INFO:teuthology.orchestra.run.trial010.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:42:44.746 INFO:teuthology.orchestra.run.trial010.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:42:44.769 INFO:teuthology.orchestra.run.trial010.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:42:44.776 INFO:teuthology.orchestra.run.trial010.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:42:44.858 INFO:teuthology.orchestra.run.trial010.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:42:44.867 INFO:teuthology.orchestra.run.trial010.stderr:done 2026-02-17T11:42:44.868 DEBUG:teuthology.orchestra.run.trial010:> test -d /sys/firmware/efi 2026-02-17T11:42:44.884 DEBUG:teuthology.orchestra.run.trial010:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:42:44.950 INFO:teuthology.orchestra.run.trial010.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:42:44.950 INFO:teuthology.orchestra.run.trial010.stdout:/boot/efi/EFI/centos 2026-02-17T11:42:44.952 DEBUG:teuthology.orchestra.run.trial010:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:42:45.017 INFO:teuthology.orchestra.run.trial010.stdout:no 2026-02-17T11:42:45.017 DEBUG:teuthology.orchestra.run.trial010:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:42:45.081 INFO:teuthology.orchestra.run.trial010.stdout:yes 2026-02-17T11:42:45.081 DEBUG:teuthology.orchestra.run.trial010:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:42:45.146 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial010 2026-02-17T11:42:45.146 DEBUG:teuthology.orchestra.run.trial010:> sudo bash -c ' 2026-02-17T11:42:45.146 DEBUG:teuthology.orchestra.run.trial010:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:42:45.147 DEBUG:teuthology.orchestra.run.trial010:> ' 2026-02-17T11:43:07.974 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-17T11:43:07.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial071.front.sepia.ceph.com' 2026-02-17T11:43:07.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:09.881 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-17T11:43:09.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T11:43:09.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:11.356 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-17T11:43:11.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-17T11:43:11.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:15.189 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T11:43:15.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-17T11:43:15.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:22.241 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.71 2026-02-17T11:43:24.160 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.153 2026-02-17T11:43:25.632 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.174 2026-02-17T11:43:29.472 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.10 2026-02-17T11:43:31.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial071.front.sepia.ceph.com' 2026-02-17T11:43:31.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:33.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T11:43:33.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:34.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-17T11:43:34.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:38.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-17T11:43:38.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:44:07.173 DEBUG:teuthology.orchestra.run.trial071:> true 2026-02-17T11:44:07.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial071.front.sepia.ceph.com' 2026-02-17T11:44:07.325 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T11:44:07.325 DEBUG:teuthology.orchestra.run.trial071:> uname -r 2026-02-17T11:44:07.382 INFO:teuthology.orchestra.run.trial071.stdout:5.14.0-681.el9.x86_64 2026-02-17T11:44:07.382 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T11:44:07.382 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:44:07.382 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T11:44:08.384 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-17T11:44:08.384 DEBUG:teuthology.orchestra.run.trial071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:44:08.414 INFO:teuthology.orchestra.run.trial071.stdout:ttyS1 2026-02-17T11:44:08.436 DEBUG:teuthology.parallel:result is None 2026-02-17T11:44:09.226 DEBUG:teuthology.orchestra.run.trial153:> true 2026-02-17T11:44:09.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T11:44:09.383 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-681.el9.x86_64"... 2026-02-17T11:44:09.383 DEBUG:teuthology.orchestra.run.trial153:> uname -r 2026-02-17T11:44:09.439 INFO:teuthology.orchestra.run.trial153.stdout:5.14.0-681.el9.x86_64 2026-02-17T11:44:09.439 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T11:44:09.439 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:44:09.439 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T11:44:10.440 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-17T11:44:10.441 DEBUG:teuthology.orchestra.run.trial153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:44:10.470 INFO:teuthology.orchestra.run.trial153.stdout:ttyS1 2026-02-17T11:44:10.490 DEBUG:teuthology.parallel:result is None 2026-02-17T11:44:10.725 DEBUG:teuthology.orchestra.run.trial174:> true 2026-02-17T11:44:10.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-17T11:44:10.868 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-681.el9.x86_64"... 2026-02-17T11:44:10.868 DEBUG:teuthology.orchestra.run.trial174:> uname -r 2026-02-17T11:44:10.923 INFO:teuthology.orchestra.run.trial174.stdout:5.14.0-681.el9.x86_64 2026-02-17T11:44:10.923 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T11:44:10.923 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:44:10.923 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T11:44:11.924 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-17T11:44:11.925 DEBUG:teuthology.orchestra.run.trial174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:44:11.952 INFO:teuthology.orchestra.run.trial174.stdout:ttyS1 2026-02-17T11:44:11.969 DEBUG:teuthology.parallel:result is None 2026-02-17T11:44:14.340 DEBUG:teuthology.orchestra.run.trial010:> true 2026-02-17T11:44:14.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-17T11:44:14.506 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T11:44:14.506 DEBUG:teuthology.orchestra.run.trial010:> uname -r 2026-02-17T11:44:14.562 INFO:teuthology.orchestra.run.trial010.stdout:5.14.0-681.el9.x86_64 2026-02-17T11:44:14.562 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T11:44:14.562 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:44:14.562 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T11:44:15.563 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T11:44:15.564 DEBUG:teuthology.orchestra.run.trial010:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:44:15.594 INFO:teuthology.orchestra.run.trial010.stdout:ttyS1 2026-02-17T11:44:15.615 DEBUG:teuthology.parallel:result is None 2026-02-17T11:44:15.616 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T11:44:15.629 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T11:44:15.630 DEBUG:teuthology.orchestra.run.trial010:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:44:15.658 DEBUG:teuthology.orchestra.run.trial071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:44:15.661 DEBUG:teuthology.orchestra.run.trial153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:44:15.663 DEBUG:teuthology.orchestra.run.trial174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:44:15.682 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T11:44:15.694 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T11:44:15.705 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T11:44:15.705 DEBUG:teuthology.orchestra.run.trial010:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:44:15.714 DEBUG:teuthology.orchestra.run.trial071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:44:15.718 DEBUG:teuthology.orchestra.run.trial153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:44:15.722 DEBUG:teuthology.orchestra.run.trial174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:44:15.748 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T11:44:15.760 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T11:44:15.761 DEBUG:teuthology.orchestra.run.trial010:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:44:15.771 DEBUG:teuthology.orchestra.run.trial071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:44:15.775 DEBUG:teuthology.orchestra.run.trial153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:44:15.780 DEBUG:teuthology.orchestra.run.trial174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:44:15.794 INFO:teuthology.orchestra.run.trial010.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:44:15.798 INFO:teuthology.orchestra.run.trial071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:44:15.801 INFO:teuthology.orchestra.run.trial153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:44:15.802 INFO:teuthology.orchestra.run.trial010.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:44:15.804 INFO:teuthology.orchestra.run.trial174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:44:15.807 INFO:teuthology.orchestra.run.trial071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:44:15.810 INFO:teuthology.orchestra.run.trial153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:44:15.813 INFO:teuthology.orchestra.run.trial174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:44:15.814 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T11:44:15.827 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T11:44:15.827 DEBUG:teuthology.orchestra.run.trial010:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:44:15.847 DEBUG:teuthology.orchestra.run.trial071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:44:15.852 DEBUG:teuthology.orchestra.run.trial153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:44:15.854 DEBUG:teuthology.orchestra.run.trial174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:44:15.878 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T11:44:15.894 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T11:44:15.895 DEBUG:teuthology.orchestra.run.trial010:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:44:15.911 DEBUG:teuthology.orchestra.run.trial071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:44:15.919 DEBUG:teuthology.orchestra.run.trial153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:44:15.921 DEBUG:teuthology.orchestra.run.trial174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:44:15.938 DEBUG:teuthology.orchestra.run.trial010:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:44:16.081 DEBUG:teuthology.orchestra.run.trial010:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:44:16.106 DEBUG:teuthology.orchestra.run.trial010:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:44:16.248 DEBUG:teuthology.orchestra.run.trial010:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:44:16.272 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:44:16.273 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:44:16.336 DEBUG:teuthology.orchestra.run.trial071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:44:16.452 DEBUG:teuthology.orchestra.run.trial071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:44:16.477 DEBUG:teuthology.orchestra.run.trial071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:44:16.622 DEBUG:teuthology.orchestra.run.trial071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:44:16.647 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:44:16.647 DEBUG:teuthology.orchestra.run.trial071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:44:16.711 DEBUG:teuthology.orchestra.run.trial153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:44:16.829 DEBUG:teuthology.orchestra.run.trial153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:44:16.854 DEBUG:teuthology.orchestra.run.trial153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:44:16.997 DEBUG:teuthology.orchestra.run.trial153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:44:17.022 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:44:17.022 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:44:17.087 DEBUG:teuthology.orchestra.run.trial174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:44:17.203 DEBUG:teuthology.orchestra.run.trial174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:44:17.229 DEBUG:teuthology.orchestra.run.trial174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:44:17.373 DEBUG:teuthology.orchestra.run.trial174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:44:17.398 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:44:17.398 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:44:17.463 DEBUG:teuthology.orchestra.run.trial010:> sudo service rsyslog restart 2026-02-17T11:44:17.472 DEBUG:teuthology.orchestra.run.trial071:> sudo service rsyslog restart 2026-02-17T11:44:17.478 DEBUG:teuthology.orchestra.run.trial153:> sudo service rsyslog restart 2026-02-17T11:44:17.481 DEBUG:teuthology.orchestra.run.trial174:> sudo service rsyslog restart 2026-02-17T11:44:17.498 INFO:teuthology.orchestra.run.trial010.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:44:17.504 INFO:teuthology.orchestra.run.trial071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:44:17.507 INFO:teuthology.orchestra.run.trial153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:44:17.532 INFO:teuthology.orchestra.run.trial174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:44:18.016 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T11:44:18.029 INFO:teuthology.task.internal:Starting timer... 2026-02-17T11:44:18.029 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T11:44:18.050 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T11:44:18.071 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T11:44:18.071 DEBUG:teuthology.orchestra.run.trial010:> sudo service auditd rotate 2026-02-17T11:44:18.100 INFO:teuthology.orchestra.run.trial010.stdout:Rotating logs: 2026-02-17T11:44:18.102 DEBUG:teuthology.orchestra.run.trial071:> sudo service auditd rotate 2026-02-17T11:44:18.131 INFO:teuthology.orchestra.run.trial071.stdout:Rotating logs: 2026-02-17T11:44:18.133 DEBUG:teuthology.orchestra.run.trial153:> sudo service auditd rotate 2026-02-17T11:44:18.164 INFO:teuthology.orchestra.run.trial153.stdout:Rotating logs: 2026-02-17T11:44:18.165 DEBUG:teuthology.orchestra.run.trial174:> sudo service auditd rotate 2026-02-17T11:44:18.195 INFO:teuthology.orchestra.run.trial174.stdout:Rotating logs: 2026-02-17T11:44:18.197 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T11:44:18.197 DEBUG:teuthology.orchestra.run.trial010:> /usr/sbin/getenforce 2026-02-17T11:44:18.215 INFO:teuthology.orchestra.run.trial010.stdout:Permissive 2026-02-17T11:44:18.215 DEBUG:teuthology.orchestra.run.trial071:> /usr/sbin/getenforce 2026-02-17T11:44:18.232 INFO:teuthology.orchestra.run.trial071.stdout:Permissive 2026-02-17T11:44:18.233 DEBUG:teuthology.orchestra.run.trial153:> /usr/sbin/getenforce 2026-02-17T11:44:18.251 INFO:teuthology.orchestra.run.trial153.stdout:Permissive 2026-02-17T11:44:18.251 DEBUG:teuthology.orchestra.run.trial174:> /usr/sbin/getenforce 2026-02-17T11:44:18.267 INFO:teuthology.orchestra.run.trial174.stdout:Permissive 2026-02-17T11:44:18.267 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial010.front.sepia.ceph.com': 'permissive', 'ubuntu@trial071.front.sepia.ceph.com': 'permissive', 'ubuntu@trial153.front.sepia.ceph.com': 'permissive', 'ubuntu@trial174.front.sepia.ceph.com': 'permissive'} 2026-02-17T11:44:18.268 DEBUG:teuthology.orchestra.run.trial010:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:44:18.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:44:18.293 DEBUG:teuthology.orchestra.run.trial071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:44:18.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:44:18.319 DEBUG:teuthology.orchestra.run.trial153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:44:18.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:44:18.345 DEBUG:teuthology.orchestra.run.trial174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:44:18.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:44:18.372 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T11:44:18.372 DEBUG:teuthology.orchestra.run.trial010:> sudo /usr/sbin/setenforce permissive 2026-02-17T11:44:18.398 DEBUG:teuthology.orchestra.run.trial071:> sudo /usr/sbin/setenforce permissive 2026-02-17T11:44:18.423 DEBUG:teuthology.orchestra.run.trial153:> sudo /usr/sbin/setenforce permissive 2026-02-17T11:44:18.448 DEBUG:teuthology.orchestra.run.trial174:> sudo /usr/sbin/setenforce permissive 2026-02-17T11:44:18.473 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T11:44:18.488 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T11:44:18.502 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T11:44:18.503 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial010.front.sepia.ceph.com,trial071.front.sepia.ceph.com,trial153.front.sepia.ceph.com,trial174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T11:47:05.245 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial010.front.sepia.ceph.com'), Remote(name='ubuntu@trial071.front.sepia.ceph.com'), Remote(name='ubuntu@trial153.front.sepia.ceph.com'), Remote(name='ubuntu@trial174.front.sepia.ceph.com')] 2026-02-17T11:47:05.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-17T11:47:05.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:47:05.365 DEBUG:teuthology.orchestra.run.trial010:> true 2026-02-17T11:47:05.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-17T11:47:05.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial071.front.sepia.ceph.com' 2026-02-17T11:47:05.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:47:05.511 DEBUG:teuthology.orchestra.run.trial071:> true 2026-02-17T11:47:05.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial071.front.sepia.ceph.com' 2026-02-17T11:47:05.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T11:47:05.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:47:05.697 DEBUG:teuthology.orchestra.run.trial153:> true 2026-02-17T11:47:05.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T11:47:05.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-17T11:47:05.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:47:05.864 DEBUG:teuthology.orchestra.run.trial174:> true 2026-02-17T11:47:05.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-17T11:47:05.945 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T11:47:05.960 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T11:47:05.960 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:47:05.961 DEBUG:teuthology.orchestra.run.trial010:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:47:05.964 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:47:05.964 DEBUG:teuthology.orchestra.run.trial071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:47:05.967 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:47:05.967 DEBUG:teuthology.orchestra.run.trial153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:47:05.969 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:47:05.970 DEBUG:teuthology.orchestra.run.trial174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:47:05.989 INFO:teuthology.orchestra.run.trial010.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:47:05.993 INFO:teuthology.orchestra.run.trial071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:47:05.995 INFO:teuthology.orchestra.run.trial153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:47:06.000 INFO:teuthology.orchestra.run.trial010.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:47:06.005 INFO:teuthology.orchestra.run.trial071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:47:06.006 INFO:teuthology.orchestra.run.trial153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:47:06.010 INFO:teuthology.orchestra.run.trial174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:47:06.021 INFO:teuthology.orchestra.run.trial010.stderr:sudo: ntpd: command not found 2026-02-17T11:47:06.022 INFO:teuthology.orchestra.run.trial174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:47:06.025 INFO:teuthology.orchestra.run.trial071.stderr:sudo: ntpd: command not found 2026-02-17T11:47:06.026 INFO:teuthology.orchestra.run.trial153.stderr:sudo: ntpd: command not found 2026-02-17T11:47:06.030 INFO:teuthology.orchestra.run.trial010.stdout:506 Cannot talk to daemon 2026-02-17T11:47:06.034 INFO:teuthology.orchestra.run.trial153.stdout:506 Cannot talk to daemon 2026-02-17T11:47:06.035 INFO:teuthology.orchestra.run.trial071.stdout:506 Cannot talk to daemon 2026-02-17T11:47:06.042 INFO:teuthology.orchestra.run.trial010.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:47:06.043 INFO:teuthology.orchestra.run.trial174.stderr:sudo: ntpd: command not found 2026-02-17T11:47:06.045 INFO:teuthology.orchestra.run.trial153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:47:06.047 INFO:teuthology.orchestra.run.trial071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:47:06.052 INFO:teuthology.orchestra.run.trial174.stdout:506 Cannot talk to daemon 2026-02-17T11:47:06.054 INFO:teuthology.orchestra.run.trial010.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:47:06.056 INFO:teuthology.orchestra.run.trial153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:47:06.058 INFO:teuthology.orchestra.run.trial071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:47:06.064 INFO:teuthology.orchestra.run.trial174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:47:06.076 INFO:teuthology.orchestra.run.trial174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:47:06.099 INFO:teuthology.orchestra.run.trial153.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:47:06.106 INFO:teuthology.orchestra.run.trial010.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:47:06.107 INFO:teuthology.orchestra.run.trial071.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:47:06.121 INFO:teuthology.orchestra.run.trial010.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:47:06.121 INFO:teuthology.orchestra.run.trial010.stdout:=============================================================================== 2026-02-17T11:47:06.121 INFO:teuthology.orchestra.run.trial010.stdout:^? chi3.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.121 INFO:teuthology.orchestra.run.trial010.stdout:^? ntp4.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.121 INFO:teuthology.orchestra.run.trial010.stdout:^? vps-lga1.orleans.ddnss.de 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.121 INFO:teuthology.orchestra.run.trial010.stdout:^? as393746.mci.trtnw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.122 INFO:teuthology.orchestra.run.trial071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:47:06.122 INFO:teuthology.orchestra.run.trial071.stdout:=============================================================================== 2026-02-17T11:47:06.122 INFO:teuthology.orchestra.run.trial071.stdout:^? 144.202.62.209.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.122 INFO:teuthology.orchestra.run.trial071.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.122 INFO:teuthology.orchestra.run.trial071.stdout:^? clock.xmission.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.123 INFO:teuthology.orchestra.run.trial071.stdout:^? jmpxus.no.sigint.today 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.128 INFO:teuthology.orchestra.run.trial174.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:47:06.133 INFO:teuthology.orchestra.run.trial153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:47:06.133 INFO:teuthology.orchestra.run.trial153.stdout:=============================================================================== 2026-02-17T11:47:06.133 INFO:teuthology.orchestra.run.trial153.stdout:^? sushi.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.133 INFO:teuthology.orchestra.run.trial153.stdout:^? startkeylogger.hungrycat> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.133 INFO:teuthology.orchestra.run.trial153.stdout:^? 149.248.12.167.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.133 INFO:teuthology.orchestra.run.trial153.stdout:^? connected.by.freedominte> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.158 INFO:teuthology.orchestra.run.trial174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:47:06.158 INFO:teuthology.orchestra.run.trial174.stdout:=============================================================================== 2026-02-17T11:47:06.159 INFO:teuthology.orchestra.run.trial174.stdout:^? 108.61.215.221.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.159 INFO:teuthology.orchestra.run.trial174.stdout:^? frumentum-zeus.infra.fru> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.159 INFO:teuthology.orchestra.run.trial174.stdout:^? nyc2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.159 INFO:teuthology.orchestra.run.trial174.stdout:^? s2-a.time.mci1.us.rozint> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:47:06.160 INFO:teuthology.run_tasks:Running task install... 2026-02-17T11:47:06.174 DEBUG:teuthology.task.install:project ceph 2026-02-17T11:47:06.174 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T11:47:06.175 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T11:47:06.175 INFO:teuthology.task.install:Using flavor: default 2026-02-17T11:47:06.184 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-17T11:47:06.184 INFO:teuthology.task.install:extra packages: [] 2026-02-17T11:47:06.185 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T11:47:06.186 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:47:06.191 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T11:47:06.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:47:06.193 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T11:47:06.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:47:06.195 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T11:47:06.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:47:06.482 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T11:47:06.483 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T11:47:06.519 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T11:47:06.520 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T11:47:06.650 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T11:47:06.650 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T11:47:06.652 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T11:47:06.652 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T11:47:06.756 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:47:06.756 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:47:06.756 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:47:06.757 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:47:06.757 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:47:06.757 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:47:06.783 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T11:47:06.784 DEBUG:teuthology.orchestra.run.trial010:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:47:06.784 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T11:47:06.784 DEBUG:teuthology.orchestra.run.trial174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:47:06.792 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:47:06.792 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:47:06.792 DEBUG:teuthology.orchestra.run.trial071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:47:06.800 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:47:06.800 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:47:06.800 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:47:06.817 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T11:47:06.817 DEBUG:teuthology.orchestra.run.trial071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:47:06.825 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T11:47:06.825 DEBUG:teuthology.orchestra.run.trial153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:47:06.847 DEBUG:teuthology.orchestra.run.trial010:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:47:06.850 DEBUG:teuthology.orchestra.run.trial174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:47:06.884 DEBUG:teuthology.orchestra.run.trial071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:47:06.889 DEBUG:teuthology.orchestra.run.trial153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:47:06.919 DEBUG:teuthology.orchestra.run.trial010:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:47:06.922 DEBUG:teuthology.orchestra.run.trial174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:47:06.956 DEBUG:teuthology.orchestra.run.trial071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:47:06.961 DEBUG:teuthology.orchestra.run.trial153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:47:06.984 INFO:teuthology.orchestra.run.trial010.stdout:check_obsoletes = 1 2026-02-17T11:47:06.986 DEBUG:teuthology.orchestra.run.trial010:> sudo yum clean all 2026-02-17T11:47:06.987 INFO:teuthology.orchestra.run.trial174.stdout:check_obsoletes = 1 2026-02-17T11:47:06.988 DEBUG:teuthology.orchestra.run.trial174:> sudo yum clean all 2026-02-17T11:47:07.019 INFO:teuthology.orchestra.run.trial071.stdout:check_obsoletes = 1 2026-02-17T11:47:07.020 DEBUG:teuthology.orchestra.run.trial071:> sudo yum clean all 2026-02-17T11:47:07.024 INFO:teuthology.orchestra.run.trial153.stdout:check_obsoletes = 1 2026-02-17T11:47:07.026 DEBUG:teuthology.orchestra.run.trial153:> sudo yum clean all 2026-02-17T11:47:07.136 INFO:teuthology.orchestra.run.trial174.stdout:41 files removed 2026-02-17T11:47:07.138 INFO:teuthology.orchestra.run.trial010.stdout:41 files removed 2026-02-17T11:47:07.150 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-radosgw 2026-02-17T11:47:07.154 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-radosgw 2026-02-17T11:47:07.169 INFO:teuthology.orchestra.run.trial071.stdout:41 files removed 2026-02-17T11:47:07.173 INFO:teuthology.orchestra.run.trial153.stdout:41 files removed 2026-02-17T11:47:07.184 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-radosgw 2026-02-17T11:47:07.186 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-radosgw 2026-02-17T11:47:07.435 INFO:teuthology.orchestra.run.trial174.stdout:ceph packages for x86_64 605 kB/s | 86 kB 00:00 2026-02-17T11:47:07.453 INFO:teuthology.orchestra.run.trial071.stdout:ceph packages for x86_64 685 kB/s | 86 kB 00:00 2026-02-17T11:47:07.453 INFO:teuthology.orchestra.run.trial153.stdout:ceph packages for x86_64 685 kB/s | 86 kB 00:00 2026-02-17T11:47:07.460 INFO:teuthology.orchestra.run.trial010.stdout:ceph packages for x86_64 528 kB/s | 86 kB 00:00 2026-02-17T11:47:07.577 INFO:teuthology.orchestra.run.trial174.stdout:ceph noarch packages 102 kB/s | 12 kB 00:00 2026-02-17T11:47:07.582 INFO:teuthology.orchestra.run.trial153.stdout:ceph noarch packages 114 kB/s | 12 kB 00:00 2026-02-17T11:47:07.583 INFO:teuthology.orchestra.run.trial071.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-17T11:47:07.590 INFO:teuthology.orchestra.run.trial010.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T11:47:07.700 INFO:teuthology.orchestra.run.trial174.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:47:07.707 INFO:teuthology.orchestra.run.trial153.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:47:07.713 INFO:teuthology.orchestra.run.trial071.stdout:ceph source packages 17 kB/s | 1.9 kB 00:00 2026-02-17T11:47:07.714 INFO:teuthology.orchestra.run.trial010.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:47:08.586 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-17T11:47:09.097 INFO:teuthology.orchestra.run.trial010.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.9 MB 00:01 2026-02-17T11:47:12.235 INFO:teuthology.orchestra.run.trial010.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T11:47:12.267 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 27 MB 00:03 2026-02-17T11:47:13.158 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.9 MB 00:05 2026-02-17T11:47:14.778 INFO:teuthology.orchestra.run.trial071.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.9 MB 00:07 2026-02-17T11:47:15.678 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 7.8 MB 00:01 2026-02-17T11:47:16.324 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T11:47:17.294 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-17T11:47:17.880 INFO:teuthology.orchestra.run.trial153.stdout:Extra Packages for Enterprise Linux 39 MB/s | 20 MB 00:00 2026-02-17T11:47:17.888 INFO:teuthology.orchestra.run.trial071.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T11:47:17.893 INFO:teuthology.orchestra.run.trial010.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 7.8 MB 00:03 2026-02-17T11:47:19.662 INFO:teuthology.orchestra.run.trial010.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-17T11:47:20.229 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-17T11:47:20.793 INFO:teuthology.orchestra.run.trial010.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-17T11:47:21.070 INFO:teuthology.orchestra.run.trial153.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-17T11:47:21.303 INFO:teuthology.orchestra.run.trial071.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-17T11:47:21.367 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 20 kB 00:00 2026-02-17T11:47:21.745 INFO:teuthology.orchestra.run.trial174.stdout:Extra Packages for Enterprise Linux 64 MB/s | 20 MB 00:00 2026-02-17T11:47:22.297 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:22.298 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:22.299 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repository Size 2026-02-17T11:47:22.299 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:22.299 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:22.299 INFO:teuthology.orchestra.run.trial153.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:47:22.299 INFO:teuthology.orchestra.run.trial153.stdout:Upgrading: 2026-02-17T11:47:22.299 INFO:teuthology.orchestra.run.trial153.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T11:47:22.299 INFO:teuthology.orchestra.run.trial153.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T11:47:22.299 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T11:47:22.299 INFO:teuthology.orchestra.run.trial153.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:47:22.300 INFO:teuthology.orchestra.run.trial153.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T11:47:22.301 INFO:teuthology.orchestra.run.trial153.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout:Installing weak dependencies: 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout:Install 33 Packages 2026-02-17T11:47:22.302 INFO:teuthology.orchestra.run.trial153.stdout:Upgrade 2 Packages 2026-02-17T11:47:22.303 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:22.303 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 63 M 2026-02-17T11:47:22.303 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:22.832 INFO:teuthology.orchestra.run.trial153.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-17T11:47:22.873 INFO:teuthology.orchestra.run.trial153.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 623 kB/s | 25 kB 00:00 2026-02-17T11:47:22.935 INFO:teuthology.orchestra.run.trial153.stdout:(3/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 16 MB/s | 999 kB 00:00 2026-02-17T11:47:22.988 INFO:teuthology.orchestra.run.trial153.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 9.2 MB/s | 503 kB 00:00 2026-02-17T11:47:23.027 INFO:teuthology.orchestra.run.trial071.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-17T11:47:23.212 INFO:teuthology.orchestra.run.trial153.stdout:(5/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 15 MB/s | 11 MB 00:00 2026-02-17T11:47:23.244 INFO:teuthology.orchestra.run.trial153.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 1.4 MB/s | 45 kB 00:00 2026-02-17T11:47:23.266 INFO:teuthology.orchestra.run.trial153.stdout:(7/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 19 MB/s | 5.4 MB 00:00 2026-02-17T11:47:23.276 INFO:teuthology.orchestra.run.trial153.stdout:(8/35): python3-ceph-common-19.2.3-675.g3c96dfb 4.3 MB/s | 142 kB 00:00 2026-02-17T11:47:23.292 INFO:teuthology.orchestra.run.trial153.stdout:(9/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 6.1 MB/s | 165 kB 00:00 2026-02-17T11:47:23.307 INFO:teuthology.orchestra.run.trial153.stdout:(10/35): python3-rados-19.2.3-675.g3c96dfb3.el9 10 MB/s | 322 kB 00:00 2026-02-17T11:47:23.325 INFO:teuthology.orchestra.run.trial153.stdout:(11/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 9.0 MB/s | 303 kB 00:00 2026-02-17T11:47:23.337 INFO:teuthology.orchestra.run.trial153.stdout:(12/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 3.3 MB/s | 100 kB 00:00 2026-02-17T11:47:23.408 INFO:teuthology.orchestra.run.trial153.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 402 kB/s | 33 kB 00:00 2026-02-17T11:47:23.456 INFO:teuthology.orchestra.run.trial153.stdout:(14/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 23 MB/s | 22 MB 00:00 2026-02-17T11:47:23.496 INFO:teuthology.orchestra.run.trial153.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 1.0 MB/s | 93 kB 00:00 2026-02-17T11:47:23.573 INFO:teuthology.orchestra.run.trial153.stdout:(16/35): nvme-cli-2.13-1.el9.x86_64.rpm 4.6 MB/s | 1.1 MB 00:00 2026-02-17T11:47:23.642 INFO:teuthology.orchestra.run.trial071.stdout:Extra Packages for Enterprise Linux 37 MB/s | 20 MB 00:00 2026-02-17T11:47:23.856 INFO:teuthology.orchestra.run.trial153.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 261 kB/s | 104 kB 00:00 2026-02-17T11:47:23.949 INFO:teuthology.orchestra.run.trial153.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 361 kB/s | 164 kB 00:00 2026-02-17T11:47:23.956 INFO:teuthology.orchestra.run.trial153.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2026-02-17T11:47:24.004 INFO:teuthology.orchestra.run.trial010.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T11:47:24.021 INFO:teuthology.orchestra.run.trial153.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 358 kB/s | 160 kB 00:00 2026-02-17T11:47:24.180 INFO:teuthology.orchestra.run.trial153.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2026-02-17T11:47:24.197 INFO:teuthology.orchestra.run.trial153.stdout:(22/35): qatlib-25.08.0-2.el9.x86_64.rpm 1.3 MB/s | 240 kB 00:00 2026-02-17T11:47:24.219 INFO:teuthology.orchestra.run.trial153.stdout:(23/35): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2026-02-17T11:47:24.263 INFO:teuthology.orchestra.run.trial153.stdout:(24/35): qatlib-service-25.08.0-2.el9.x86_64.rp 445 kB/s | 37 kB 00:00 2026-02-17T11:47:24.283 INFO:teuthology.orchestra.run.trial153.stdout:(25/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 768 kB/s | 66 kB 00:00 2026-02-17T11:47:24.374 INFO:teuthology.orchestra.run.trial153.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 273 kB/s | 25 kB 00:00 2026-02-17T11:47:24.415 INFO:teuthology.orchestra.run.trial153.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2026-02-17T11:47:24.416 INFO:teuthology.orchestra.run.trial153.stdout:(28/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.5 MB/s | 308 kB 00:00 2026-02-17T11:47:24.446 INFO:teuthology.orchestra.run.trial153.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.2 MB/s | 67 kB 00:00 2026-02-17T11:47:24.489 INFO:teuthology.orchestra.run.trial153.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 11 MB/s | 838 kB 00:00 2026-02-17T11:47:24.495 INFO:teuthology.orchestra.run.trial153.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2026-02-17T11:47:24.539 INFO:teuthology.orchestra.run.trial153.stdout:(32/35): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-17T11:47:24.547 INFO:teuthology.orchestra.run.trial153.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2026-02-17T11:47:24.733 INFO:teuthology.orchestra.run.trial153.stdout:(34/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 14 MB/s | 3.4 MB 00:00 2026-02-17T11:47:24.756 INFO:teuthology.orchestra.run.trial153.stdout:(35/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 15 MB/s | 3.2 MB 00:00 2026-02-17T11:47:24.759 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:24.759 INFO:teuthology.orchestra.run.trial153.stdout:Total 26 MB/s | 63 MB 00:02 2026-02-17T11:47:24.862 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:24.881 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:24.881 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:24.991 INFO:teuthology.orchestra.run.trial174.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T11:47:25.118 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:25.118 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:25.234 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repository Size 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout:Upgrading: 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout:Installing dependencies: 2026-02-17T11:47:25.236 INFO:teuthology.orchestra.run.trial010.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:47:25.237 INFO:teuthology.orchestra.run.trial010.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T11:47:25.238 INFO:teuthology.orchestra.run.trial010.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout:Installing weak dependencies: 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout:Install 33 Packages 2026-02-17T11:47:25.239 INFO:teuthology.orchestra.run.trial010.stdout:Upgrade 2 Packages 2026-02-17T11:47:25.240 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:25.240 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 63 M 2026-02-17T11:47:25.240 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:47:25.406 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:25.414 INFO:teuthology.orchestra.run.trial153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:47:25.418 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:47:25.429 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:47:25.581 INFO:teuthology.orchestra.run.trial153.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:47:25.584 INFO:teuthology.orchestra.run.trial153.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:25.611 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:25.653 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:47:25.654 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:25.666 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:25.670 INFO:teuthology.orchestra.run.trial153.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:47:25.680 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T11:47:25.703 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:47:25.704 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:25.716 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:25.747 INFO:teuthology.orchestra.run.trial153.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:47:25.751 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:47:25.759 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:47:25.761 INFO:teuthology.orchestra.run.trial153.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:47:25.764 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:47:25.768 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:47:25.824 INFO:teuthology.orchestra.run.trial010.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 17 MB/s | 5.5 MB 00:00 2026-02-17T11:47:25.860 INFO:teuthology.orchestra.run.trial010.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 687 kB/s | 25 kB 00:00 2026-02-17T11:47:25.908 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:47:25.909 INFO:teuthology.orchestra.run.trial153.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:47:25.917 INFO:teuthology.orchestra.run.trial010.stdout:(3/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 17 MB/s | 999 kB 00:00 2026-02-17T11:47:25.935 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:47:25.937 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T11:47:25.944 INFO:teuthology.orchestra.run.trial153.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:47:25.965 INFO:teuthology.orchestra.run.trial010.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 10 MB/s | 503 kB 00:00 2026-02-17T11:47:26.125 INFO:teuthology.orchestra.run.trial010.stdout:(5/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 17 MB/s | 11 MB 00:00 2026-02-17T11:47:26.168 INFO:teuthology.orchestra.run.trial153.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:47:26.168 INFO:teuthology.orchestra.run.trial010.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 1.0 MB/s | 45 kB 00:00 2026-02-17T11:47:26.169 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:47:26.185 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:47:26.188 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T11:47:26.192 INFO:teuthology.orchestra.run.trial153.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:47:26.195 INFO:teuthology.orchestra.run.trial153.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:47:26.196 INFO:teuthology.orchestra.run.trial153.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:47:26.198 INFO:teuthology.orchestra.run.trial010.stdout:(7/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 23 MB/s | 5.4 MB 00:00 2026-02-17T11:47:26.209 INFO:teuthology.orchestra.run.trial010.stdout:(8/35): python3-ceph-common-19.2.3-675.g3c96dfb 3.5 MB/s | 142 kB 00:00 2026-02-17T11:47:26.212 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout:Upgrading: 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:47:26.214 INFO:teuthology.orchestra.run.trial174.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout:Installing weak dependencies: 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout:Install 33 Packages 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout:Upgrade 2 Packages 2026-02-17T11:47:26.215 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 63 M 2026-02-17T11:47:26.216 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:47:26.227 INFO:teuthology.orchestra.run.trial010.stdout:(9/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 5.5 MB/s | 165 kB 00:00 2026-02-17T11:47:26.241 INFO:teuthology.orchestra.run.trial010.stdout:(10/35): python3-rados-19.2.3-675.g3c96dfb3.el9 9.6 MB/s | 322 kB 00:00 2026-02-17T11:47:26.264 INFO:teuthology.orchestra.run.trial010.stdout:(11/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 8.2 MB/s | 303 kB 00:00 2026-02-17T11:47:26.274 INFO:teuthology.orchestra.run.trial010.stdout:(12/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 3.0 MB/s | 100 kB 00:00 2026-02-17T11:47:26.326 INFO:teuthology.orchestra.run.trial153.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:47:26.329 INFO:teuthology.orchestra.run.trial153.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:47:26.396 INFO:teuthology.orchestra.run.trial010.stdout:(13/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T11:47:26.601 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:47:26.601 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:47:26.601 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:26.639 INFO:teuthology.orchestra.run.trial153.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:47:26.641 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T11:47:26.727 INFO:teuthology.orchestra.run.trial010.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 72 kB/s | 33 kB 00:00 2026-02-17T11:47:26.776 INFO:teuthology.orchestra.run.trial010.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 2.0 MB/s | 104 kB 00:00 2026-02-17T11:47:26.793 INFO:teuthology.orchestra.run.trial010.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 9.7 MB/s | 164 kB 00:00 2026-02-17T11:47:26.804 INFO:teuthology.orchestra.run.trial010.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 15 MB/s | 160 kB 00:00 2026-02-17T11:47:26.811 INFO:teuthology.orchestra.run.trial071.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T11:47:26.812 INFO:teuthology.orchestra.run.trial010.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 5.3 MB/s | 45 kB 00:00 2026-02-17T11:47:26.833 INFO:teuthology.orchestra.run.trial010.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 32 MB/s | 662 kB 00:00 2026-02-17T11:47:26.843 INFO:teuthology.orchestra.run.trial010.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 28 MB/s | 292 kB 00:00 2026-02-17T11:47:26.854 INFO:teuthology.orchestra.run.trial010.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 23 MB/s | 240 kB 00:00 2026-02-17T11:47:26.862 INFO:teuthology.orchestra.run.trial010.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 4.3 MB/s | 37 kB 00:00 2026-02-17T11:47:26.871 INFO:teuthology.orchestra.run.trial010.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.6 MB/s | 66 kB 00:00 2026-02-17T11:47:26.938 INFO:teuthology.orchestra.run.trial010.stdout:(24/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.5 MB/s | 308 kB 00:00 2026-02-17T11:47:26.989 INFO:teuthology.orchestra.run.trial010.stdout:(25/35): libarrow-9.0.0-15.el9.x86_64.rpm 86 MB/s | 4.4 MB 00:00 2026-02-17T11:47:27.000 INFO:teuthology.orchestra.run.trial010.stdout:(26/35): pciutils-3.7.0-7.el9.x86_64.rpm 156 kB/s | 93 kB 00:00 2026-02-17T11:47:27.005 INFO:teuthology.orchestra.run.trial010.stdout:(27/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.6 MB/s | 25 kB 00:00 2026-02-17T11:47:27.016 INFO:teuthology.orchestra.run.trial010.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 3.1 MB/s | 49 kB 00:00 2026-02-17T11:47:27.027 INFO:teuthology.orchestra.run.trial010.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 3.1 MB/s | 67 kB 00:00 2026-02-17T11:47:27.043 INFO:teuthology.orchestra.run.trial010.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 11 MB/s | 191 kB 00:00 2026-02-17T11:47:27.074 INFO:teuthology.orchestra.run.trial010.stdout:(31/35): thrift-0.15.0-4.el9.x86_64.rpm 52 MB/s | 1.6 MB 00:00 2026-02-17T11:47:27.096 INFO:teuthology.orchestra.run.trial010.stdout:(32/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 10 MB/s | 838 kB 00:00 2026-02-17T11:47:27.307 INFO:teuthology.orchestra.run.trial010.stdout:(33/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 15 MB/s | 3.4 MB 00:00 2026-02-17T11:47:27.328 INFO:teuthology.orchestra.run.trial010.stdout:(34/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 14 MB/s | 3.2 MB 00:00 2026-02-17T11:47:27.384 INFO:teuthology.orchestra.run.trial010.stdout:(35/35): nvme-cli-2.13-1.el9.x86_64.rpm 1.0 MB/s | 1.1 MB 00:01 2026-02-17T11:47:27.390 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:27.390 INFO:teuthology.orchestra.run.trial010.stdout:Total 29 MB/s | 63 MB 00:02 2026-02-17T11:47:27.491 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:47:27.510 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:47:27.510 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:47:27.588 INFO:teuthology.orchestra.run.trial174.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 5.0 MB/s | 5.5 MB 00:01 2026-02-17T11:47:27.607 INFO:teuthology.orchestra.run.trial174.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 1.3 MB/s | 25 kB 00:00 2026-02-17T11:47:27.619 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:27.621 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:27.682 INFO:teuthology.orchestra.run.trial174.stdout:(3/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 13 MB/s | 999 kB 00:00 2026-02-17T11:47:27.735 INFO:teuthology.orchestra.run.trial174.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 9.3 MB/s | 503 kB 00:00 2026-02-17T11:47:27.747 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:47:27.748 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:47:27.905 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:27.908 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:47:27.950 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:47:27.950 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:47:27.951 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:47:27.951 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:27.954 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:27.967 INFO:teuthology.orchestra.run.trial174.stdout:(5/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 7.2 MB/s | 11 MB 00:01 2026-02-17T11:47:28.000 INFO:teuthology.orchestra.run.trial174.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 1.3 MB/s | 45 kB 00:00 2026-02-17T11:47:28.034 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:47:28.035 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:47:28.036 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repository Size 2026-02-17T11:47:28.036 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:47:28.036 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:47:28.036 INFO:teuthology.orchestra.run.trial071.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:47:28.036 INFO:teuthology.orchestra.run.trial071.stdout:Upgrading: 2026-02-17T11:47:28.037 INFO:teuthology.orchestra.run.trial071.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T11:47:28.037 INFO:teuthology.orchestra.run.trial071.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T11:47:28.037 INFO:teuthology.orchestra.run.trial071.stdout:Installing dependencies: 2026-02-17T11:47:28.037 INFO:teuthology.orchestra.run.trial071.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:47:28.037 INFO:teuthology.orchestra.run.trial071.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T11:47:28.037 INFO:teuthology.orchestra.run.trial071.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T11:47:28.038 INFO:teuthology.orchestra.run.trial071.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T11:47:28.038 INFO:teuthology.orchestra.run.trial071.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:47:28.038 INFO:teuthology.orchestra.run.trial071.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:47:28.038 INFO:teuthology.orchestra.run.trial071.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:47:28.038 INFO:teuthology.orchestra.run.trial071.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T11:47:28.038 INFO:teuthology.orchestra.run.trial071.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:47:28.038 INFO:teuthology.orchestra.run.trial071.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:47:28.039 INFO:teuthology.orchestra.run.trial071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:47:28.039 INFO:teuthology.orchestra.run.trial071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:47:28.039 INFO:teuthology.orchestra.run.trial071.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T11:47:28.039 INFO:teuthology.orchestra.run.trial071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:47:28.039 INFO:teuthology.orchestra.run.trial071.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T11:47:28.039 INFO:teuthology.orchestra.run.trial071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:47:28.040 INFO:teuthology.orchestra.run.trial071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:47:28.040 INFO:teuthology.orchestra.run.trial071.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:47:28.040 INFO:teuthology.orchestra.run.trial071.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:47:28.040 INFO:teuthology.orchestra.run.trial071.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:47:28.040 INFO:teuthology.orchestra.run.trial071.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T11:47:28.040 INFO:teuthology.orchestra.run.trial071.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T11:47:28.040 INFO:teuthology.orchestra.run.trial071.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T11:47:28.041 INFO:teuthology.orchestra.run.trial071.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T11:47:28.041 INFO:teuthology.orchestra.run.trial071.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T11:47:28.041 INFO:teuthology.orchestra.run.trial071.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T11:47:28.041 INFO:teuthology.orchestra.run.trial071.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:47:28.041 INFO:teuthology.orchestra.run.trial071.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:47:28.041 INFO:teuthology.orchestra.run.trial071.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:47:28.041 INFO:teuthology.orchestra.run.trial071.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:47:28.042 INFO:teuthology.orchestra.run.trial071.stdout:Installing weak dependencies: 2026-02-17T11:47:28.042 INFO:teuthology.orchestra.run.trial071.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:47:28.042 INFO:teuthology.orchestra.run.trial071.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:47:28.042 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:28.042 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:47:28.042 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:47:28.042 INFO:teuthology.orchestra.run.trial071.stdout:Install 33 Packages 2026-02-17T11:47:28.043 INFO:teuthology.orchestra.run.trial071.stdout:Upgrade 2 Packages 2026-02-17T11:47:28.043 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:28.044 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:47:28.045 INFO:teuthology.orchestra.run.trial174.stdout:(7/35): python3-ceph-common-19.2.3-675.g3c96dfb 3.8 MB/s | 142 kB 00:00 2026-02-17T11:47:28.045 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 63 M 2026-02-17T11:47:28.045 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:47:28.048 INFO:teuthology.orchestra.run.trial010.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:47:28.050 INFO:teuthology.orchestra.run.trial010.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:47:28.062 INFO:teuthology.orchestra.run.trial010.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:47:28.076 INFO:teuthology.orchestra.run.trial174.stdout:(8/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 4.1 MB/s | 165 kB 00:00 2026-02-17T11:47:28.120 INFO:teuthology.orchestra.run.trial174.stdout:(9/35): python3-rados-19.2.3-675.g3c96dfb3.el9. 7.2 MB/s | 322 kB 00:00 2026-02-17T11:47:28.127 INFO:teuthology.orchestra.run.trial174.stdout:(10/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_6 14 MB/s | 5.4 MB 00:00 2026-02-17T11:47:28.154 INFO:teuthology.orchestra.run.trial174.stdout:(11/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 8.7 MB/s | 303 kB 00:00 2026-02-17T11:47:28.162 INFO:teuthology.orchestra.run.trial174.stdout:(12/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 2.8 MB/s | 100 kB 00:00 2026-02-17T11:47:28.217 INFO:teuthology.orchestra.run.trial010.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:47:28.220 INFO:teuthology.orchestra.run.trial010.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:28.226 INFO:teuthology.orchestra.run.trial174.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 459 kB/s | 33 kB 00:00 2026-02-17T11:47:28.251 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:28.269 INFO:teuthology.orchestra.run.trial174.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 2.1 MB/s | 93 kB 00:00 2026-02-17T11:47:28.291 INFO:teuthology.orchestra.run.trial174.stdout:(15/35): nvme-cli-2.13-1.el9.x86_64.rpm 8.5 MB/s | 1.1 MB 00:00 2026-02-17T11:47:28.296 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:47:28.297 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:28.309 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:28.315 INFO:teuthology.orchestra.run.trial010.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:47:28.325 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T11:47:28.347 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:47:28.348 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:28.361 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:28.392 INFO:teuthology.orchestra.run.trial010.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:47:28.396 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:47:28.403 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:47:28.406 INFO:teuthology.orchestra.run.trial010.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:47:28.409 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:47:28.413 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:47:28.415 INFO:teuthology.orchestra.run.trial174.stdout:(16/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 11 MB/s | 22 MB 00:01 2026-02-17T11:47:28.558 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:47:28.559 INFO:teuthology.orchestra.run.trial010.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:47:28.584 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:47:28.587 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T11:47:28.593 INFO:teuthology.orchestra.run.trial010.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:47:28.824 INFO:teuthology.orchestra.run.trial010.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:47:28.825 INFO:teuthology.orchestra.run.trial010.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:47:28.841 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:47:28.844 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T11:47:28.850 INFO:teuthology.orchestra.run.trial010.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:47:28.851 INFO:teuthology.orchestra.run.trial174.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 179 kB/s | 104 kB 00:00 2026-02-17T11:47:28.852 INFO:teuthology.orchestra.run.trial010.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:47:28.853 INFO:teuthology.orchestra.run.trial010.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:47:28.870 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:47:28.872 INFO:teuthology.orchestra.run.trial174.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 282 kB/s | 164 kB 00:00 2026-02-17T11:47:28.937 INFO:teuthology.orchestra.run.trial174.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 531 kB/s | 45 kB 00:00 2026-02-17T11:47:28.983 INFO:teuthology.orchestra.run.trial010.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:47:28.985 INFO:teuthology.orchestra.run.trial010.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:47:28.996 INFO:teuthology.orchestra.run.trial174.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 275 kB/s | 160 kB 00:00 2026-02-17T11:47:29.122 INFO:teuthology.orchestra.run.trial174.stdout:(21/35): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2026-02-17T11:47:29.165 INFO:teuthology.orchestra.run.trial174.stdout:(22/35): qatlib-25.08.0-2.el9.x86_64.rpm 1.4 MB/s | 240 kB 00:00 2026-02-17T11:47:29.208 INFO:teuthology.orchestra.run.trial174.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 432 kB/s | 37 kB 00:00 2026-02-17T11:47:29.253 INFO:teuthology.orchestra.run.trial174.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 759 kB/s | 66 kB 00:00 2026-02-17T11:47:29.260 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:47:29.261 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:47:29.261 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:29.296 INFO:teuthology.orchestra.run.trial010.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:47:29.298 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T11:47:29.345 INFO:teuthology.orchestra.run.trial174.stdout:(25/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 716 kB/s | 292 kB 00:00 2026-02-17T11:47:29.448 INFO:teuthology.orchestra.run.trial071.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 4.7 MB/s | 5.5 MB 00:01 2026-02-17T11:47:29.456 INFO:teuthology.orchestra.run.trial174.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 223 kB/s | 25 kB 00:00 2026-02-17T11:47:29.458 INFO:teuthology.orchestra.run.trial174.stdout:(27/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-17T11:47:29.479 INFO:teuthology.orchestra.run.trial071.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 798 kB/s | 25 kB 00:00 2026-02-17T11:47:29.498 INFO:teuthology.orchestra.run.trial174.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2026-02-17T11:47:29.513 INFO:teuthology.orchestra.run.trial071.stdout:(3/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 8.7 MB/s | 11 MB 00:01 2026-02-17T11:47:29.531 INFO:teuthology.orchestra.run.trial174.stdout:(29/35): liboath-2.6.12-1.el9.x86_64.rpm 652 kB/s | 49 kB 00:00 2026-02-17T11:47:29.553 INFO:teuthology.orchestra.run.trial071.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 13 MB/s | 503 kB 00:00 2026-02-17T11:47:29.584 INFO:teuthology.orchestra.run.trial071.stdout:(5/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 9.3 MB/s | 999 kB 00:00 2026-02-17T11:47:29.603 INFO:teuthology.orchestra.run.trial174.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.8 MB/s | 838 kB 00:00 2026-02-17T11:47:29.624 INFO:teuthology.orchestra.run.trial174.stdout:(31/35): libarrow-9.0.0-15.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2026-02-17T11:47:29.624 INFO:teuthology.orchestra.run.trial071.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 1.1 MB/s | 45 kB 00:00 2026-02-17T11:47:29.631 INFO:teuthology.orchestra.run.trial174.stdout:(32/35): re2-20211101-20.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2026-02-17T11:47:29.670 INFO:teuthology.orchestra.run.trial071.stdout:(7/35): python3-ceph-common-19.2.3-675.g3c96dfb 3.1 MB/s | 142 kB 00:00 2026-02-17T11:47:29.691 INFO:teuthology.orchestra.run.trial174.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2026-02-17T11:47:29.718 INFO:teuthology.orchestra.run.trial071.stdout:(8/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 3.3 MB/s | 165 kB 00:00 2026-02-17T11:47:29.773 INFO:teuthology.orchestra.run.trial071.stdout:(9/35): python3-rados-19.2.3-675.g3c96dfb3.el9. 5.7 MB/s | 322 kB 00:00 2026-02-17T11:47:29.832 INFO:teuthology.orchestra.run.trial071.stdout:(10/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 5.0 MB/s | 303 kB 00:00 2026-02-17T11:47:29.894 INFO:teuthology.orchestra.run.trial071.stdout:(11/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 1.6 MB/s | 100 kB 00:00 2026-02-17T11:47:29.961 INFO:teuthology.orchestra.run.trial071.stdout:(12/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_6 13 MB/s | 5.4 MB 00:00 2026-02-17T11:47:29.979 INFO:teuthology.orchestra.run.trial071.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 387 kB/s | 33 kB 00:00 2026-02-17T11:47:30.051 INFO:teuthology.orchestra.run.trial071.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 1.3 MB/s | 93 kB 00:00 2026-02-17T11:47:30.100 INFO:teuthology.orchestra.run.trial174.stdout:(34/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 6.8 MB/s | 3.2 MB 00:00 2026-02-17T11:47:30.131 INFO:teuthology.orchestra.run.trial071.stdout:(15/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 12 MB/s | 22 MB 00:01 2026-02-17T11:47:30.131 INFO:teuthology.orchestra.run.trial071.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 1.3 MB/s | 104 kB 00:00 2026-02-17T11:47:30.175 INFO:teuthology.orchestra.run.trial071.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.6 MB/s | 160 kB 00:00 2026-02-17T11:47:30.187 INFO:teuthology.orchestra.run.trial071.stdout:(18/35): nvme-cli-2.13-1.el9.x86_64.rpm 4.9 MB/s | 1.1 MB 00:00 2026-02-17T11:47:30.197 INFO:teuthology.orchestra.run.trial071.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-17T11:47:30.216 INFO:teuthology.orchestra.run.trial071.stdout:(20/35): libnbd-1.20.3-4.el9.x86_64.rpm 1.9 MB/s | 164 kB 00:00 2026-02-17T11:47:30.241 INFO:teuthology.orchestra.run.trial071.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.5 MB/s | 292 kB 00:00 2026-02-17T11:47:30.244 INFO:teuthology.orchestra.run.trial174.stdout:(35/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 5.5 MB/s | 3.4 MB 00:00 2026-02-17T11:47:30.248 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:30.248 INFO:teuthology.orchestra.run.trial174.stdout:Total 16 MB/s | 63 MB 00:04 2026-02-17T11:47:30.262 INFO:teuthology.orchestra.run.trial071.stdout:(22/35): qatlib-25.08.0-2.el9.x86_64.rpm 5.1 MB/s | 240 kB 00:00 2026-02-17T11:47:30.262 INFO:teuthology.orchestra.run.trial071.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-17T11:47:30.285 INFO:teuthology.orchestra.run.trial071.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-17T11:47:30.301 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:30.303 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:30.315 INFO:teuthology.orchestra.run.trial071.stdout:(25/35): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2026-02-17T11:47:30.347 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:47:30.365 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:47:30.366 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:47:30.388 INFO:teuthology.orchestra.run.trial071.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 336 kB/s | 25 kB 00:00 2026-02-17T11:47:30.421 INFO:teuthology.orchestra.run.trial071.stdout:(27/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2026-02-17T11:47:30.438 INFO:teuthology.orchestra.run.trial071.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 982 kB/s | 49 kB 00:00 2026-02-17T11:47:30.448 INFO:teuthology.orchestra.run.trial071.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.4 MB/s | 67 kB 00:00 2026-02-17T11:47:30.476 INFO:teuthology.orchestra.run.trial071.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 6.8 MB/s | 191 kB 00:00 2026-02-17T11:47:30.514 INFO:teuthology.orchestra.run.trial071.stdout:(31/35): libarrow-9.0.0-15.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2026-02-17T11:47:30.539 INFO:teuthology.orchestra.run.trial071.stdout:(32/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.1 MB/s | 838 kB 00:00 2026-02-17T11:47:30.577 INFO:teuthology.orchestra.run.trial071.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2026-02-17T11:47:30.592 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:30.596 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:47:30.602 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:47:30.602 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:47:30.633 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:47:30.633 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:47:30.633 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:47:30.633 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:30.636 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:30.748 INFO:teuthology.orchestra.run.trial071.stdout:(34/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 15 MB/s | 3.2 MB 00:00 2026-02-17T11:47:30.893 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:47:30.901 INFO:teuthology.orchestra.run.trial174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:47:30.903 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:47:30.915 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:47:31.014 INFO:teuthology.orchestra.run.trial071.stdout:(35/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 6.9 MB/s | 3.4 MB 00:00 2026-02-17T11:47:31.015 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:31.016 INFO:teuthology.orchestra.run.trial071.stdout:Total 21 MB/s | 63 MB 00:02 2026-02-17T11:47:31.063 INFO:teuthology.orchestra.run.trial174.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:47:31.067 INFO:teuthology.orchestra.run.trial174.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:31.098 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:31.120 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:47:31.141 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:47:31.141 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:47:31.141 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:47:31.142 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:31.154 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:31.159 INFO:teuthology.orchestra.run.trial174.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:47:31.168 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T11:47:31.192 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:47:31.192 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:31.206 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:31.240 INFO:teuthology.orchestra.run.trial174.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:47:31.246 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:47:31.252 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:47:31.254 INFO:teuthology.orchestra.run.trial174.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:47:31.257 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:47:31.262 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:47:31.380 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:47:31.380 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:47:31.400 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:47:31.402 INFO:teuthology.orchestra.run.trial174.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:47:31.428 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:47:31.431 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T11:47:31.437 INFO:teuthology.orchestra.run.trial174.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:47:31.661 INFO:teuthology.orchestra.run.trial174.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:47:31.662 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:47:31.670 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:47:31.678 INFO:teuthology.orchestra.run.trial071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:47:31.679 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:47:31.680 INFO:teuthology.orchestra.run.trial071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:47:31.682 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T11:47:31.686 INFO:teuthology.orchestra.run.trial174.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:47:31.689 INFO:teuthology.orchestra.run.trial174.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:47:31.690 INFO:teuthology.orchestra.run.trial174.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:47:31.692 INFO:teuthology.orchestra.run.trial071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:47:31.708 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:47:31.822 INFO:teuthology.orchestra.run.trial174.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:47:31.825 INFO:teuthology.orchestra.run.trial174.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:47:31.840 INFO:teuthology.orchestra.run.trial071.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:47:31.846 INFO:teuthology.orchestra.run.trial071.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:31.876 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:31.921 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:47:31.922 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:31.933 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:31.937 INFO:teuthology.orchestra.run.trial071.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:47:31.946 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T11:47:31.968 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:47:31.969 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:31.982 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:32.014 INFO:teuthology.orchestra.run.trial071.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:47:32.019 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:47:32.026 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:47:32.028 INFO:teuthology.orchestra.run.trial071.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:47:32.031 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:47:32.036 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:47:32.106 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:47:32.106 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:47:32.106 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:32.141 INFO:teuthology.orchestra.run.trial174.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:47:32.143 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T11:47:32.175 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:47:32.176 INFO:teuthology.orchestra.run.trial071.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:47:32.202 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:47:32.204 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T11:47:32.210 INFO:teuthology.orchestra.run.trial071.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:47:32.435 INFO:teuthology.orchestra.run.trial071.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:47:32.436 INFO:teuthology.orchestra.run.trial071.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:47:32.451 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:32.452 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /sys 2026-02-17T11:47:32.452 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /proc 2026-02-17T11:47:32.452 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /mnt 2026-02-17T11:47:32.452 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /var/tmp 2026-02-17T11:47:32.452 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /home 2026-02-17T11:47:32.452 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /root 2026-02-17T11:47:32.452 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /tmp 2026-02-17T11:47:32.452 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:32.453 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:47:32.455 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T11:47:32.461 INFO:teuthology.orchestra.run.trial071.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:47:32.463 INFO:teuthology.orchestra.run.trial071.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:47:32.464 INFO:teuthology.orchestra.run.trial071.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:47:32.482 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:47:32.597 INFO:teuthology.orchestra.run.trial071.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:47:32.599 INFO:teuthology.orchestra.run.trial071.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:47:32.884 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:47:32.885 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:47:32.885 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:32.902 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:47:32.920 INFO:teuthology.orchestra.run.trial071.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:47:32.922 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T11:47:32.926 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:47:32.926 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:32.926 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:47:32.926 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:47:32.926 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:47:32.926 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:32.928 INFO:teuthology.orchestra.run.trial153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:47:32.940 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:47:32.940 INFO:teuthology.orchestra.run.trial153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:32.997 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:32.997 INFO:teuthology.orchestra.run.trial153.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:47:32.997 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:33.123 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:33.126 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:33.261 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T11:47:33.261 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T11:47:33.261 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:47:33.262 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T11:47:33.326 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:33.326 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:33.326 INFO:teuthology.orchestra.run.trial153.stdout:Upgraded: 2026-02-17T11:47:33.326 INFO:teuthology.orchestra.run.trial153.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.326 INFO:teuthology.orchestra.run.trial153.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.326 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:33.326 INFO:teuthology.orchestra.run.trial153.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:47:33.326 INFO:teuthology.orchestra.run.trial153.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.326 INFO:teuthology.orchestra.run.trial153.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.327 INFO:teuthology.orchestra.run.trial153.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.328 INFO:teuthology.orchestra.run.trial153.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.329 INFO:teuthology.orchestra.run.trial153.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:33.329 INFO:teuthology.orchestra.run.trial153.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:47:33.329 INFO:teuthology.orchestra.run.trial153.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:47:33.329 INFO:teuthology.orchestra.run.trial153.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:47:33.329 INFO:teuthology.orchestra.run.trial153.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:47:33.329 INFO:teuthology.orchestra.run.trial153.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:47:33.329 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:33.329 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:33.369 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-test 2026-02-17T11:47:33.407 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:33.410 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:47:33.459 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:47:33.459 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:47:33.459 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:47:33.459 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:33.463 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:33.681 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:33.765 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:33.766 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:33.766 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repository Size 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:33.767 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:33.768 INFO:teuthology.orchestra.run.trial153.stdout:Install 5 Packages 2026-02-17T11:47:33.768 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:33.768 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 50 M 2026-02-17T11:47:33.768 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 212 M 2026-02-17T11:47:33.768 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:33.875 INFO:teuthology.orchestra.run.trial153.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 5.0 MB/s | 233 kB 00:00 2026-02-17T11:47:33.892 INFO:teuthology.orchestra.run.trial153.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 17 MB/s | 303 kB 00:00 2026-02-17T11:47:33.900 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:33.902 INFO:teuthology.orchestra.run.trial153.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.1 MB/s | 64 kB 00:00 2026-02-17T11:47:33.902 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:33.914 INFO:teuthology.orchestra.run.trial153.stdout:(4/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T11:47:34.187 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:47:34.190 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:47:34.238 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:47:34.238 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:47:34.238 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:47:34.238 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:34.241 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:34.834 INFO:teuthology.orchestra.run.trial153.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T11:47:34.836 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:34.836 INFO:teuthology.orchestra.run.trial153.stdout:Total 47 MB/s | 50 MB 00:01 2026-02-17T11:47:34.862 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:34.871 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:34.871 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:35.056 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:35.056 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:35.171 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:35.171 INFO:teuthology.orchestra.run.trial010.stdout:skipping the directory /sys 2026-02-17T11:47:35.171 INFO:teuthology.orchestra.run.trial010.stdout:skipping the directory /proc 2026-02-17T11:47:35.171 INFO:teuthology.orchestra.run.trial010.stdout:skipping the directory /mnt 2026-02-17T11:47:35.171 INFO:teuthology.orchestra.run.trial010.stdout:skipping the directory /var/tmp 2026-02-17T11:47:35.171 INFO:teuthology.orchestra.run.trial010.stdout:skipping the directory /home 2026-02-17T11:47:35.171 INFO:teuthology.orchestra.run.trial010.stdout:skipping the directory /root 2026-02-17T11:47:35.171 INFO:teuthology.orchestra.run.trial010.stdout:skipping the directory /tmp 2026-02-17T11:47:35.171 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:35.268 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:35.274 INFO:teuthology.orchestra.run.trial153.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:47:35.279 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:47:35.286 INFO:teuthology.orchestra.run.trial153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:47:35.287 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:47:35.634 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:47:35.658 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:47:35.658 INFO:teuthology.orchestra.run.trial010.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:35.658 INFO:teuthology.orchestra.run.trial010.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:47:35.658 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:47:35.658 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:47:35.659 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:35.659 INFO:teuthology.orchestra.run.trial010.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:47:35.671 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:47:35.671 INFO:teuthology.orchestra.run.trial010.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:35.726 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:35.726 INFO:teuthology.orchestra.run.trial010.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:47:35.726 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:35.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T11:47:35.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T11:47:35.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T11:47:35.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:47:35.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:47:35.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:47:35.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:47:35.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:47:35.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:47:35.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:47:35.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:47:35.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:35.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:47:35.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T11:47:36.053 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:36.054 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:36.054 INFO:teuthology.orchestra.run.trial010.stdout:Upgraded: 2026-02-17T11:47:36.054 INFO:teuthology.orchestra.run.trial010.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.054 INFO:teuthology.orchestra.run.trial010.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.054 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:47:36.054 INFO:teuthology.orchestra.run.trial010.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:47:36.054 INFO:teuthology.orchestra.run.trial010.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.054 INFO:teuthology.orchestra.run.trial010.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.054 INFO:teuthology.orchestra.run.trial010.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:47:36.055 INFO:teuthology.orchestra.run.trial010.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.056 INFO:teuthology.orchestra.run.trial010.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.057 INFO:teuthology.orchestra.run.trial010.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:36.057 INFO:teuthology.orchestra.run.trial010.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:47:36.057 INFO:teuthology.orchestra.run.trial010.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:47:36.057 INFO:teuthology.orchestra.run.trial010.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:47:36.057 INFO:teuthology.orchestra.run.trial010.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:47:36.057 INFO:teuthology.orchestra.run.trial010.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:47:36.057 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:36.057 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:47:36.096 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-test 2026-02-17T11:47:36.414 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:36.497 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repository Size 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout:Installing dependencies: 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:47:36.498 INFO:teuthology.orchestra.run.trial010.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:47:36.499 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:36.499 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:47:36.499 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:47:36.499 INFO:teuthology.orchestra.run.trial010.stdout:Install 5 Packages 2026-02-17T11:47:36.499 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:36.499 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 50 M 2026-02-17T11:47:36.499 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 212 M 2026-02-17T11:47:36.499 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:47:36.955 INFO:teuthology.orchestra.run.trial010.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 412 kB/s | 163 kB 00:00 2026-02-17T11:47:37.383 INFO:teuthology.orchestra.run.trial010.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 283 kB/s | 233 kB 00:00 2026-02-17T11:47:37.542 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:47:37.547 INFO:teuthology.orchestra.run.trial010.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 386 kB/s | 64 kB 00:00 2026-02-17T11:47:37.560 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:47:37.771 INFO:teuthology.orchestra.run.trial010.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 372 kB/s | 303 kB 00:00 2026-02-17T11:47:37.774 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:47:37.774 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T11:47:37.774 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T11:47:37.774 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:47:37.774 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:47:37.828 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:47:37.828 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:37.828 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:37.829 INFO:teuthology.orchestra.run.trial153.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:37.829 INFO:teuthology.orchestra.run.trial153.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:37.829 INFO:teuthology.orchestra.run.trial153.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:47:37.829 INFO:teuthology.orchestra.run.trial153.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:47:37.829 INFO:teuthology.orchestra.run.trial153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:47:37.829 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:37.829 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:37.861 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph 2026-02-17T11:47:38.037 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:38.037 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /sys 2026-02-17T11:47:38.038 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /proc 2026-02-17T11:47:38.038 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /mnt 2026-02-17T11:47:38.038 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /var/tmp 2026-02-17T11:47:38.038 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /home 2026-02-17T11:47:38.038 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /root 2026-02-17T11:47:38.038 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /tmp 2026-02-17T11:47:38.038 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:38.161 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:38.246 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:38.249 INFO:teuthology.orchestra.run.trial153.stdout:====================================================================================== 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repository Size 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout:====================================================================================== 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T11:47:38.250 INFO:teuthology.orchestra.run.trial153.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:47:38.251 INFO:teuthology.orchestra.run.trial153.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:47:38.252 INFO:teuthology.orchestra.run.trial153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:47:38.253 INFO:teuthology.orchestra.run.trial153.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:47:38.254 INFO:teuthology.orchestra.run.trial153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout:Installing weak dependencies: 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T11:47:38.255 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout:====================================================================================== 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout:Install 99 Packages 2026-02-17T11:47:38.256 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:38.257 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 95 M 2026-02-17T11:47:38.257 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 520 M 2026-02-17T11:47:38.257 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:38.258 INFO:teuthology.orchestra.run.trial010.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 29 MB/s | 50 MB 00:01 2026-02-17T11:47:38.260 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:38.261 INFO:teuthology.orchestra.run.trial010.stdout:Total 29 MB/s | 50 MB 00:01 2026-02-17T11:47:38.287 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:47:38.297 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:47:38.297 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:47:38.482 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:47:38.482 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:47:38.494 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:47:38.518 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:47:38.518 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:38.518 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:47:38.518 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:47:38.519 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:47:38.519 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:38.520 INFO:teuthology.orchestra.run.trial174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:47:38.534 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:47:38.534 INFO:teuthology.orchestra.run.trial174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:38.585 INFO:teuthology.orchestra.run.trial153.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 130 kB/s | 6.5 kB 00:00 2026-02-17T11:47:38.589 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:38.589 INFO:teuthology.orchestra.run.trial174.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:47:38.589 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:38.674 INFO:teuthology.orchestra.run.trial153.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 7.7 MB/s | 1.1 MB 00:00 2026-02-17T11:47:38.692 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:47:38.698 INFO:teuthology.orchestra.run.trial010.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:47:38.698 INFO:teuthology.orchestra.run.trial153.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 15 MB/s | 2.4 MB 00:00 2026-02-17T11:47:38.704 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:47:38.712 INFO:teuthology.orchestra.run.trial010.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:47:38.713 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:47:38.732 INFO:teuthology.orchestra.run.trial153.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 943 kB/s | 31 kB 00:00 2026-02-17T11:47:38.760 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:38.760 INFO:teuthology.orchestra.run.trial071.stdout:skipping the directory /sys 2026-02-17T11:47:38.760 INFO:teuthology.orchestra.run.trial071.stdout:skipping the directory /proc 2026-02-17T11:47:38.760 INFO:teuthology.orchestra.run.trial071.stdout:skipping the directory /mnt 2026-02-17T11:47:38.760 INFO:teuthology.orchestra.run.trial071.stdout:skipping the directory /var/tmp 2026-02-17T11:47:38.760 INFO:teuthology.orchestra.run.trial071.stdout:skipping the directory /home 2026-02-17T11:47:38.761 INFO:teuthology.orchestra.run.trial071.stdout:skipping the directory /root 2026-02-17T11:47:38.761 INFO:teuthology.orchestra.run.trial071.stdout:skipping the directory /tmp 2026-02-17T11:47:38.761 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:38.770 INFO:teuthology.orchestra.run.trial153.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 3.9 MB/s | 150 kB 00:00 2026-02-17T11:47:38.856 INFO:teuthology.orchestra.run.trial153.stdout:(6/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 17 MB/s | 4.7 MB 00:00 2026-02-17T11:47:38.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T11:47:38.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T11:47:38.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T11:47:38.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T11:47:38.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:38.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:47:38.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:38.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T11:47:38.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:47:38.860 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:47:38.861 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T11:47:38.922 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:38.922 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:38.922 INFO:teuthology.orchestra.run.trial174.stdout:Upgraded: 2026-02-17T11:47:38.922 INFO:teuthology.orchestra.run.trial174.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.922 INFO:teuthology.orchestra.run.trial174.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.922 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:47:38.922 INFO:teuthology.orchestra.run.trial174.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:47:38.922 INFO:teuthology.orchestra.run.trial174.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.922 INFO:teuthology.orchestra.run.trial174.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:47:38.923 INFO:teuthology.orchestra.run.trial174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:47:38.924 INFO:teuthology.orchestra.run.trial174.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:47:38.925 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:38.925 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:47:38.940 INFO:teuthology.orchestra.run.trial153.stdout:(7/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 22 MB/s | 3.8 MB 00:00 2026-02-17T11:47:38.964 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-test 2026-02-17T11:47:38.983 INFO:teuthology.orchestra.run.trial153.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 519 kB/s | 22 kB 00:00 2026-02-17T11:47:39.032 INFO:teuthology.orchestra.run.trial153.stdout:(9/99): ceph-mgr-modules-core-19.2.3-675.g3c96d 5.1 MB/s | 253 kB 00:00 2026-02-17T11:47:39.079 INFO:teuthology.orchestra.run.trial153.stdout:(10/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 1.0 MB/s | 49 kB 00:00 2026-02-17T11:47:39.128 INFO:teuthology.orchestra.run.trial153.stdout:(11/99): ceph-prometheus-alerts-19.2.3-675.g3c9 344 kB/s | 17 kB 00:00 2026-02-17T11:47:39.185 INFO:teuthology.orchestra.run.trial153.stdout:(12/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 5.1 MB/s | 299 kB 00:00 2026-02-17T11:47:39.215 INFO:teuthology.orchestra.run.trial153.stdout:(13/99): ceph-mgr-diskprediction-local-19.2.3-6 21 MB/s | 7.4 MB 00:00 2026-02-17T11:47:39.215 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:47:39.233 INFO:teuthology.orchestra.run.trial153.stdout:(14/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 16 MB/s | 769 kB 00:00 2026-02-17T11:47:39.238 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:47:39.238 INFO:teuthology.orchestra.run.trial071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:39.238 INFO:teuthology.orchestra.run.trial071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:47:39.238 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:47:39.238 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:47:39.238 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:39.240 INFO:teuthology.orchestra.run.trial071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:47:39.254 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:47:39.254 INFO:teuthology.orchestra.run.trial071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:39.260 INFO:teuthology.orchestra.run.trial153.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.5 MB/s | 40 kB 00:00 2026-02-17T11:47:39.263 INFO:teuthology.orchestra.run.trial153.stdout:(16/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 7.2 MB/s | 350 kB 00:00 2026-02-17T11:47:39.276 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:15 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:39.286 INFO:teuthology.orchestra.run.trial153.stdout:(17/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T11:47:39.289 INFO:teuthology.orchestra.run.trial153.stdout:(18/99): libgfortran-11.5.0-14.el9.x86_64.rpm 30 MB/s | 794 kB 00:00 2026-02-17T11:47:39.294 INFO:teuthology.orchestra.run.trial153.stdout:(19/99): libconfig-1.7.2-9.el9.x86_64.rpm 2.1 MB/s | 72 kB 00:00 2026-02-17T11:47:39.302 INFO:teuthology.orchestra.run.trial153.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 19 MB/s | 253 kB 00:00 2026-02-17T11:47:39.308 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:39.308 INFO:teuthology.orchestra.run.trial071.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:47:39.309 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:39.313 INFO:teuthology.orchestra.run.trial153.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 9.9 MB/s | 106 kB 00:00 2026-02-17T11:47:39.323 INFO:teuthology.orchestra.run.trial153.stdout:(22/99): python3-pycparser-2.20-6.el9.noarch.rp 13 MB/s | 135 kB 00:00 2026-02-17T11:47:39.329 INFO:teuthology.orchestra.run.trial153.stdout:(23/99): python3-cryptography-36.0.1-5.el9.x86_ 36 MB/s | 1.2 MB 00:00 2026-02-17T11:47:39.329 INFO:teuthology.orchestra.run.trial153.stdout:(24/99): libquadmath-11.5.0-14.el9.x86_64.rpm 4.2 MB/s | 184 kB 00:00 2026-02-17T11:47:39.333 INFO:teuthology.orchestra.run.trial153.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 14 MB/s | 150 kB 00:00 2026-02-17T11:47:39.339 INFO:teuthology.orchestra.run.trial153.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 12 MB/s | 126 kB 00:00 2026-02-17T11:47:39.345 INFO:teuthology.orchestra.run.trial153.stdout:(27/99): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-17T11:47:39.347 INFO:teuthology.orchestra.run.trial153.stdout:(28/99): python3-urllib3-1.26.5-7.el9.noarch.rp 12 MB/s | 218 kB 00:00 2026-02-17T11:47:39.349 INFO:teuthology.orchestra.run.trial153.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 28 MB/s | 266 kB 00:00 2026-02-17T11:47:39.356 INFO:teuthology.orchestra.run.trial153.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 2.7 MB/s | 30 kB 00:00 2026-02-17T11:47:39.358 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:47:39.359 INFO:teuthology.orchestra.run.trial153.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 1.5 MB/s | 15 kB 00:00 2026-02-17T11:47:39.359 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:47:39.359 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:47:39.360 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:47:39.361 INFO:teuthology.orchestra.run.trial174.stdout:Install 5 Packages 2026-02-17T11:47:39.361 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:39.361 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 50 M 2026-02-17T11:47:39.361 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 212 M 2026-02-17T11:47:39.361 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:47:39.368 INFO:teuthology.orchestra.run.trial153.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 20 MB/s | 246 kB 00:00 2026-02-17T11:47:39.370 INFO:teuthology.orchestra.run.trial153.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 16 MB/s | 188 kB 00:00 2026-02-17T11:47:39.372 INFO:teuthology.orchestra.run.trial153.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 9.5 MB/s | 42 kB 00:00 2026-02-17T11:47:39.382 INFO:teuthology.orchestra.run.trial153.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 86 MB/s | 3.0 MB 00:00 2026-02-17T11:47:39.399 INFO:teuthology.orchestra.run.trial153.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 38 MB/s | 1.0 MB 00:00 2026-02-17T11:47:39.409 INFO:teuthology.orchestra.run.trial153.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 223 MB/s | 6.0 MB 00:00 2026-02-17T11:47:39.410 INFO:teuthology.orchestra.run.trial153.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 22 MB/s | 244 kB 00:00 2026-02-17T11:47:39.416 INFO:teuthology.orchestra.run.trial153.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 35 MB/s | 249 kB 00:00 2026-02-17T11:47:39.418 INFO:teuthology.orchestra.run.trial153.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 24 MB/s | 177 kB 00:00 2026-02-17T11:47:39.424 INFO:teuthology.orchestra.run.trial153.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 26 MB/s | 172 kB 00:00 2026-02-17T11:47:39.427 INFO:teuthology.orchestra.run.trial153.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 116 MB/s | 1.2 MB 00:00 2026-02-17T11:47:39.429 INFO:teuthology.orchestra.run.trial153.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 7.1 MB/s | 35 kB 00:00 2026-02-17T11:47:39.440 INFO:teuthology.orchestra.run.trial153.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 42 MB/s | 442 kB 00:00 2026-02-17T11:47:39.445 INFO:teuthology.orchestra.run.trial153.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 14 MB/s | 77 kB 00:00 2026-02-17T11:47:39.453 INFO:teuthology.orchestra.run.trial153.stdout:(46/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 237 MB/s | 6.1 MB 00:00 2026-02-17T11:47:39.454 INFO:teuthology.orchestra.run.trial153.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 30 MB/s | 267 kB 00:00 2026-02-17T11:47:39.460 INFO:teuthology.orchestra.run.trial153.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 23 MB/s | 159 kB 00:00 2026-02-17T11:47:39.461 INFO:teuthology.orchestra.run.trial153.stdout:(49/99): python3-pyasn1-modules-0.4.8-6.el9.noa 39 MB/s | 279 kB 00:00 2026-02-17T11:47:39.465 INFO:teuthology.orchestra.run.trial153.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 10 MB/s | 54 kB 00:00 2026-02-17T11:47:39.470 INFO:teuthology.orchestra.run.trial153.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 8.8 MB/s | 42 kB 00:00 2026-02-17T11:47:39.475 INFO:teuthology.orchestra.run.trial153.stdout:(52/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 40 MB/s | 189 kB 00:00 2026-02-17T11:47:39.485 INFO:teuthology.orchestra.run.trial153.stdout:(53/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 46 MB/s | 5.3 MB 00:00 2026-02-17T11:47:39.485 INFO:teuthology.orchestra.run.trial153.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 8.6 MB/s | 90 kB 00:00 2026-02-17T11:47:39.527 INFO:teuthology.orchestra.run.trial153.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 528 kB/s | 22 kB 00:00 2026-02-17T11:47:39.546 INFO:teuthology.orchestra.run.trial153.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 14 MB/s | 862 kB 00:00 2026-02-17T11:47:39.579 INFO:teuthology.orchestra.run.trial153.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 593 kB/s | 19 kB 00:00 2026-02-17T11:47:39.587 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T11:47:39.588 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T11:47:39.588 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T11:47:39.588 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T11:47:39.588 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:47:39.588 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:47:39.588 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:47:39.588 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T11:47:39.588 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T11:47:39.588 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:47:39.589 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:47:39.590 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:47:39.591 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T11:47:39.614 INFO:teuthology.orchestra.run.trial153.stdout:(58/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 6.2 MB/s | 551 kB 00:00 2026-02-17T11:47:39.614 INFO:teuthology.orchestra.run.trial153.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 4.2 MB/s | 151 kB 00:00 2026-02-17T11:47:39.627 INFO:teuthology.orchestra.run.trial153.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 2.2 MB/s | 29 kB 00:00 2026-02-17T11:47:39.629 INFO:teuthology.orchestra.run.trial153.stdout:(61/99): python3-asyncssh-2.13.2-5.el9.noarch.r 36 MB/s | 548 kB 00:00 2026-02-17T11:47:39.640 INFO:teuthology.orchestra.run.trial153.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 3.6 MB/s | 43 kB 00:00 2026-02-17T11:47:39.641 INFO:teuthology.orchestra.run.trial153.stdout:(63/99): python3-backports-tarfile-1.2.0-1.el9. 4.4 MB/s | 60 kB 00:00 2026-02-17T11:47:39.648 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:47:39.648 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:39.648 INFO:teuthology.orchestra.run.trial071.stdout:Upgraded: 2026-02-17T11:47:39.648 INFO:teuthology.orchestra.run.trial071.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.648 INFO:teuthology.orchestra.run.trial071.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.648 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:47:39.648 INFO:teuthology.orchestra.run.trial071.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:47:39.649 INFO:teuthology.orchestra.run.trial071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.650 INFO:teuthology.orchestra.run.trial071.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.651 INFO:teuthology.orchestra.run.trial071.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.651 INFO:teuthology.orchestra.run.trial071.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:39.651 INFO:teuthology.orchestra.run.trial071.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:47:39.651 INFO:teuthology.orchestra.run.trial071.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:47:39.651 INFO:teuthology.orchestra.run.trial071.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:47:39.651 INFO:teuthology.orchestra.run.trial071.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:47:39.651 INFO:teuthology.orchestra.run.trial071.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:47:39.651 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:39.651 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:47:39.652 INFO:teuthology.orchestra.run.trial153.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 2.8 MB/s | 32 kB 00:00 2026-02-17T11:47:39.653 INFO:teuthology.orchestra.run.trial153.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 1.1 MB/s | 14 kB 00:00 2026-02-17T11:47:39.664 INFO:teuthology.orchestra.run.trial153.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 14 MB/s | 173 kB 00:00 2026-02-17T11:47:39.680 INFO:teuthology.orchestra.run.trial153.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 13 MB/s | 358 kB 00:00 2026-02-17T11:47:39.680 INFO:teuthology.orchestra.run.trial153.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 16 MB/s | 254 kB 00:00 2026-02-17T11:47:39.692 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-test 2026-02-17T11:47:39.694 INFO:teuthology.orchestra.run.trial153.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 11 MB/s | 144 kB 00:00 2026-02-17T11:47:39.708 INFO:teuthology.orchestra.run.trial153.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 9.8 MB/s | 139 kB 00:00 2026-02-17T11:47:39.720 INFO:teuthology.orchestra.run.trial153.stdout:(71/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 51 MB/s | 2.0 MB 00:00 2026-02-17T11:47:39.721 INFO:teuthology.orchestra.run.trial153.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 4.4 MB/s | 56 kB 00:00 2026-02-17T11:47:39.727 INFO:teuthology.orchestra.run.trial174.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.9 MB/s | 233 kB 00:00 2026-02-17T11:47:39.732 INFO:teuthology.orchestra.run.trial153.stdout:(73/99): python3-jaraco-classes-3.2.1-5.el9.noa 1.5 MB/s | 18 kB 00:00 2026-02-17T11:47:39.733 INFO:teuthology.orchestra.run.trial153.stdout:(74/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 825 kB/s | 11 kB 00:00 2026-02-17T11:47:39.743 INFO:teuthology.orchestra.run.trial153.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 2.0 MB/s | 23 kB 00:00 2026-02-17T11:47:39.746 INFO:teuthology.orchestra.run.trial153.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 1.5 MB/s | 20 kB 00:00 2026-02-17T11:47:39.747 INFO:teuthology.orchestra.run.trial174.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 15 MB/s | 303 kB 00:00 2026-02-17T11:47:39.754 INFO:teuthology.orchestra.run.trial174.stdout:(3/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T11:47:39.754 INFO:teuthology.orchestra.run.trial153.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 1.7 MB/s | 19 kB 00:00 2026-02-17T11:47:39.757 INFO:teuthology.orchestra.run.trial174.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 6.4 MB/s | 64 kB 00:00 2026-02-17T11:47:39.757 INFO:teuthology.orchestra.run.trial153.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 2.4 MB/s | 26 kB 00:00 2026-02-17T11:47:39.770 INFO:teuthology.orchestra.run.trial153.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 65 MB/s | 1.0 MB 00:00 2026-02-17T11:47:39.770 INFO:teuthology.orchestra.run.trial153.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 3.3 MB/s | 46 kB 00:00 2026-02-17T11:47:39.782 INFO:teuthology.orchestra.run.trial153.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 6.3 MB/s | 79 kB 00:00 2026-02-17T11:47:39.783 INFO:teuthology.orchestra.run.trial153.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 6.7 MB/s | 86 kB 00:00 2026-02-17T11:47:39.795 INFO:teuthology.orchestra.run.trial153.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 4.8 MB/s | 58 kB 00:00 2026-02-17T11:47:39.798 INFO:teuthology.orchestra.run.trial153.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 18 MB/s | 272 kB 00:00 2026-02-17T11:47:39.805 INFO:teuthology.orchestra.run.trial153.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 1.5 MB/s | 16 kB 00:00 2026-02-17T11:47:39.811 INFO:teuthology.orchestra.run.trial153.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 6.6 MB/s | 90 kB 00:00 2026-02-17T11:47:39.817 INFO:teuthology.orchestra.run.trial153.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 2.6 MB/s | 31 kB 00:00 2026-02-17T11:47:39.827 INFO:teuthology.orchestra.run.trial153.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 12 MB/s | 188 kB 00:00 2026-02-17T11:47:39.829 INFO:teuthology.orchestra.run.trial153.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 4.9 MB/s | 59 kB 00:00 2026-02-17T11:47:39.841 INFO:teuthology.orchestra.run.trial153.stdout:(90/99): python3-tempora-5.0.0-2.el9.noarch.rpm 3.1 MB/s | 36 kB 00:00 2026-02-17T11:47:39.849 INFO:teuthology.orchestra.run.trial153.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 5.5 MB/s | 125 kB 00:00 2026-02-17T11:47:39.852 INFO:teuthology.orchestra.run.trial153.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 7.5 MB/s | 86 kB 00:00 2026-02-17T11:47:39.880 INFO:teuthology.orchestra.run.trial153.stdout:(93/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 46 MB/s | 19 MB 00:00 2026-02-17T11:47:39.881 INFO:teuthology.orchestra.run.trial153.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 3.0 MB/s | 90 kB 00:00 2026-02-17T11:47:39.882 INFO:teuthology.orchestra.run.trial153.stdout:(95/99): python3-webob-1.8.8-2.el9.noarch.rpm 6.7 MB/s | 230 kB 00:00 2026-02-17T11:47:39.893 INFO:teuthology.orchestra.run.trial153.stdout:(96/99): python3-xmltodict-0.12.0-15.el9.noarch 2.0 MB/s | 22 kB 00:00 2026-02-17T11:47:39.904 INFO:teuthology.orchestra.run.trial153.stdout:(97/99): python3-zc-lockfile-2.0-10.el9.noarch. 1.9 MB/s | 20 kB 00:00 2026-02-17T11:47:39.929 INFO:teuthology.orchestra.run.trial153.stdout:(98/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.0 MB/s | 48 kB 00:00 2026-02-17T11:47:39.942 INFO:teuthology.orchestra.run.trial153.stdout:(99/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.8 MB/s | 427 kB 00:00 2026-02-17T11:47:39.944 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:39.944 INFO:teuthology.orchestra.run.trial153.stdout:Total 56 MB/s | 95 MB 00:01 2026-02-17T11:47:40.004 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:14 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:47:40.087 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:47:40.088 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:47:40.088 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repository Size 2026-02-17T11:47:40.088 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:47:40.088 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:47:40.088 INFO:teuthology.orchestra.run.trial071.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T11:47:40.088 INFO:teuthology.orchestra.run.trial071.stdout:Installing dependencies: 2026-02-17T11:47:40.088 INFO:teuthology.orchestra.run.trial071.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T11:47:40.088 INFO:teuthology.orchestra.run.trial071.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:47:40.088 INFO:teuthology.orchestra.run.trial071.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:47:40.089 INFO:teuthology.orchestra.run.trial071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:47:40.089 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:40.089 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:47:40.089 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:47:40.089 INFO:teuthology.orchestra.run.trial071.stdout:Install 5 Packages 2026-02-17T11:47:40.089 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:40.089 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 50 M 2026-02-17T11:47:40.089 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 212 M 2026-02-17T11:47:40.089 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:47:40.212 INFO:teuthology.orchestra.run.trial071.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.1 MB/s | 233 kB 00:00 2026-02-17T11:47:40.241 INFO:teuthology.orchestra.run.trial071.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 10 MB/s | 303 kB 00:00 2026-02-17T11:47:40.266 INFO:teuthology.orchestra.run.trial071.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2026-02-17T11:47:40.360 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:40.398 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:40.398 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:40.514 INFO:teuthology.orchestra.run.trial071.stdout:(4/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 456 kB/s | 163 kB 00:00 2026-02-17T11:47:40.689 INFO:teuthology.orchestra.run.trial174.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T11:47:40.690 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:40.690 INFO:teuthology.orchestra.run.trial174.stdout:Total 38 MB/s | 50 MB 00:01 2026-02-17T11:47:40.716 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:47:40.725 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:47:40.725 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:47:40.810 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:40.810 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:40.911 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:47:40.911 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:47:41.022 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:47:41.040 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:47:41.123 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:47:41.129 INFO:teuthology.orchestra.run.trial174.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:47:41.134 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:47:41.142 INFO:teuthology.orchestra.run.trial174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:47:41.143 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:47:41.250 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:41.252 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:47:41.279 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:47:41.279 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T11:47:41.279 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T11:47:41.279 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:47:41.279 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:47:41.282 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:47:41.288 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:47:41.309 INFO:teuthology.orchestra.run.trial153.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:47:41.315 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:47:41.332 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:47:41.332 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:41.332 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:47:41.333 INFO:teuthology.orchestra.run.trial010.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:41.333 INFO:teuthology.orchestra.run.trial010.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:41.333 INFO:teuthology.orchestra.run.trial010.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:47:41.333 INFO:teuthology.orchestra.run.trial010.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:47:41.333 INFO:teuthology.orchestra.run.trial010.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:47:41.333 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:41.333 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:47:41.347 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:47:41.357 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:47:41.362 INFO:teuthology.orchestra.run.trial153.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:47:41.364 INFO:teuthology.orchestra.run.trial153.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:47:41.365 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph 2026-02-17T11:47:41.368 INFO:teuthology.orchestra.run.trial153.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:47:41.391 INFO:teuthology.orchestra.run.trial153.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:47:41.403 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:47:41.406 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:47:41.412 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:47:41.414 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:47:41.425 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:47:41.431 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:47:41.455 INFO:teuthology.orchestra.run.trial153.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:47:41.458 INFO:teuthology.orchestra.run.trial153.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:47:41.465 INFO:teuthology.orchestra.run.trial153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:47:41.489 INFO:teuthology.orchestra.run.trial153.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:47:41.540 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:47:41.553 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:47:41.556 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:47:41.560 INFO:teuthology.orchestra.run.trial153.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:47:41.565 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:47:41.570 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:47:41.573 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:47:41.587 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:47:41.609 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:47:41.614 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:47:41.619 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:47:41.630 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:47:41.639 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:47:41.647 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:47:41.666 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:47:41.668 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:41.675 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:47:41.729 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:47:41.741 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:47:41.754 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:47:41.756 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:47:41.757 INFO:teuthology.orchestra.run.trial010.stdout:====================================================================================== 2026-02-17T11:47:41.757 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repository Size 2026-02-17T11:47:41.757 INFO:teuthology.orchestra.run.trial010.stdout:====================================================================================== 2026-02-17T11:47:41.757 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:47:41.757 INFO:teuthology.orchestra.run.trial010.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T11:47:41.757 INFO:teuthology.orchestra.run.trial010.stdout:Installing dependencies: 2026-02-17T11:47:41.757 INFO:teuthology.orchestra.run.trial010.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:47:41.757 INFO:teuthology.orchestra.run.trial010.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:47:41.758 INFO:teuthology.orchestra.run.trial010.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:47:41.759 INFO:teuthology.orchestra.run.trial010.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:47:41.760 INFO:teuthology.orchestra.run.trial010.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:47:41.761 INFO:teuthology.orchestra.run.trial010.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:47:41.762 INFO:teuthology.orchestra.run.trial010.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:47:41.763 INFO:teuthology.orchestra.run.trial010.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:47:41.764 INFO:teuthology.orchestra.run.trial010.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout:Installing weak dependencies: 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:47:41.765 INFO:teuthology.orchestra.run.trial010.stdout:====================================================================================== 2026-02-17T11:47:41.766 INFO:teuthology.orchestra.run.trial010.stdout:Install 99 Packages 2026-02-17T11:47:41.766 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:41.766 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:47:41.767 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 95 M 2026-02-17T11:47:41.767 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 520 M 2026-02-17T11:47:41.767 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:47:41.768 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:47:41.790 INFO:teuthology.orchestra.run.trial071.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 30 MB/s | 50 MB 00:01 2026-02-17T11:47:41.793 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:41.793 INFO:teuthology.orchestra.run.trial071.stdout:Total 30 MB/s | 50 MB 00:01 2026-02-17T11:47:41.808 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:47:41.819 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:47:41.828 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:47:41.828 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:47:42.014 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:47:42.014 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:47:42.128 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:47:42.138 INFO:teuthology.orchestra.run.trial010.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 115 kB/s | 6.5 kB 00:00 2026-02-17T11:47:42.138 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:47:42.142 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:47:42.148 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:47:42.149 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:47:42.176 INFO:teuthology.orchestra.run.trial153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:47:42.214 INFO:teuthology.orchestra.run.trial010.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 8.1 MB/s | 1.1 MB 00:00 2026-02-17T11:47:42.220 INFO:teuthology.orchestra.run.trial153.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:47:42.226 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:47:42.227 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:47:42.230 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:47:42.231 INFO:teuthology.orchestra.run.trial071.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:47:42.236 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:47:42.236 INFO:teuthology.orchestra.run.trial010.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 16 MB/s | 2.4 MB 00:00 2026-02-17T11:47:42.236 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:47:42.239 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:47:42.244 INFO:teuthology.orchestra.run.trial071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:47:42.244 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:47:42.246 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:47:42.250 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:47:42.261 INFO:teuthology.orchestra.run.trial010.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 1.2 MB/s | 31 kB 00:00 2026-02-17T11:47:42.278 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:47:42.287 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:47:42.290 INFO:teuthology.orchestra.run.trial010.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 5.1 MB/s | 150 kB 00:00 2026-02-17T11:47:42.322 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:47:42.444 INFO:teuthology.orchestra.run.trial010.stdout:(6/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 16 MB/s | 4.7 MB 00:00 2026-02-17T11:47:42.449 INFO:teuthology.orchestra.run.trial010.stdout:(7/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 24 MB/s | 3.8 MB 00:00 2026-02-17T11:47:42.482 INFO:teuthology.orchestra.run.trial010.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 677 kB/s | 22 kB 00:00 2026-02-17T11:47:42.521 INFO:teuthology.orchestra.run.trial010.stdout:(9/99): ceph-mgr-modules-core-19.2.3-675.g3c96d 6.2 MB/s | 253 kB 00:00 2026-02-17T11:47:42.547 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:47:42.558 INFO:teuthology.orchestra.run.trial010.stdout:(10/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 1.3 MB/s | 49 kB 00:00 2026-02-17T11:47:42.571 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:47:42.574 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:47:42.596 INFO:teuthology.orchestra.run.trial010.stdout:(11/99): ceph-prometheus-alerts-19.2.3-675.g3c9 439 kB/s | 17 kB 00:00 2026-02-17T11:47:42.634 INFO:teuthology.orchestra.run.trial153.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:47:42.635 INFO:teuthology.orchestra.run.trial153.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:47:42.641 INFO:teuthology.orchestra.run.trial010.stdout:(12/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 6.5 MB/s | 299 kB 00:00 2026-02-17T11:47:42.656 INFO:teuthology.orchestra.run.trial153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:47:42.699 INFO:teuthology.orchestra.run.trial010.stdout:(13/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 13 MB/s | 769 kB 00:00 2026-02-17T11:47:42.771 INFO:teuthology.orchestra.run.trial010.stdout:(14/99): ceph-mgr-diskprediction-local-19.2.3-6 23 MB/s | 7.4 MB 00:00 2026-02-17T11:47:42.835 INFO:teuthology.orchestra.run.trial010.stdout:(15/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T11:47:42.981 INFO:teuthology.orchestra.run.trial153.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:47:43.054 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:47:43.206 INFO:teuthology.orchestra.run.trial010.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 93 kB/s | 40 kB 00:00 2026-02-17T11:47:43.350 INFO:teuthology.orchestra.run.trial010.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 141 kB/s | 72 kB 00:00 2026-02-17T11:47:43.394 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:47:43.412 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:47:43.614 INFO:teuthology.orchestra.run.trial010.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 700 kB/s | 184 kB 00:00 2026-02-17T11:47:43.643 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:47:43.644 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T11:47:43.644 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T11:47:43.644 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:47:43.644 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:47:43.658 INFO:teuthology.orchestra.run.trial010.stdout:(19/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 365 kB/s | 350 kB 00:00 2026-02-17T11:47:43.697 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:47:43.697 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:43.697 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:47:43.697 INFO:teuthology.orchestra.run.trial174.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:43.697 INFO:teuthology.orchestra.run.trial174.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:43.697 INFO:teuthology.orchestra.run.trial174.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:47:43.697 INFO:teuthology.orchestra.run.trial174.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:47:43.697 INFO:teuthology.orchestra.run.trial174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:47:43.697 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:43.698 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:47:43.725 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:47:43.731 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph 2026-02-17T11:47:43.742 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:47:43.752 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:47:43.759 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:47:43.772 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:47:43.788 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:47:43.863 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:47:43.872 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:47:43.896 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:47:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:47:43.959 INFO:teuthology.orchestra.run.trial010.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 734 kB/s | 253 kB 00:00 2026-02-17T11:47:43.979 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:47:43.985 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:47:43.989 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:47:43.990 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:47:44.009 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:44.009 INFO:teuthology.orchestra.run.trial153.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:47:44.009 INFO:teuthology.orchestra.run.trial153.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:47:44.009 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:44.016 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:44.039 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:20 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:44.042 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:44.042 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:47:44.042 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:44.075 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:47:44.126 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout:====================================================================================== 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout:====================================================================================== 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T11:47:44.129 INFO:teuthology.orchestra.run.trial174.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:47:44.130 INFO:teuthology.orchestra.run.trial174.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:47:44.131 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:47:44.132 INFO:teuthology.orchestra.run.trial174.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:47:44.133 INFO:teuthology.orchestra.run.trial174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:47:44.134 INFO:teuthology.orchestra.run.trial174.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout:Installing weak dependencies: 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout:====================================================================================== 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout:Install 99 Packages 2026-02-17T11:47:44.135 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:44.136 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 95 M 2026-02-17T11:47:44.136 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 520 M 2026-02-17T11:47:44.136 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:47:44.138 INFO:teuthology.orchestra.run.trial153.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:47:44.140 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:47:44.142 INFO:teuthology.orchestra.run.trial010.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 581 kB/s | 106 kB 00:00 2026-02-17T11:47:44.154 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:47:44.154 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:44.154 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:47:44.154 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:44.325 INFO:teuthology.orchestra.run.trial010.stdout:(22/99): python3-pycparser-2.20-6.el9.noarch.rp 738 kB/s | 135 kB 00:00 2026-02-17T11:47:44.486 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:47:44.504 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:47:44.589 INFO:teuthology.orchestra.run.trial010.stdout:(23/99): python3-pyparsing-2.4.7-9.el9.noarch.r 570 kB/s | 150 kB 00:00 2026-02-17T11:47:44.715 INFO:teuthology.orchestra.run.trial174.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 129 kB/s | 6.5 kB 00:00 2026-02-17T11:47:44.718 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:47:44.719 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T11:47:44.719 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T11:47:44.719 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:47:44.719 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:47:44.771 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:47:44.771 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:44.771 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:47:44.771 INFO:teuthology.orchestra.run.trial071.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:44.771 INFO:teuthology.orchestra.run.trial071.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:44.771 INFO:teuthology.orchestra.run.trial071.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:47:44.772 INFO:teuthology.orchestra.run.trial071.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:47:44.772 INFO:teuthology.orchestra.run.trial071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:47:44.772 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:44.772 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:47:44.772 INFO:teuthology.orchestra.run.trial010.stdout:(24/99): python3-requests-2.25.1-10.el9.noarch. 690 kB/s | 126 kB 00:00 2026-02-17T11:47:44.806 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph 2026-02-17T11:47:44.807 INFO:teuthology.orchestra.run.trial174.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 7.6 MB/s | 1.1 MB 00:00 2026-02-17T11:47:44.835 INFO:teuthology.orchestra.run.trial174.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-17T11:47:44.853 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:47:44.870 INFO:teuthology.orchestra.run.trial174.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 908 kB/s | 31 kB 00:00 2026-02-17T11:47:44.879 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:47:44.879 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:44.879 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:47:44.879 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:47:44.879 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:47:44.879 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:44.906 INFO:teuthology.orchestra.run.trial174.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 4.0 MB/s | 150 kB 00:00 2026-02-17T11:47:44.933 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:47:44.935 INFO:teuthology.orchestra.run.trial153.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:47:44.940 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T11:47:44.942 INFO:teuthology.orchestra.run.trial174.stdout:(6/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 21 MB/s | 4.7 MB 00:00 2026-02-17T11:47:44.959 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T11:47:44.961 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:47:45.117 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:19 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:47:45.117 INFO:teuthology.orchestra.run.trial010.stdout:(25/99): python3-urllib3-1.26.5-7.el9.noarch.rp 631 kB/s | 218 kB 00:00 2026-02-17T11:47:45.129 INFO:teuthology.orchestra.run.trial174.stdout:(7/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 17 MB/s | 3.8 MB 00:00 2026-02-17T11:47:45.174 INFO:teuthology.orchestra.run.trial174.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 495 kB/s | 22 kB 00:00 2026-02-17T11:47:45.203 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:47:45.205 INFO:teuthology.orchestra.run.trial071.stdout:====================================================================================== 2026-02-17T11:47:45.205 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repository Size 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout:====================================================================================== 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout:Installing dependencies: 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T11:47:45.206 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:47:45.207 INFO:teuthology.orchestra.run.trial071.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:47:45.208 INFO:teuthology.orchestra.run.trial071.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:47:45.209 INFO:teuthology.orchestra.run.trial071.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:47:45.210 INFO:teuthology.orchestra.run.trial071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:47:45.211 INFO:teuthology.orchestra.run.trial071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:47:45.212 INFO:teuthology.orchestra.run.trial071.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:47:45.213 INFO:teuthology.orchestra.run.trial071.stdout:Installing weak dependencies: 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout:====================================================================================== 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout:Install 99 Packages 2026-02-17T11:47:45.214 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:45.215 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 95 M 2026-02-17T11:47:45.215 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 520 M 2026-02-17T11:47:45.215 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:47:45.225 INFO:teuthology.orchestra.run.trial174.stdout:(9/99): ceph-mgr-modules-core-19.2.3-675.g3c96d 4.8 MB/s | 253 kB 00:00 2026-02-17T11:47:45.233 INFO:teuthology.orchestra.run.trial010.stdout:(26/99): python3-cryptography-36.0.1-5.el9.x86_ 810 kB/s | 1.2 MB 00:01 2026-02-17T11:47:45.267 INFO:teuthology.orchestra.run.trial010.stdout:(27/99): libgfortran-11.5.0-14.el9.x86_64.rpm 385 kB/s | 794 kB 00:02 2026-02-17T11:47:45.274 INFO:teuthology.orchestra.run.trial174.stdout:(10/99): ceph-mgr-diskprediction-local-19.2.3-6 22 MB/s | 7.4 MB 00:00 2026-02-17T11:47:45.275 INFO:teuthology.orchestra.run.trial174.stdout:(11/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 999 kB/s | 49 kB 00:00 2026-02-17T11:47:45.300 INFO:teuthology.orchestra.run.trial174.stdout:(12/99): ceph-prometheus-alerts-19.2.3-675.g3c9 647 kB/s | 17 kB 00:00 2026-02-17T11:47:45.307 INFO:teuthology.orchestra.run.trial174.stdout:(13/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 9.1 MB/s | 299 kB 00:00 2026-02-17T11:47:45.346 INFO:teuthology.orchestra.run.trial174.stdout:(14/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 16 MB/s | 769 kB 00:00 2026-02-17T11:47:45.382 INFO:teuthology.orchestra.run.trial010.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 688 kB/s | 182 kB 00:00 2026-02-17T11:47:45.399 INFO:teuthology.orchestra.run.trial010.stdout:(29/99): flexiblas-3.0.4-9.el9.x86_64.rpm 225 kB/s | 30 kB 00:00 2026-02-17T11:47:45.424 INFO:teuthology.orchestra.run.trial174.stdout:(15/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T11:47:45.452 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:47:45.455 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:47:45.488 INFO:teuthology.orchestra.run.trial010.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 167 kB/s | 15 kB 00:00 2026-02-17T11:47:45.581 INFO:teuthology.orchestra.run.trial010.stdout:(31/99): zip-3.0-35.el9.x86_64.rpm 764 kB/s | 266 kB 00:00 2026-02-17T11:47:45.585 INFO:teuthology.orchestra.run.trial071.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 116 kB/s | 6.5 kB 00:00 2026-02-17T11:47:45.660 INFO:teuthology.orchestra.run.trial071.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 8.2 MB/s | 1.1 MB 00:00 2026-02-17T11:47:45.681 INFO:teuthology.orchestra.run.trial071.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 16 MB/s | 2.4 MB 00:00 2026-02-17T11:47:45.710 INFO:teuthology.orchestra.run.trial071.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 1.1 MB/s | 31 kB 00:00 2026-02-17T11:47:45.739 INFO:teuthology.orchestra.run.trial071.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 5.0 MB/s | 150 kB 00:00 2026-02-17T11:47:45.804 INFO:teuthology.orchestra.run.trial174.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 88 kB/s | 40 kB 00:00 2026-02-17T11:47:45.819 INFO:teuthology.orchestra.run.trial010.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 744 kB/s | 246 kB 00:00 2026-02-17T11:47:45.831 INFO:teuthology.orchestra.run.trial010.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 754 kB/s | 188 kB 00:00 2026-02-17T11:47:45.898 INFO:teuthology.orchestra.run.trial071.stdout:(6/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 24 MB/s | 3.8 MB 00:00 2026-02-17T11:47:45.905 INFO:teuthology.orchestra.run.trial010.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 490 kB/s | 42 kB 00:00 2026-02-17T11:47:45.908 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:47:45.909 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:47:45.919 INFO:teuthology.orchestra.run.trial174.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 146 kB/s | 72 kB 00:00 2026-02-17T11:47:45.922 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:47:45.922 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:47:45.961 INFO:teuthology.orchestra.run.trial010.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 5.2 MB/s | 3.0 MB 00:00 2026-02-17T11:47:45.974 INFO:teuthology.orchestra.run.trial071.stdout:(7/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 12 MB/s | 4.7 MB 00:00 2026-02-17T11:47:45.979 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:47:46.028 INFO:teuthology.orchestra.run.trial071.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 408 kB/s | 22 kB 00:00 2026-02-17T11:47:46.029 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T11:47:46.030 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:47:46.051 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:47:46.052 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:46.052 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:47:46.052 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:47:46.052 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:47:46.052 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:46.058 INFO:teuthology.orchestra.run.trial174.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 466 kB/s | 350 kB 00:00 2026-02-17T11:47:46.063 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:47:46.088 INFO:teuthology.orchestra.run.trial071.stdout:(9/99): ceph-mgr-modules-core-19.2.3-675.g3c96d 4.2 MB/s | 253 kB 00:00 2026-02-17T11:47:46.145 INFO:teuthology.orchestra.run.trial071.stdout:(10/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 863 kB/s | 49 kB 00:00 2026-02-17T11:47:46.166 INFO:teuthology.orchestra.run.trial174.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 746 kB/s | 184 kB 00:00 2026-02-17T11:47:46.169 INFO:teuthology.orchestra.run.trial071.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-6 27 MB/s | 7.4 MB 00:00 2026-02-17T11:47:46.186 INFO:teuthology.orchestra.run.trial071.stdout:(12/99): ceph-prometheus-alerts-19.2.3-675.g3c9 409 kB/s | 17 kB 00:00 2026-02-17T11:47:46.204 INFO:teuthology.orchestra.run.trial071.stdout:(13/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 8.5 MB/s | 299 kB 00:00 2026-02-17T11:47:46.226 INFO:teuthology.orchestra.run.trial071.stdout:(14/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 16 MB/s | 350 kB 00:00 2026-02-17T11:47:46.230 INFO:teuthology.orchestra.run.trial071.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 9.2 MB/s | 40 kB 00:00 2026-02-17T11:47:46.235 INFO:teuthology.orchestra.run.trial071.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 15 MB/s | 72 kB 00:00 2026-02-17T11:47:46.244 INFO:teuthology.orchestra.run.trial071.stdout:(17/99): libgfortran-11.5.0-14.el9.x86_64.rpm 85 MB/s | 794 kB 00:00 2026-02-17T11:47:46.251 INFO:teuthology.orchestra.run.trial071.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 26 MB/s | 184 kB 00:00 2026-02-17T11:47:46.258 INFO:teuthology.orchestra.run.trial071.stdout:(19/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 37 MB/s | 253 kB 00:00 2026-02-17T11:47:46.276 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:47:46.277 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:47:46.282 INFO:teuthology.orchestra.run.trial071.stdout:(20/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 27 MB/s | 17 MB 00:00 2026-02-17T11:47:46.283 INFO:teuthology.orchestra.run.trial071.stdout:(21/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 7.7 MB/s | 769 kB 00:00 2026-02-17T11:47:46.289 INFO:teuthology.orchestra.run.trial071.stdout:(22/99): python3-cryptography-36.0.1-5.el9.x86_ 40 MB/s | 1.2 MB 00:00 2026-02-17T11:47:46.296 INFO:teuthology.orchestra.run.trial071.stdout:(23/99): python3-pyparsing-2.4.7-9.el9.noarch.r 23 MB/s | 150 kB 00:00 2026-02-17T11:47:46.297 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:47:46.298 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:46.298 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:47:46.298 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:47:46.298 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:47:46.298 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:46.300 INFO:teuthology.orchestra.run.trial071.stdout:(24/99): python3-ply-3.11-14.el9.noarch.rpm 6.0 MB/s | 106 kB 00:00 2026-02-17T11:47:46.301 INFO:teuthology.orchestra.run.trial071.stdout:(25/99): python3-pycparser-2.20-6.el9.noarch.rp 7.4 MB/s | 135 kB 00:00 2026-02-17T11:47:46.303 INFO:teuthology.orchestra.run.trial071.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 18 MB/s | 126 kB 00:00 2026-02-17T11:47:46.309 INFO:teuthology.orchestra.run.trial174.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2026-02-17T11:47:46.309 INFO:teuthology.orchestra.run.trial071.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 22 MB/s | 218 kB 00:00 2026-02-17T11:47:46.310 INFO:teuthology.orchestra.run.trial071.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 20 MB/s | 182 kB 00:00 2026-02-17T11:47:46.311 INFO:teuthology.orchestra.run.trial071.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 33 MB/s | 266 kB 00:00 2026-02-17T11:47:46.334 INFO:teuthology.orchestra.run.trial071.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 661 kB/s | 15 kB 00:00 2026-02-17T11:47:46.335 INFO:teuthology.orchestra.run.trial071.stdout:(31/99): flexiblas-3.0.4-9.el9.x86_64.rpm 1.1 MB/s | 30 kB 00:00 2026-02-17T11:47:46.365 INFO:teuthology.orchestra.run.trial071.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 7.8 MB/s | 246 kB 00:00 2026-02-17T11:47:46.365 INFO:teuthology.orchestra.run.trial071.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 6.2 MB/s | 188 kB 00:00 2026-02-17T11:47:46.373 INFO:teuthology.orchestra.run.trial071.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 4.8 MB/s | 42 kB 00:00 2026-02-17T11:47:46.384 INFO:teuthology.orchestra.run.trial071.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 41 MB/s | 3.0 MB 00:00 2026-02-17T11:47:46.386 INFO:teuthology.orchestra.run.trial010.stdout:(36/99): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2026-02-17T11:47:46.396 INFO:teuthology.orchestra.run.trial174.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-17T11:47:46.398 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:47:46.405 INFO:teuthology.orchestra.run.trial071.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 31 MB/s | 1.0 MB 00:00 2026-02-17T11:47:46.416 INFO:teuthology.orchestra.run.trial071.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 183 MB/s | 6.0 MB 00:00 2026-02-17T11:47:46.417 INFO:teuthology.orchestra.run.trial071.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 20 MB/s | 244 kB 00:00 2026-02-17T11:47:46.418 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:47:46.418 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:46.418 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:47:46.418 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:47:46.418 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:47:46.418 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:46.427 INFO:teuthology.orchestra.run.trial071.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 22 MB/s | 249 kB 00:00 2026-02-17T11:47:46.429 INFO:teuthology.orchestra.run.trial071.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 15 MB/s | 177 kB 00:00 2026-02-17T11:47:46.437 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:47:46.440 INFO:teuthology.orchestra.run.trial071.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 15 MB/s | 172 kB 00:00 2026-02-17T11:47:46.442 INFO:teuthology.orchestra.run.trial071.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 84 MB/s | 1.2 MB 00:00 2026-02-17T11:47:46.450 INFO:teuthology.orchestra.run.trial071.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 3.8 MB/s | 35 kB 00:00 2026-02-17T11:47:46.462 INFO:teuthology.orchestra.run.trial071.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 35 MB/s | 442 kB 00:00 2026-02-17T11:47:46.473 INFO:teuthology.orchestra.run.trial010.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 2.7 MB/s | 244 kB 00:00 2026-02-17T11:47:46.475 INFO:teuthology.orchestra.run.trial071.stdout:(45/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 186 MB/s | 6.1 MB 00:00 2026-02-17T11:47:46.476 INFO:teuthology.orchestra.run.trial071.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 5.5 MB/s | 77 kB 00:00 2026-02-17T11:47:46.491 INFO:teuthology.orchestra.run.trial071.stdout:(47/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 42 MB/s | 5.3 MB 00:00 2026-02-17T11:47:46.491 INFO:teuthology.orchestra.run.trial071.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 10 MB/s | 159 kB 00:00 2026-02-17T11:47:46.492 INFO:teuthology.orchestra.run.trial071.stdout:(49/99): python3-protobuf-3.14.0-17.el9.noarch. 16 MB/s | 267 kB 00:00 2026-02-17T11:47:46.501 INFO:teuthology.orchestra.run.trial071.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 5.6 MB/s | 54 kB 00:00 2026-02-17T11:47:46.502 INFO:teuthology.orchestra.run.trial071.stdout:(51/99): python3-pyasn1-modules-0.4.8-6.el9.noa 24 MB/s | 279 kB 00:00 2026-02-17T11:47:46.510 INFO:teuthology.orchestra.run.trial071.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 4.4 MB/s | 42 kB 00:00 2026-02-17T11:47:46.513 INFO:teuthology.orchestra.run.trial071.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 17 MB/s | 189 kB 00:00 2026-02-17T11:47:46.519 INFO:teuthology.orchestra.run.trial071.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 10 MB/s | 90 kB 00:00 2026-02-17T11:47:46.560 INFO:teuthology.orchestra.run.trial010.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.8 MB/s | 249 kB 00:00 2026-02-17T11:47:46.564 INFO:teuthology.orchestra.run.trial174.stdout:(22/99): python3-pycparser-2.20-6.el9.noarch.rp 803 kB/s | 135 kB 00:00 2026-02-17T11:47:46.578 INFO:teuthology.orchestra.run.trial071.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 223 MB/s | 19 MB 00:00 2026-02-17T11:47:46.647 INFO:teuthology.orchestra.run.trial010.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 2.0 MB/s | 177 kB 00:00 2026-02-17T11:47:46.694 INFO:teuthology.orchestra.run.trial071.stdout:(56/99): lua-devel-5.4.4-4.el9.x86_64.rpm 123 kB/s | 22 kB 00:00 2026-02-17T11:47:46.733 INFO:teuthology.orchestra.run.trial174.stdout:(23/99): python3-pyparsing-2.4.7-9.el9.noarch.r 893 kB/s | 150 kB 00:00 2026-02-17T11:47:46.741 INFO:teuthology.orchestra.run.trial010.stdout:(40/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2026-02-17T11:47:46.760 INFO:teuthology.orchestra.run.trial071.stdout:(57/99): protobuf-compiler-3.14.0-17.el9.x86_64 3.5 MB/s | 862 kB 00:00 2026-02-17T11:47:46.778 INFO:teuthology.orchestra.run.trial174.stdout:(24/99): libgfortran-11.5.0-14.el9.x86_64.rpm 815 kB/s | 794 kB 00:00 2026-02-17T11:47:46.811 INFO:teuthology.orchestra.run.trial010.stdout:(41/99): protobuf-3.14.0-17.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2026-02-17T11:47:46.827 INFO:teuthology.orchestra.run.trial010.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 172 kB 00:00 2026-02-17T11:47:46.898 INFO:teuthology.orchestra.run.trial010.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 400 kB/s | 35 kB 00:00 2026-02-17T11:47:46.902 INFO:teuthology.orchestra.run.trial174.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 750 kB/s | 126 kB 00:00 2026-02-17T11:47:46.905 INFO:teuthology.orchestra.run.trial010.stdout:(44/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 4.9 MB/s | 5.3 MB 00:01 2026-02-17T11:47:46.908 INFO:teuthology.orchestra.run.trial071.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 91 kB/s | 19 kB 00:00 2026-02-17T11:47:46.990 INFO:teuthology.orchestra.run.trial010.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 4.7 MB/s | 442 kB 00:00 2026-02-17T11:47:46.992 INFO:teuthology.orchestra.run.trial010.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 892 kB/s | 77 kB 00:00 2026-02-17T11:47:47.069 INFO:teuthology.orchestra.run.trial071.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-17T11:47:47.070 INFO:teuthology.orchestra.run.trial174.stdout:(26/99): unzip-6.0-59.el9.x86_64.rpm 1.1 MB/s | 182 kB 00:00 2026-02-17T11:47:47.079 INFO:teuthology.orchestra.run.trial010.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 2.9 MB/s | 267 kB 00:00 2026-02-17T11:47:47.106 INFO:teuthology.orchestra.run.trial174.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 664 kB/s | 218 kB 00:00 2026-02-17T11:47:47.118 INFO:teuthology.orchestra.run.trial071.stdout:(60/99): luarocks-3.9.2-5.el9.noarch.rpm 423 kB/s | 151 kB 00:00 2026-02-17T11:47:47.136 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:47:47.136 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T11:47:47.136 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T11:47:47.136 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T11:47:47.136 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T11:47:47.136 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T11:47:47.136 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T11:47:47.136 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T11:47:47.136 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:47:47.137 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:47:47.138 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:47:47.139 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:47:47.140 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:47:47.141 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:47:47.142 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:47:47.143 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:47:47.143 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:47:47.143 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:47:47.144 INFO:teuthology.orchestra.run.trial174.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 774 kB/s | 30 kB 00:00 2026-02-17T11:47:47.163 INFO:teuthology.orchestra.run.trial010.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 928 kB/s | 159 kB 00:00 2026-02-17T11:47:47.167 INFO:teuthology.orchestra.run.trial010.stdout:(49/99): python3-pyasn1-modules-0.4.8-6.el9.noa 3.1 MB/s | 279 kB 00:00 2026-02-17T11:47:47.200 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:47:47.200 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:47.200 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:47.200 INFO:teuthology.orchestra.run.trial153.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:47:47.200 INFO:teuthology.orchestra.run.trial153.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:47.200 INFO:teuthology.orchestra.run.trial153.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.200 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.201 INFO:teuthology.orchestra.run.trial153.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:47:47.202 INFO:teuthology.orchestra.run.trial153.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:47:47.203 INFO:teuthology.orchestra.run.trial153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:47:47.204 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:47:47.205 INFO:teuthology.orchestra.run.trial153.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:47:47.206 INFO:teuthology.orchestra.run.trial153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:47:47.207 INFO:teuthology.orchestra.run.trial153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:47:47.208 INFO:teuthology.orchestra.run.trial153.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:47:47.208 INFO:teuthology.orchestra.run.trial153.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:47:47.208 INFO:teuthology.orchestra.run.trial153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:47:47.208 INFO:teuthology.orchestra.run.trial153.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:47:47.208 INFO:teuthology.orchestra.run.trial153.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:47:47.208 INFO:teuthology.orchestra.run.trial153.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:47:47.208 INFO:teuthology.orchestra.run.trial153.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:47:47.208 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:47.208 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:47.209 INFO:teuthology.orchestra.run.trial174.stdout:(29/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 50 MB/s | 3.0 MB 00:00 2026-02-17T11:47:47.212 INFO:teuthology.orchestra.run.trial174.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 1.8 MB/s | 15 kB 00:00 2026-02-17T11:47:47.222 INFO:teuthology.orchestra.run.trial174.stdout:(31/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 24 MB/s | 246 kB 00:00 2026-02-17T11:47:47.233 INFO:teuthology.orchestra.run.trial174.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 19 MB/s | 188 kB 00:00 2026-02-17T11:47:47.241 INFO:teuthology.orchestra.run.trial174.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 5.0 MB/s | 42 kB 00:00 2026-02-17T11:47:47.254 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-base 2026-02-17T11:47:47.255 INFO:teuthology.orchestra.run.trial010.stdout:(50/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 14 MB/s | 6.1 MB 00:00 2026-02-17T11:47:47.255 INFO:teuthology.orchestra.run.trial010.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 593 kB/s | 54 kB 00:00 2026-02-17T11:47:47.267 INFO:teuthology.orchestra.run.trial174.stdout:(34/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 203 MB/s | 5.3 MB 00:00 2026-02-17T11:47:47.279 INFO:teuthology.orchestra.run.trial174.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 82 MB/s | 1.0 MB 00:00 2026-02-17T11:47:47.283 INFO:teuthology.orchestra.run.trial071.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 137 kB/s | 29 kB 00:00 2026-02-17T11:47:47.311 INFO:teuthology.orchestra.run.trial174.stdout:(36/99): python3-babel-2.9.1-2.el9.noarch.rpm 186 MB/s | 6.0 MB 00:00 2026-02-17T11:47:47.320 INFO:teuthology.orchestra.run.trial174.stdout:(37/99): zip-3.0-35.el9.x86_64.rpm 1.0 MB/s | 266 kB 00:00 2026-02-17T11:47:47.322 INFO:teuthology.orchestra.run.trial174.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 22 MB/s | 244 kB 00:00 2026-02-17T11:47:47.333 INFO:teuthology.orchestra.run.trial174.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 17 MB/s | 177 kB 00:00 2026-02-17T11:47:47.340 INFO:teuthology.orchestra.run.trial010.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 480 kB/s | 42 kB 00:00 2026-02-17T11:47:47.340 INFO:teuthology.orchestra.run.trial010.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.1 MB/s | 189 kB 00:00 2026-02-17T11:47:47.346 INFO:teuthology.orchestra.run.trial174.stdout:(40/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 91 MB/s | 1.2 MB 00:00 2026-02-17T11:47:47.357 INFO:teuthology.orchestra.run.trial174.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 16 MB/s | 172 kB 00:00 2026-02-17T11:47:47.366 INFO:teuthology.orchestra.run.trial174.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 3.9 MB/s | 35 kB 00:00 2026-02-17T11:47:47.368 INFO:teuthology.orchestra.run.trial174.stdout:(43/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 5.1 MB/s | 249 kB 00:00 2026-02-17T11:47:47.381 INFO:teuthology.orchestra.run.trial010.stdout:(54/99): lua-devel-5.4.4-4.el9.x86_64.rpm 562 kB/s | 22 kB 00:00 2026-02-17T11:47:47.388 INFO:teuthology.orchestra.run.trial174.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 21 MB/s | 442 kB 00:00 2026-02-17T11:47:47.398 INFO:teuthology.orchestra.run.trial071.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 214 kB/s | 60 kB 00:00 2026-02-17T11:47:47.399 INFO:teuthology.orchestra.run.trial174.stdout:(45/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 188 MB/s | 6.1 MB 00:00 2026-02-17T11:47:47.399 INFO:teuthology.orchestra.run.trial174.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 6.9 MB/s | 77 kB 00:00 2026-02-17T11:47:47.409 INFO:teuthology.orchestra.run.trial174.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 24 MB/s | 267 kB 00:00 2026-02-17T11:47:47.410 INFO:teuthology.orchestra.run.trial174.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 14 MB/s | 159 kB 00:00 2026-02-17T11:47:47.414 INFO:teuthology.orchestra.run.trial071.stdout:(63/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.1 MB/s | 548 kB 00:00 2026-02-17T11:47:47.415 INFO:teuthology.orchestra.run.trial010.stdout:(55/99): protobuf-compiler-3.14.0-17.el9.x86_64 24 MB/s | 862 kB 00:00 2026-02-17T11:47:47.419 INFO:teuthology.orchestra.run.trial174.stdout:(49/99): python3-requests-oauthlib-1.3.0-12.el9 5.7 MB/s | 54 kB 00:00 2026-02-17T11:47:47.420 INFO:teuthology.orchestra.run.trial174.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 25 MB/s | 279 kB 00:00 2026-02-17T11:47:47.426 INFO:teuthology.orchestra.run.trial010.stdout:(56/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.0 MB/s | 90 kB 00:00 2026-02-17T11:47:47.429 INFO:teuthology.orchestra.run.trial174.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 4.7 MB/s | 42 kB 00:00 2026-02-17T11:47:47.439 INFO:teuthology.orchestra.run.trial174.stdout:(52/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 20 MB/s | 189 kB 00:00 2026-02-17T11:47:47.448 INFO:teuthology.orchestra.run.trial174.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 9.8 MB/s | 90 kB 00:00 2026-02-17T11:47:47.486 INFO:teuthology.orchestra.run.trial010.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 327 kB/s | 19 kB 00:00 2026-02-17T11:47:47.499 INFO:teuthology.orchestra.run.trial071.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 202 kB/s | 43 kB 00:00 2026-02-17T11:47:47.521 INFO:teuthology.orchestra.run.trial174.stdout:(54/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 191 MB/s | 19 MB 00:00 2026-02-17T11:47:47.547 INFO:teuthology.orchestra.run.trial010.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 2.4 MB/s | 151 kB 00:00 2026-02-17T11:47:47.559 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:26 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:47.559 INFO:teuthology.orchestra.run.trial071.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 97 kB/s | 14 kB 00:00 2026-02-17T11:47:47.561 INFO:teuthology.orchestra.run.trial010.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.7 MB/s | 551 kB 00:00 2026-02-17T11:47:47.582 INFO:teuthology.orchestra.run.trial010.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 1.4 MB/s | 29 kB 00:00 2026-02-17T11:47:47.598 INFO:teuthology.orchestra.run.trial010.stdout:(61/99): python3-asyncssh-2.13.2-5.el9.noarch.r 11 MB/s | 548 kB 00:00 2026-02-17T11:47:47.603 INFO:teuthology.orchestra.run.trial010.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 2.8 MB/s | 60 kB 00:00 2026-02-17T11:47:47.609 INFO:teuthology.orchestra.run.trial071.stdout:(66/99): python3-cachetools-4.2.4-1.el9.noarch. 153 kB/s | 32 kB 00:00 2026-02-17T11:47:47.619 INFO:teuthology.orchestra.run.trial010.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.0 MB/s | 43 kB 00:00 2026-02-17T11:47:47.622 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:47.624 INFO:teuthology.orchestra.run.trial010.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 1.5 MB/s | 32 kB 00:00 2026-02-17T11:47:47.640 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:47.640 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:47.640 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:47.641 INFO:teuthology.orchestra.run.trial010.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 646 kB/s | 14 kB 00:00 2026-02-17T11:47:47.645 INFO:teuthology.orchestra.run.trial010.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 8.1 MB/s | 173 kB 00:00 2026-02-17T11:47:47.661 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install cephadm 2026-02-17T11:47:47.665 INFO:teuthology.orchestra.run.trial010.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 15 MB/s | 358 kB 00:00 2026-02-17T11:47:47.668 INFO:teuthology.orchestra.run.trial010.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 11 MB/s | 254 kB 00:00 2026-02-17T11:47:47.691 INFO:teuthology.orchestra.run.trial010.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 6.2 MB/s | 144 kB 00:00 2026-02-17T11:47:47.694 INFO:teuthology.orchestra.run.trial174.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 90 kB/s | 22 kB 00:00 2026-02-17T11:47:47.708 INFO:teuthology.orchestra.run.trial174.stdout:(56/99): python3-cryptography-36.0.1-5.el9.x86_ 827 kB/s | 1.2 MB 00:01 2026-02-17T11:47:47.713 INFO:teuthology.orchestra.run.trial010.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 6.0 MB/s | 139 kB 00:00 2026-02-17T11:47:47.716 INFO:teuthology.orchestra.run.trial010.stdout:(71/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 40 MB/s | 2.0 MB 00:00 2026-02-17T11:47:47.735 INFO:teuthology.orchestra.run.trial010.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 2.6 MB/s | 56 kB 00:00 2026-02-17T11:47:47.737 INFO:teuthology.orchestra.run.trial010.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 513 kB/s | 11 kB 00:00 2026-02-17T11:47:47.756 INFO:teuthology.orchestra.run.trial010.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 820 kB/s | 18 kB 00:00 2026-02-17T11:47:47.758 INFO:teuthology.orchestra.run.trial010.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-17T11:47:47.777 INFO:teuthology.orchestra.run.trial010.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 950 kB/s | 20 kB 00:00 2026-02-17T11:47:47.779 INFO:teuthology.orchestra.run.trial010.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 939 kB/s | 19 kB 00:00 2026-02-17T11:47:47.798 INFO:teuthology.orchestra.run.trial010.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 1.2 MB/s | 26 kB 00:00 2026-02-17T11:47:47.821 INFO:teuthology.orchestra.run.trial010.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 24 MB/s | 1.0 MB 00:00 2026-02-17T11:47:47.821 INFO:teuthology.orchestra.run.trial010.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 2.0 MB/s | 46 kB 00:00 2026-02-17T11:47:47.843 INFO:teuthology.orchestra.run.trial010.stdout:(81/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.8 MB/s | 86 kB 00:00 2026-02-17T11:47:47.843 INFO:teuthology.orchestra.run.trial010.stdout:(82/99): python3-more-itertools-8.12.0-2.el9.no 3.4 MB/s | 79 kB 00:00 2026-02-17T11:47:47.846 INFO:teuthology.orchestra.run.trial071.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 499 kB/s | 173 kB 00:00 2026-02-17T11:47:47.864 INFO:teuthology.orchestra.run.trial010.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 2.7 MB/s | 58 kB 00:00 2026-02-17T11:47:47.867 INFO:teuthology.orchestra.run.trial010.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2026-02-17T11:47:47.885 INFO:teuthology.orchestra.run.trial010.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 793 kB/s | 16 kB 00:00 2026-02-17T11:47:47.889 INFO:teuthology.orchestra.run.trial010.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.0 MB/s | 90 kB 00:00 2026-02-17T11:47:47.906 INFO:teuthology.orchestra.run.trial010.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 1.5 MB/s | 31 kB 00:00 2026-02-17T11:47:47.913 INFO:teuthology.orchestra.run.trial010.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 7.6 MB/s | 188 kB 00:00 2026-02-17T11:47:47.928 INFO:teuthology.orchestra.run.trial010.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 2.7 MB/s | 59 kB 00:00 2026-02-17T11:47:47.936 INFO:teuthology.orchestra.run.trial010.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 5.4 MB/s | 125 kB 00:00 2026-02-17T11:47:47.949 INFO:teuthology.orchestra.run.trial010.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 1.7 MB/s | 36 kB 00:00 2026-02-17T11:47:47.958 INFO:teuthology.orchestra.run.trial010.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 3.8 MB/s | 86 kB 00:00 2026-02-17T11:47:47.966 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:26 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:47.971 INFO:teuthology.orchestra.run.trial010.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 9.9 MB/s | 230 kB 00:00 2026-02-17T11:47:47.975 INFO:teuthology.orchestra.run.trial071.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 862 kB/s | 358 kB 00:00 2026-02-17T11:47:47.980 INFO:teuthology.orchestra.run.trial010.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 4.0 MB/s | 90 kB 00:00 2026-02-17T11:47:48.000 INFO:teuthology.orchestra.run.trial010.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 15 MB/s | 427 kB 00:00 2026-02-17T11:47:48.002 INFO:teuthology.orchestra.run.trial010.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.2 MB/s | 48 kB 00:00 2026-02-17T11:47:48.021 INFO:teuthology.orchestra.run.trial010.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 1.0 MB/s | 22 kB 00:00 2026-02-17T11:47:48.024 INFO:teuthology.orchestra.run.trial010.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 920 kB/s | 20 kB 00:00 2026-02-17T11:47:48.029 INFO:teuthology.orchestra.run.trial153.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:47:48.043 INFO:teuthology.orchestra.run.trial071.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 586 kB/s | 254 kB 00:00 2026-02-17T11:47:48.047 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:48.047 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:48.047 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:48.068 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:47:48.122 INFO:teuthology.orchestra.run.trial174.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 47 kB/s | 19 kB 00:00 2026-02-17T11:47:48.333 INFO:teuthology.orchestra.run.trial071.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 404 kB/s | 144 kB 00:00 2026-02-17T11:47:48.366 INFO:teuthology.orchestra.run.trial174.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 620 kB/s | 151 kB 00:00 2026-02-17T11:47:48.372 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:48.393 INFO:teuthology.orchestra.run.trial071.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 397 kB/s | 139 kB 00:00 2026-02-17T11:47:48.454 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:48.454 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 145 k 2026-02-17T11:47:48.455 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 431 k 2026-02-17T11:47:48.456 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:48.490 INFO:teuthology.orchestra.run.trial071.stdout:(72/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.2 MB/s | 2.0 MB 00:00 2026-02-17T11:47:48.534 INFO:teuthology.orchestra.run.trial071.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 76 kB/s | 11 kB 00:00 2026-02-17T11:47:48.539 INFO:teuthology.orchestra.run.trial153.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.7 MB/s | 145 kB 00:00 2026-02-17T11:47:48.540 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:48.540 INFO:teuthology.orchestra.run.trial153.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T11:47:48.540 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:48.543 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:48.544 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:48.574 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:48.575 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:48.594 INFO:teuthology.orchestra.run.trial174.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 613 kB/s | 551 kB 00:00 2026-02-17T11:47:48.614 INFO:teuthology.orchestra.run.trial071.stdout:(74/99): python3-isodate-0.6.1-3.el9.noarch.rpm 200 kB/s | 56 kB 00:00 2026-02-17T11:47:48.629 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:48.631 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:48.654 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:48.654 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:48.654 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:47:48.654 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:48.656 INFO:teuthology.orchestra.run.trial174.stdout:(60/99): protobuf-compiler-3.14.0-17.el9.x86_64 759 kB/s | 862 kB 00:01 2026-02-17T11:47:48.678 INFO:teuthology.orchestra.run.trial174.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 353 kB/s | 29 kB 00:00 2026-02-17T11:47:48.705 INFO:teuthology.orchestra.run.trial071.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 82 kB/s | 18 kB 00:00 2026-02-17T11:47:48.745 INFO:teuthology.orchestra.run.trial071.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 110 kB/s | 23 kB 00:00 2026-02-17T11:47:48.760 INFO:teuthology.orchestra.run.trial174.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 529 kB/s | 43 kB 00:00 2026-02-17T11:47:48.823 INFO:teuthology.orchestra.run.trial071.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 94 kB/s | 20 kB 00:00 2026-02-17T11:47:48.843 INFO:teuthology.orchestra.run.trial174.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 392 kB/s | 32 kB 00:00 2026-02-17T11:47:48.853 INFO:teuthology.orchestra.run.trial174.stdout:(64/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.1 MB/s | 548 kB 00:00 2026-02-17T11:47:48.913 INFO:teuthology.orchestra.run.trial071.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 93 kB/s | 19 kB 00:00 2026-02-17T11:47:48.925 INFO:teuthology.orchestra.run.trial174.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 172 kB/s | 14 kB 00:00 2026-02-17T11:47:48.936 INFO:teuthology.orchestra.run.trial174.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.0 MB/s | 173 kB 00:00 2026-02-17T11:47:48.955 INFO:teuthology.orchestra.run.trial071.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 126 kB/s | 26 kB 00:00 2026-02-17T11:47:48.956 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:48.956 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:48.957 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:48.957 INFO:teuthology.orchestra.run.trial153.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:48.957 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:48.957 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:48.984 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr 2026-02-17T11:47:49.019 INFO:teuthology.orchestra.run.trial174.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 3.0 MB/s | 254 kB 00:00 2026-02-17T11:47:49.089 INFO:teuthology.orchestra.run.trial174.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 2.1 MB/s | 358 kB 00:00 2026-02-17T11:47:49.148 INFO:teuthology.orchestra.run.trial174.stdout:(69/99): python3-backports-tarfile-1.2.0-1.el9. 122 kB/s | 60 kB 00:00 2026-02-17T11:47:49.172 INFO:teuthology.orchestra.run.trial174.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 1.7 MB/s | 144 kB 00:00 2026-02-17T11:47:49.190 INFO:teuthology.orchestra.run.trial071.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 167 kB/s | 46 kB 00:00 2026-02-17T11:47:49.235 INFO:teuthology.orchestra.run.trial071.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 281 kB/s | 79 kB 00:00 2026-02-17T11:47:49.254 INFO:teuthology.orchestra.run.trial174.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 682 kB/s | 56 kB 00:00 2026-02-17T11:47:49.267 INFO:teuthology.orchestra.run.trial174.stdout:(72/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.2 MB/s | 2.0 MB 00:00 2026-02-17T11:47:49.299 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:49.335 INFO:teuthology.orchestra.run.trial174.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 131 kB/s | 11 kB 00:00 2026-02-17T11:47:49.349 INFO:teuthology.orchestra.run.trial174.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 216 kB/s | 18 kB 00:00 2026-02-17T11:47:49.363 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:49.380 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:49.381 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:49.381 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:49.381 INFO:teuthology.orchestra.run.trial071.stdout:(82/99): python3-kubernetes-26.1.0-3.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2026-02-17T11:47:49.392 INFO:teuthology.orchestra.run.trial174.stdout:(75/99): python3-influxdb-5.3.1-1.el9.noarch.rp 570 kB/s | 139 kB 00:00 2026-02-17T11:47:49.402 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:47:49.417 INFO:teuthology.orchestra.run.trial174.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 283 kB/s | 23 kB 00:00 2026-02-17T11:47:49.431 INFO:teuthology.orchestra.run.trial174.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 240 kB/s | 20 kB 00:00 2026-02-17T11:47:49.474 INFO:teuthology.orchestra.run.trial174.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 236 kB/s | 19 kB 00:00 2026-02-17T11:47:49.477 INFO:teuthology.orchestra.run.trial071.stdout:(83/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 301 kB/s | 86 kB 00:00 2026-02-17T11:47:49.500 INFO:teuthology.orchestra.run.trial174.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 322 kB/s | 26 kB 00:00 2026-02-17T11:47:49.513 INFO:teuthology.orchestra.run.trial071.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 208 kB/s | 58 kB 00:00 2026-02-17T11:47:49.518 INFO:teuthology.orchestra.run.trial174.stdout:(80/99): python3-kubernetes-26.1.0-3.el9.noarch 12 MB/s | 1.0 MB 00:00 2026-02-17T11:47:49.557 INFO:teuthology.orchestra.run.trial174.stdout:(81/99): python3-logutils-0.3.5-21.el9.noarch.r 566 kB/s | 46 kB 00:00 2026-02-17T11:47:49.582 INFO:teuthology.orchestra.run.trial174.stdout:(82/99): python3-more-itertools-8.12.0-2.el9.no 955 kB/s | 79 kB 00:00 2026-02-17T11:47:49.600 INFO:teuthology.orchestra.run.trial174.stdout:(83/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2026-02-17T11:47:49.639 INFO:teuthology.orchestra.run.trial174.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 705 kB/s | 58 kB 00:00 2026-02-17T11:47:49.666 INFO:teuthology.orchestra.run.trial174.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2026-02-17T11:47:49.683 INFO:teuthology.orchestra.run.trial174.stdout:(86/99): python3-portend-3.1.0-2.el9.noarch.rpm 199 kB/s | 16 kB 00:00 2026-02-17T11:47:49.691 INFO:teuthology.orchestra.run.trial071.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 77 kB/s | 16 kB 00:00 2026-02-17T11:47:49.714 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:49.748 INFO:teuthology.orchestra.run.trial174.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 372 kB/s | 31 kB 00:00 2026-02-17T11:47:49.766 INFO:teuthology.orchestra.run.trial174.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2026-02-17T11:47:49.778 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:47:49.795 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:49.796 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:49.796 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:49.801 INFO:teuthology.orchestra.run.trial174.stdout:(89/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 552 kB/s | 90 kB 00:00 2026-02-17T11:47:49.802 INFO:teuthology.orchestra.run.trial071.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 311 kB/s | 90 kB 00:00 2026-02-17T11:47:49.815 INFO:teuthology.orchestra.run.trial071.stdout:(87/99): python3-pecan-1.4.2-3.el9.noarch.rpm 628 kB/s | 272 kB 00:00 2026-02-17T11:47:49.817 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:47:49.831 INFO:teuthology.orchestra.run.trial174.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 717 kB/s | 59 kB 00:00 2026-02-17T11:47:49.848 INFO:teuthology.orchestra.run.trial174.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.5 MB/s | 125 kB 00:00 2026-02-17T11:47:49.883 INFO:teuthology.orchestra.run.trial174.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 437 kB/s | 36 kB 00:00 2026-02-17T11:47:49.909 INFO:teuthology.orchestra.run.trial071.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 141 kB/s | 31 kB 00:00 2026-02-17T11:47:49.914 INFO:teuthology.orchestra.run.trial174.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 1.0 MB/s | 86 kB 00:00 2026-02-17T11:47:49.931 INFO:teuthology.orchestra.run.trial174.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2026-02-17T11:47:49.998 INFO:teuthology.orchestra.run.trial174.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.9 MB/s | 427 kB 00:00 2026-02-17T11:47:50.014 INFO:teuthology.orchestra.run.trial174.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 588 kB/s | 48 kB 00:00 2026-02-17T11:47:50.046 INFO:teuthology.orchestra.run.trial174.stdout:(97/99): python3-websocket-client-1.2.3-2.el9.n 551 kB/s | 90 kB 00:00 2026-02-17T11:47:50.082 INFO:teuthology.orchestra.run.trial174.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 266 kB/s | 22 kB 00:00 2026-02-17T11:47:50.095 INFO:teuthology.orchestra.run.trial174.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 244 kB/s | 20 kB 00:00 2026-02-17T11:47:50.100 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:50.100 INFO:teuthology.orchestra.run.trial174.stdout:Total 16 MB/s | 95 MB 00:05 2026-02-17T11:47:50.104 INFO:teuthology.orchestra.run.trial071.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 204 kB/s | 59 kB 00:00 2026-02-17T11:47:50.123 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:50.161 INFO:teuthology.orchestra.run.trial071.stdout:(90/99): python3-routes-2.5.1-5.el9.noarch.rpm 526 kB/s | 188 kB 00:00 2026-02-17T11:47:50.187 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:47:50.204 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:50.205 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:50.205 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:50.226 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:47:50.256 INFO:teuthology.orchestra.run.trial071.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 360 kB/s | 125 kB 00:00 2026-02-17T11:47:50.315 INFO:teuthology.orchestra.run.trial071.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 170 kB/s | 36 kB 00:00 2026-02-17T11:47:50.450 INFO:teuthology.orchestra.run.trial071.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 299 kB/s | 86 kB 00:00 2026-02-17T11:47:50.528 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:47:50.529 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:50.566 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:47:50.566 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:47:50.592 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:47:50.596 INFO:teuthology.orchestra.run.trial071.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 319 kB/s | 90 kB 00:00 2026-02-17T11:47:50.609 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:50.610 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:50.610 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:50.631 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:47:50.685 INFO:teuthology.orchestra.run.trial071.stdout:(95/99): python3-webob-1.8.8-2.el9.noarch.rpm 537 kB/s | 230 kB 00:00 2026-02-17T11:47:50.790 INFO:teuthology.orchestra.run.trial010.stdout:(99/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 5.3 MB/s | 19 MB 00:03 2026-02-17T11:47:50.794 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:50.794 INFO:teuthology.orchestra.run.trial010.stdout:Total 11 MB/s | 95 MB 00:09 2026-02-17T11:47:50.883 INFO:teuthology.orchestra.run.trial071.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 169 kB/s | 48 kB 00:00 2026-02-17T11:47:50.885 INFO:teuthology.orchestra.run.trial071.stdout:(97/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 983 kB/s | 427 kB 00:00 2026-02-17T11:47:50.893 INFO:teuthology.orchestra.run.trial071.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 106 kB/s | 22 kB 00:00 2026-02-17T11:47:50.939 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:50.981 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:47:50.982 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:47:51.003 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:47:51.020 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:51.021 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:51.021 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:51.042 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-fuse 2026-02-17T11:47:51.091 INFO:teuthology.orchestra.run.trial071.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 96 kB/s | 20 kB 00:00 2026-02-17T11:47:51.096 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:51.096 INFO:teuthology.orchestra.run.trial071.stdout:Total 16 MB/s | 95 MB 00:05 2026-02-17T11:47:51.218 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:47:51.255 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:47:51.255 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:47:51.348 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:51.426 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:47:51.428 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:47:51.429 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 1.2 M 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 3.6 M 2026-02-17T11:47:51.430 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:51.459 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:47:51.464 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:47:51.485 INFO:teuthology.orchestra.run.trial174.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:47:51.491 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:47:51.524 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:47:51.526 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:47:51.535 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:47:51.541 INFO:teuthology.orchestra.run.trial174.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:47:51.543 INFO:teuthology.orchestra.run.trial174.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:47:51.548 INFO:teuthology.orchestra.run.trial153.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T11:47:51.548 INFO:teuthology.orchestra.run.trial174.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:47:51.548 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:51.548 INFO:teuthology.orchestra.run.trial153.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T11:47:51.548 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:51.552 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:51.552 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:51.563 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:47:51.563 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:47:51.571 INFO:teuthology.orchestra.run.trial174.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:47:51.584 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:47:51.586 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:51.586 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:51.586 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:47:51.592 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:47:51.594 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:47:51.606 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:47:51.612 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:47:51.636 INFO:teuthology.orchestra.run.trial174.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:47:51.639 INFO:teuthology.orchestra.run.trial174.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:47:51.647 INFO:teuthology.orchestra.run.trial174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:47:51.671 INFO:teuthology.orchestra.run.trial174.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:47:51.672 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:47:51.672 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:47:51.686 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:51.703 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:51.723 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:47:51.736 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:47:51.738 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:47:51.743 INFO:teuthology.orchestra.run.trial174.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:47:51.748 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:47:51.753 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:47:51.756 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:47:51.771 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:47:51.792 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:47:51.797 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:47:51.802 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:47:51.813 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:47:51.823 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:47:51.829 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:47:51.849 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:47:51.858 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:47:51.912 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:47:51.925 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:47:51.940 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:47:51.942 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:51.945 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:47:51.953 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:47:51.978 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:47:51.978 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:47:51.993 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:47:52.000 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:52.000 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:52.000 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:52.000 INFO:teuthology.orchestra.run.trial153.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:52.000 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:52.000 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:52.028 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-volume 2026-02-17T11:47:52.120 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:47:52.122 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:47:52.153 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:47:52.158 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:47:52.180 INFO:teuthology.orchestra.run.trial010.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:47:52.186 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:47:52.219 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:47:52.229 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:47:52.234 INFO:teuthology.orchestra.run.trial010.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:47:52.236 INFO:teuthology.orchestra.run.trial010.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:47:52.241 INFO:teuthology.orchestra.run.trial010.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:47:52.264 INFO:teuthology.orchestra.run.trial010.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:47:52.276 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:47:52.279 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:47:52.285 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:47:52.287 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:47:52.298 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:47:52.304 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:47:52.322 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:47:52.328 INFO:teuthology.orchestra.run.trial010.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:47:52.331 INFO:teuthology.orchestra.run.trial010.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:47:52.333 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:47:52.337 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:47:52.339 INFO:teuthology.orchestra.run.trial010.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:47:52.341 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:52.344 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:47:52.346 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:47:52.363 INFO:teuthology.orchestra.run.trial010.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:47:52.374 INFO:teuthology.orchestra.run.trial174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:47:52.404 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:47:52.414 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:47:52.418 INFO:teuthology.orchestra.run.trial174.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:47:52.422 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:52.422 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:52.423 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:52.424 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:47:52.427 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:47:52.428 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:47:52.428 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:47:52.429 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:47:52.430 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:47:52.433 INFO:teuthology.orchestra.run.trial010.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:47:52.434 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:47:52.437 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:47:52.439 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:47:52.443 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install librados-devel 2026-02-17T11:47:52.444 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:47:52.444 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:47:52.447 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:47:52.448 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:47:52.461 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:47:52.461 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:47:52.466 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:47:52.476 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:47:52.482 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:47:52.486 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:47:52.487 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:47:52.487 INFO:teuthology.orchestra.run.trial071.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:47:52.492 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:47:52.493 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:47:52.503 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:47:52.512 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:47:52.519 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:47:52.521 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:47:52.526 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:47:52.536 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:47:52.538 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:47:52.542 INFO:teuthology.orchestra.run.trial071.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:47:52.544 INFO:teuthology.orchestra.run.trial071.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:47:52.547 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:47:52.549 INFO:teuthology.orchestra.run.trial071.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:47:52.572 INFO:teuthology.orchestra.run.trial071.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:47:52.585 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:47:52.588 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:47:52.594 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:47:52.596 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:47:52.602 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:47:52.608 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:47:52.614 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:47:52.614 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:47:52.629 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:47:52.634 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:47:52.638 INFO:teuthology.orchestra.run.trial071.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:47:52.641 INFO:teuthology.orchestra.run.trial071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:47:52.642 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:47:52.649 INFO:teuthology.orchestra.run.trial071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:47:52.673 INFO:teuthology.orchestra.run.trial071.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:47:52.681 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:47:52.725 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:47:52.738 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:47:52.741 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:47:52.745 INFO:teuthology.orchestra.run.trial071.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:47:52.747 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:52.747 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:47:52.751 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:47:52.755 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:47:52.759 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:47:52.771 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:47:52.773 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:47:52.775 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:47:52.795 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:47:52.799 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:47:52.804 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:47:52.816 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:47:52.825 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:47:52.828 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:52.829 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:52.829 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:47:52.829 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:52.829 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:52.829 INFO:teuthology.orchestra.run.trial153.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T11:47:52.829 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:52.830 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:52.830 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:52.830 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:47:52.830 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:52.830 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 127 k 2026-02-17T11:47:52.830 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 456 k 2026-02-17T11:47:52.830 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:52.831 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:47:52.833 INFO:teuthology.orchestra.run.trial174.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:47:52.836 INFO:teuthology.orchestra.run.trial174.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:47:52.851 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:47:52.856 INFO:teuthology.orchestra.run.trial174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:47:52.860 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:47:52.914 INFO:teuthology.orchestra.run.trial153.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.5 MB/s | 127 kB 00:00 2026-02-17T11:47:52.915 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:52.915 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:47:52.916 INFO:teuthology.orchestra.run.trial153.stdout:Total 1.4 MB/s | 127 kB 00:00 2026-02-17T11:47:52.916 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:52.918 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:52.918 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:52.927 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:47:52.943 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:47:52.948 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:47:52.948 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:52.949 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:52.956 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:47:52.996 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:47:53.003 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:53.008 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:47:53.018 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:47:53.020 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:53.022 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:47:53.028 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:47:53.030 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:47:53.057 INFO:teuthology.orchestra.run.trial010.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:47:53.099 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:53.101 INFO:teuthology.orchestra.run.trial010.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:47:53.107 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:47:53.111 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:47:53.117 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:47:53.120 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:47:53.127 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:47:53.130 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:47:53.156 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:53.156 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:53.156 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:53.156 INFO:teuthology.orchestra.run.trial153.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:53.156 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:53.156 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:53.159 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:47:53.168 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:47:53.185 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install libcephfs2 2026-02-17T11:47:53.186 INFO:teuthology.orchestra.run.trial174.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:47:53.203 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:47:53.261 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:47:53.326 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:47:53.336 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:47:53.340 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:47:53.346 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:47:53.348 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:47:53.376 INFO:teuthology.orchestra.run.trial071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:47:53.419 INFO:teuthology.orchestra.run.trial071.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:47:53.426 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:47:53.426 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:47:53.430 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:47:53.436 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:47:53.439 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:47:53.446 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:47:53.450 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:47:53.450 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:47:53.454 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:47:53.478 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:47:53.488 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:47:53.493 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:53.514 INFO:teuthology.orchestra.run.trial010.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:47:53.516 INFO:teuthology.orchestra.run.trial010.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:47:53.523 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:47:53.537 INFO:teuthology.orchestra.run.trial010.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:47:53.556 INFO:teuthology.orchestra.run.trial153.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:53.574 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:53.574 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:53.574 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:53.595 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install libcephfs-devel 2026-02-17T11:47:53.751 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:47:53.775 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:47:53.779 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:47:53.838 INFO:teuthology.orchestra.run.trial071.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:47:53.840 INFO:teuthology.orchestra.run.trial071.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:47:53.860 INFO:teuthology.orchestra.run.trial071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:47:53.863 INFO:teuthology.orchestra.run.trial010.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:47:53.903 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:53.931 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:47:53.936 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:47:53.949 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:47:53.959 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:47:53.966 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:47:53.979 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:47:53.984 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:53.985 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:53.985 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:47:53.985 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:53.985 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:53.985 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T11:47:53.985 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:53.985 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:53.986 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:53.986 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:47:53.986 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:53.986 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 34 k 2026-02-17T11:47:53.986 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 153 k 2026-02-17T11:47:53.986 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:53.994 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:47:54.048 INFO:teuthology.orchestra.run.trial153.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 537 kB/s | 34 kB 00:00 2026-02-17T11:47:54.048 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:54.048 INFO:teuthology.orchestra.run.trial153.stdout:Total 531 kB/s | 34 kB 00:00 2026-02-17T11:47:54.048 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:54.050 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:54.050 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:54.052 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:54.052 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:54.070 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:47:54.074 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:54.078 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:47:54.090 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:54.102 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:47:54.132 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:47:54.145 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:54.182 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:47:54.188 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:47:54.190 INFO:teuthology.orchestra.run.trial071.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:47:54.192 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:47:54.193 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:47:54.201 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:54.201 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:54.201 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:54.201 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:54.201 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:54.201 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:54.212 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:54.212 INFO:teuthology.orchestra.run.trial174.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:47:54.212 INFO:teuthology.orchestra.run.trial174.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:47:54.212 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:54.219 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:54.229 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install librados2 2026-02-17T11:47:54.245 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:54.245 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:47:54.246 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:54.264 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:47:54.280 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:47:54.344 INFO:teuthology.orchestra.run.trial174.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:47:54.346 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:47:54.362 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:47:54.362 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:54.362 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:47:54.362 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:54.535 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:54.601 INFO:teuthology.orchestra.run.trial153.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:54.607 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:47:54.618 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:54.619 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:54.619 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:54.624 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:47:54.634 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:47:54.640 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install librbd1 2026-02-17T11:47:54.641 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:47:54.654 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:47:54.669 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:47:54.745 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:47:54.753 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:47:54.777 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:47:54.806 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:47:54.857 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:47:54.863 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:47:54.867 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:47:54.868 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:47:54.885 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:54.886 INFO:teuthology.orchestra.run.trial010.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:47:54.886 INFO:teuthology.orchestra.run.trial010.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:47:54.886 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:54.893 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:54.917 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:54.917 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:47:54.918 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:54.945 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:47:54.945 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:54.951 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:47:54.963 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:47:54.973 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:47:54.979 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:47:54.993 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:47:55.009 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:47:55.009 INFO:teuthology.orchestra.run.trial153.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:55.016 INFO:teuthology.orchestra.run.trial010.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:47:55.018 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:47:55.026 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:55.027 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:55.027 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:55.032 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:47:55.032 INFO:teuthology.orchestra.run.trial010.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:55.032 INFO:teuthology.orchestra.run.trial010.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:47:55.032 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:55.048 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-rados 2026-02-17T11:47:55.061 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:47:55.085 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:47:55.087 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:47:55.087 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:55.087 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:47:55.087 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:47:55.088 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:47:55.088 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:55.094 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:47:55.118 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:47:55.143 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:47:55.145 INFO:teuthology.orchestra.run.trial174.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:47:55.148 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:47:55.150 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T11:47:55.169 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T11:47:55.171 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:47:55.199 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:47:55.206 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:47:55.211 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:47:55.212 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:47:55.230 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:55.230 INFO:teuthology.orchestra.run.trial071.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:47:55.230 INFO:teuthology.orchestra.run.trial071.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:47:55.230 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:55.237 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:55.262 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:47:55.262 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:47:55.262 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:55.296 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:47:55.358 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:55.361 INFO:teuthology.orchestra.run.trial071.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:47:55.363 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:47:55.376 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:47:55.376 INFO:teuthology.orchestra.run.trial071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:55.376 INFO:teuthology.orchestra.run.trial071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:47:55.376 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:55.421 INFO:teuthology.orchestra.run.trial153.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:55.439 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:55.439 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:55.440 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:55.461 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-rgw 2026-02-17T11:47:55.662 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:47:55.665 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:47:55.741 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:47:55.766 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:47:55.766 INFO:teuthology.orchestra.run.trial010.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:55.766 INFO:teuthology.orchestra.run.trial010.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:47:55.766 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:47:55.784 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:47:55.784 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:55.785 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:55.819 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:47:55.821 INFO:teuthology.orchestra.run.trial010.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:47:55.826 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T11:47:55.834 INFO:teuthology.orchestra.run.trial153.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:55.845 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T11:47:55.846 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:47:55.852 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:55.852 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:55.852 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:55.873 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-cephfs 2026-02-17T11:47:56.075 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:47:56.100 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:47:56.101 INFO:teuthology.orchestra.run.trial071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:56.101 INFO:teuthology.orchestra.run.trial071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:47:56.101 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:47:56.101 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:47:56.101 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:56.119 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:47:56.120 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:47:56.132 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:47:56.133 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:47:56.154 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:47:56.156 INFO:teuthology.orchestra.run.trial071.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:47:56.161 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T11:47:56.181 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T11:47:56.182 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:47:56.191 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:47:56.197 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:56.241 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T11:47:56.241 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:47:56.262 INFO:teuthology.orchestra.run.trial153.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:56.264 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:47:56.265 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:56.265 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:47:56.265 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:47:56.265 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:47:56.265 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:56.278 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:47:56.279 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:56.279 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:56.280 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:56.302 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-rbd 2026-02-17T11:47:56.338 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:47:56.341 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:47:56.494 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:47:56.496 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:47:56.519 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:47:56.519 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:56.519 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:47:56.519 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:47:56.519 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:47:56.519 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:56.612 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:56.620 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:47:56.643 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:47:56.643 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:56.643 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:47:56.643 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:47:56.643 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:47:56.643 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:56.661 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:47:56.675 INFO:teuthology.orchestra.run.trial153.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:56.677 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:47:56.681 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:47:56.692 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:56.693 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:47:56.693 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:56.714 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install rbd-fuse 2026-02-17T11:47:56.797 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:47:56.798 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:47:56.810 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:47:56.811 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:47:56.868 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:47:56.919 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T11:47:56.920 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:47:56.941 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:47:56.941 INFO:teuthology.orchestra.run.trial010.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:56.941 INFO:teuthology.orchestra.run.trial010.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:47:56.941 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:47:56.942 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:47:56.942 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:56.952 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:47:57.018 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:47:57.100 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:57.101 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 85 k 2026-02-17T11:47:57.101 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 227 k 2026-02-17T11:47:57.101 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:57.134 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:47:57.135 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:47:57.149 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:47:57.149 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:47:57.172 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:47:57.173 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:47:57.174 INFO:teuthology.orchestra.run.trial153.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T11:47:57.174 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:57.174 INFO:teuthology.orchestra.run.trial153.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T11:47:57.174 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:57.178 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:57.178 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:57.194 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:47:57.194 INFO:teuthology.orchestra.run.trial010.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:57.194 INFO:teuthology.orchestra.run.trial010.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:47:57.194 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:47:57.194 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:47:57.194 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:57.206 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:47:57.209 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:57.209 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:57.257 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T11:47:57.258 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:47:57.260 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:57.277 INFO:teuthology.orchestra.run.trial153.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:57.280 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:47:57.280 INFO:teuthology.orchestra.run.trial071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:57.280 INFO:teuthology.orchestra.run.trial071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:47:57.280 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:47:57.280 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:47:57.280 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:57.292 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:47:57.298 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T11:47:57.310 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:47:57.311 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:47:57.312 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:47:57.313 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:47:57.314 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:47:57.318 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:47:57.318 INFO:teuthology.orchestra.run.trial010.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:57.318 INFO:teuthology.orchestra.run.trial010.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:47:57.319 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:47:57.319 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:47:57.319 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:57.337 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:47:57.353 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:57.379 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:47:57.379 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:57.379 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:47:57.379 INFO:teuthology.orchestra.run.trial174.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:47:57.379 INFO:teuthology.orchestra.run.trial174.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:57.379 INFO:teuthology.orchestra.run.trial174.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.379 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:57.379 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:57.380 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.380 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.380 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.380 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.380 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.380 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.380 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:57.380 INFO:teuthology.orchestra.run.trial174.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:57.380 INFO:teuthology.orchestra.run.trial174.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.381 INFO:teuthology.orchestra.run.trial174.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.381 INFO:teuthology.orchestra.run.trial174.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:57.381 INFO:teuthology.orchestra.run.trial174.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:47:57.381 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:47:57.381 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:47:57.381 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:47:57.381 INFO:teuthology.orchestra.run.trial174.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:47:57.381 INFO:teuthology.orchestra.run.trial174.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:47:57.381 INFO:teuthology.orchestra.run.trial174.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:47:57.382 INFO:teuthology.orchestra.run.trial174.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:47:57.382 INFO:teuthology.orchestra.run.trial174.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:47:57.382 INFO:teuthology.orchestra.run.trial174.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:47:57.382 INFO:teuthology.orchestra.run.trial174.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:47:57.382 INFO:teuthology.orchestra.run.trial174.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:47:57.382 INFO:teuthology.orchestra.run.trial174.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:47:57.382 INFO:teuthology.orchestra.run.trial174.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:47:57.382 INFO:teuthology.orchestra.run.trial174.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:47:57.383 INFO:teuthology.orchestra.run.trial174.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:47:57.383 INFO:teuthology.orchestra.run.trial174.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:47:57.383 INFO:teuthology.orchestra.run.trial174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:47:57.383 INFO:teuthology.orchestra.run.trial174.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:47:57.383 INFO:teuthology.orchestra.run.trial174.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:47:57.383 INFO:teuthology.orchestra.run.trial174.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:47:57.384 INFO:teuthology.orchestra.run.trial174.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:47:57.385 INFO:teuthology.orchestra.run.trial174.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:47:57.386 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:47:57.387 INFO:teuthology.orchestra.run.trial174.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:47:57.388 INFO:teuthology.orchestra.run.trial174.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:47:57.389 INFO:teuthology.orchestra.run.trial174.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:47:57.389 INFO:teuthology.orchestra.run.trial174.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:47:57.389 INFO:teuthology.orchestra.run.trial174.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:47:57.389 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:57.389 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:47:57.411 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:57.411 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:57.411 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:57.411 INFO:teuthology.orchestra.run.trial153.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:57.411 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:57.412 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:57.433 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-base 2026-02-17T11:47:57.439 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install rbd-mirror 2026-02-17T11:47:57.512 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:47:57.513 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:47:57.534 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:47:57.534 INFO:teuthology.orchestra.run.trial071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:57.534 INFO:teuthology.orchestra.run.trial071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:47:57.534 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:47:57.534 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:47:57.534 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:57.636 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:47:57.658 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:47:57.658 INFO:teuthology.orchestra.run.trial071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:57.658 INFO:teuthology.orchestra.run.trial071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:47:57.658 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:47:57.658 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:47:57.658 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:57.677 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:47:57.738 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:57.759 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:57.802 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:57.820 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:47:57.820 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:47:57.820 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:47:57.840 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install cephadm 2026-02-17T11:47:57.841 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:57.841 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:57.841 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:47:57.841 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:57.841 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:57.841 INFO:teuthology.orchestra.run.trial153.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T11:47:57.842 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:57.842 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:57.842 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:57.842 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:47:57.842 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:57.842 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 3.1 M 2026-02-17T11:47:57.842 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 13 M 2026-02-17T11:47:57.842 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:57.986 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:47:57.986 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:47:57.987 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:47:57.988 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:47:57.988 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:47:57.988 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:47:57.992 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:47:57.992 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:47:57.992 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:47:57.992 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:47:57.992 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:47:57.992 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:47:57.992 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:47:57.992 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:47:57.992 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:47:57.993 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:47:57.994 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:47:57.995 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:47:57.996 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:47:57.997 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:47:57.998 INFO:teuthology.orchestra.run.trial153.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T11:47:57.998 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:57.998 INFO:teuthology.orchestra.run.trial153.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T11:47:57.998 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:57.998 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:57.998 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:58.034 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:58.034 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:58.057 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:47:58.057 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:58.057 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:47:58.057 INFO:teuthology.orchestra.run.trial010.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:47:58.057 INFO:teuthology.orchestra.run.trial010.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.057 INFO:teuthology.orchestra.run.trial010.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.057 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.058 INFO:teuthology.orchestra.run.trial010.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:47:58.059 INFO:teuthology.orchestra.run.trial010.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:47:58.060 INFO:teuthology.orchestra.run.trial010.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:47:58.061 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:47:58.062 INFO:teuthology.orchestra.run.trial010.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:47:58.063 INFO:teuthology.orchestra.run.trial010.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:47:58.064 INFO:teuthology.orchestra.run.trial010.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:47:58.065 INFO:teuthology.orchestra.run.trial010.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:47:58.065 INFO:teuthology.orchestra.run.trial010.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:47:58.065 INFO:teuthology.orchestra.run.trial010.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:47:58.065 INFO:teuthology.orchestra.run.trial010.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:47:58.065 INFO:teuthology.orchestra.run.trial010.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:47:58.065 INFO:teuthology.orchestra.run.trial010.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:47:58.065 INFO:teuthology.orchestra.run.trial010.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:47:58.065 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:58.065 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:47:58.112 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-base 2026-02-17T11:47:58.156 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:58.220 INFO:teuthology.orchestra.run.trial174.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:47:58.226 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:58.228 INFO:teuthology.orchestra.run.trial153.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:58.238 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:47:58.238 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:47:58.238 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:47:58.250 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:58.250 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:58.250 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:47:58.250 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:47:58.250 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:47:58.250 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:58.261 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:47:58.348 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:47:58.348 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T11:47:58.348 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T11:47:58.348 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T11:47:58.349 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:47:58.350 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:47:58.351 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:47:58.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:47:58.353 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:47:58.354 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:47:58.355 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:47:58.356 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:47:58.356 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:47:58.356 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:47:58.356 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:47:58.356 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:47:58.411 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:47:58.412 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:58.412 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:47:58.412 INFO:teuthology.orchestra.run.trial071.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:47:58.412 INFO:teuthology.orchestra.run.trial071.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.412 INFO:teuthology.orchestra.run.trial071.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.412 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.412 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.412 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.412 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:47:58.413 INFO:teuthology.orchestra.run.trial071.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:47:58.414 INFO:teuthology.orchestra.run.trial071.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:47:58.415 INFO:teuthology.orchestra.run.trial071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:47:58.416 INFO:teuthology.orchestra.run.trial071.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:47:58.417 INFO:teuthology.orchestra.run.trial071.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:47:58.418 INFO:teuthology.orchestra.run.trial071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:47:58.419 INFO:teuthology.orchestra.run.trial071.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:47:58.420 INFO:teuthology.orchestra.run.trial071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:47:58.420 INFO:teuthology.orchestra.run.trial071.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:47:58.420 INFO:teuthology.orchestra.run.trial071.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:47:58.420 INFO:teuthology.orchestra.run.trial071.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:47:58.420 INFO:teuthology.orchestra.run.trial071.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:47:58.420 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:58.420 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:47:58.427 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:58.466 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-base 2026-02-17T11:47:58.490 INFO:teuthology.orchestra.run.trial010.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:58.508 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:47:58.509 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:47:58.509 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:47:58.529 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install cephadm 2026-02-17T11:47:58.569 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:58.569 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:58.570 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:58.570 INFO:teuthology.orchestra.run.trial153.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:58.570 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:58.570 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:58.571 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:58.597 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install rbd-nbd 2026-02-17T11:47:58.654 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:47:58.655 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:47:58.655 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:47:58.655 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:47:58.655 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:47:58.655 INFO:teuthology.orchestra.run.trial174.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T11:47:58.655 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:58.655 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:47:58.655 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:47:58.655 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:47:58.656 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:58.656 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 145 k 2026-02-17T11:47:58.656 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 431 k 2026-02-17T11:47:58.656 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:47:58.741 INFO:teuthology.orchestra.run.trial174.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.7 MB/s | 145 kB 00:00 2026-02-17T11:47:58.741 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:58.742 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T11:47:58.742 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:47:58.744 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:47:58.744 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:47:58.775 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:47:58.775 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:47:58.777 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:47:58.834 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:47:58.834 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:58.838 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:58.842 INFO:teuthology.orchestra.run.trial071.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:58.858 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:58.858 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:58.858 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:47:58.859 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:58.859 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:47:58.860 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:47:58.860 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:47:58.881 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install cephadm 2026-02-17T11:47:58.901 INFO:teuthology.orchestra.run.trial010.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:47:58.909 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:58.918 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:47:58.919 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:47:58.919 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:47:58.940 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 171 k 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 490 k 2026-02-17T11:47:58.992 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:59.078 INFO:teuthology.orchestra.run.trial153.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T11:47:59.078 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:59.078 INFO:teuthology.orchestra.run.trial153.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T11:47:59.079 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:47:59.082 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:47:59.082 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:47:59.112 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:47:59.112 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:47:59.158 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:59.158 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:59.158 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:47:59.158 INFO:teuthology.orchestra.run.trial174.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:59.158 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:47:59.158 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:47:59.167 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:47:59.185 INFO:teuthology.orchestra.run.trial153.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:59.186 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr 2026-02-17T11:47:59.187 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:47:59.248 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:59.252 INFO:teuthology.orchestra.run.trial071.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:47:59.261 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:59.270 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:47:59.270 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:47:59.271 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:47:59.292 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:47:59.319 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:47:59.319 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:59.320 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:47:59.320 INFO:teuthology.orchestra.run.trial153.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:59.320 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:59.320 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:47:59.329 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:47:59.330 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:47:59.330 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:47:59.330 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 145 k 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 431 k 2026-02-17T11:47:59.331 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:47:59.349 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:47:59.416 INFO:teuthology.orchestra.run.trial010.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.7 MB/s | 145 kB 00:00 2026-02-17T11:47:59.416 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:59.416 INFO:teuthology.orchestra.run.trial010.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T11:47:59.416 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:47:59.419 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:47:59.419 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:47:59.450 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:47:59.450 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:47:59.498 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:59.506 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:47:59.507 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:59.529 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:59.529 INFO:teuthology.orchestra.run.trial010.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:59.529 INFO:teuthology.orchestra.run.trial010.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:47:59.529 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:59.562 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:47:59.580 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:47:59.581 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:47:59.581 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:47:59.598 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:47:59.603 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:47:59.666 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 145 k 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 431 k 2026-02-17T11:47:59.683 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:47:59.748 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:47:59.748 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:59.749 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:47:59.749 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:59.749 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:47:59.749 INFO:teuthology.orchestra.run.trial153.stdout: ceph-base-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 72 M 2026-02-17T11:47:59.749 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T11:47:59.749 INFO:teuthology.orchestra.run.trial153.stdout: ceph-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 24 M 2026-02-17T11:47:59.749 INFO:teuthology.orchestra.run.trial153.stdout:Installing weak dependencies: 2026-02-17T11:47:59.749 INFO:teuthology.orchestra.run.trial153.stdout: ceph-debugsource x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:47:59.749 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:59.750 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:47:59.750 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:47:59.750 INFO:teuthology.orchestra.run.trial153.stdout:Install 3 Packages 2026-02-17T11:47:59.750 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:47:59.750 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 107 M 2026-02-17T11:47:59.750 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 654 M 2026-02-17T11:47:59.750 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:47:59.769 INFO:teuthology.orchestra.run.trial071.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.6 MB/s | 145 kB 00:00 2026-02-17T11:47:59.770 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:59.770 INFO:teuthology.orchestra.run.trial071.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T11:47:59.770 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:47:59.774 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:47:59.774 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:47:59.804 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:47:59.804 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:47:59.819 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:59.819 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:59.819 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:47:59.819 INFO:teuthology.orchestra.run.trial010.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:47:59.819 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:47:59.819 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:47:59.845 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-mgr 2026-02-17T11:47:59.859 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:47:59.860 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:59.883 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:47:59.883 INFO:teuthology.orchestra.run.trial071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:47:59.883 INFO:teuthology.orchestra.run.trial071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:47:59.883 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:47:59.918 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:47:59.984 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:00.001 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:00.001 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:00.002 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:00.023 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:48:00.157 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:00.198 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:48:00.198 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:00.198 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:48:00.198 INFO:teuthology.orchestra.run.trial071.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:00.198 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:00.198 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:00.221 INFO:teuthology.orchestra.run.trial010.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:00.225 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-mgr 2026-02-17T11:48:00.238 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:00.239 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:00.239 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:00.259 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:48:00.330 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:00.396 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:00.413 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:00.414 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:00.414 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:00.435 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:48:00.544 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:00.550 INFO:teuthology.orchestra.run.trial153.stdout:(1/3): ceph-debugsource-19.2.3-675.g3c96dfb3.el 13 MB/s | 11 MB 00:00 2026-02-17T11:48:00.573 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:00.609 INFO:teuthology.orchestra.run.trial071.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:00.627 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:00.628 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:00.628 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:00.637 INFO:teuthology.orchestra.run.trial010.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:00.649 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:48:00.655 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:00.655 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:00.655 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:00.677 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:48:00.749 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:00.814 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:00.831 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:00.832 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:00.832 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:00.852 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:48:00.862 INFO:teuthology.orchestra.run.trial153.stdout:(2/3): ceph-debuginfo-19.2.3-675.g3c96dfb3.el9. 22 MB/s | 24 MB 00:01 2026-02-17T11:48:00.962 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:00.985 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:01.028 INFO:teuthology.orchestra.run.trial071.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:01.046 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:01.046 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:01.046 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:01.050 INFO:teuthology.orchestra.run.trial010.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:01.067 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:01.068 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:01.068 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:01.069 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:48:01.090 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:48:01.162 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:01.226 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:01.243 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:01.244 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:01.264 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-fuse 2026-02-17T11:48:01.377 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:01.401 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:01.442 INFO:teuthology.orchestra.run.trial071.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:01.459 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:01.460 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:01.460 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:01.464 INFO:teuthology.orchestra.run.trial010.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:01.482 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:48:01.484 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:01.484 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:01.484 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:01.504 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:48:01.575 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:01.660 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:01.660 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout: Package Architecture Version Repository Size 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:01.661 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 1.2 M 2026-02-17T11:48:01.662 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 3.6 M 2026-02-17T11:48:01.662 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:48:01.775 INFO:teuthology.orchestra.run.trial153.stdout:(3/3): ceph-base-debuginfo-19.2.3-675.g3c96dfb3 35 MB/s | 72 MB 00:02 2026-02-17T11:48:01.777 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:01.777 INFO:teuthology.orchestra.run.trial153.stdout:Total 53 MB/s | 107 MB 00:02 2026-02-17T11:48:01.777 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:48:01.782 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:48:01.782 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:48:01.785 INFO:teuthology.orchestra.run.trial174.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.3 MB/s | 1.2 MB 00:00 2026-02-17T11:48:01.786 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:01.786 INFO:teuthology.orchestra.run.trial174.stdout:Total 9.2 MB/s | 1.2 MB 00:00 2026-02-17T11:48:01.786 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:48:01.790 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:48:01.790 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:48:01.792 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:01.816 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:01.824 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:48:01.824 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:48:01.857 INFO:teuthology.orchestra.run.trial071.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:01.874 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:01.875 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:01.875 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:01.880 INFO:teuthology.orchestra.run.trial010.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:01.897 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:48:01.898 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:01.898 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:01.898 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:01.919 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-fuse 2026-02-17T11:48:01.926 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:48:01.943 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:02.154 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:02.161 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:48:02.161 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:48:02.210 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:02.210 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:02.210 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:02.210 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:48:02.211 INFO:teuthology.orchestra.run.trial174.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:02.211 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:02.211 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:02.228 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:02.237 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-volume 2026-02-17T11:48:02.274 INFO:teuthology.orchestra.run.trial071.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:02.291 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:02.292 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:02.292 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:02.310 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:02.311 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:02.311 INFO:teuthology.orchestra.run.trial010.stdout: Package Architecture Version Repository Size 2026-02-17T11:48:02.311 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:02.311 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:48:02.311 INFO:teuthology.orchestra.run.trial010.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T11:48:02.311 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:02.311 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:48:02.311 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:02.312 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:48:02.312 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:02.312 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 1.2 M 2026-02-17T11:48:02.312 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 3.6 M 2026-02-17T11:48:02.312 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:48:02.313 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-fuse 2026-02-17T11:48:02.429 INFO:teuthology.orchestra.run.trial010.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T11:48:02.429 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:02.429 INFO:teuthology.orchestra.run.trial010.stdout:Total 9.8 MB/s | 1.2 MB 00:00 2026-02-17T11:48:02.429 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:48:02.432 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:48:02.433 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:48:02.466 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:48:02.467 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:48:02.546 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:02.569 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:48:02.587 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:02.613 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:02.625 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:02.631 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:02.631 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:02.631 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:02.654 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librados-devel 2026-02-17T11:48:02.707 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:02.708 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:02.708 INFO:teuthology.orchestra.run.trial071.stdout: Package Architecture Version Repository Size 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 1.2 M 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 3.6 M 2026-02-17T11:48:02.709 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:48:02.821 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:02.825 INFO:teuthology.orchestra.run.trial071.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T11:48:02.826 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:02.826 INFO:teuthology.orchestra.run.trial071.stdout:Total 9.8 MB/s | 1.2 MB 00:00 2026-02-17T11:48:02.826 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:48:02.830 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:48:02.830 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:48:02.863 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:48:02.864 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:48:02.877 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:02.878 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:02.878 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:48:02.878 INFO:teuthology.orchestra.run.trial010.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:02.878 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:02.878 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:02.905 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-volume 2026-02-17T11:48:02.964 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:48:02.974 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:02.981 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 127 k 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 456 k 2026-02-17T11:48:03.056 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:48:03.141 INFO:teuthology.orchestra.run.trial174.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.5 MB/s | 127 kB 00:00 2026-02-17T11:48:03.141 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:03.141 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.5 MB/s | 127 kB 00:00 2026-02-17T11:48:03.141 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:48:03.144 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:48:03.144 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:48:03.175 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:48:03.175 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:48:03.200 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:03.227 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:03.229 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:48:03.245 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:03.256 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:03.256 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:03.256 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:48:03.256 INFO:teuthology.orchestra.run.trial071.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:03.256 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:03.256 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:03.285 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-volume 2026-02-17T11:48:03.290 INFO:teuthology.orchestra.run.trial010.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:03.308 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:03.309 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:03.309 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:03.323 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:03.330 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install librados-devel 2026-02-17T11:48:03.380 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:03.380 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:03.380 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:48:03.380 INFO:teuthology.orchestra.run.trial174.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:03.380 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:03.380 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:03.408 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install libcephfs2 2026-02-17T11:48:03.597 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:03.641 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:03.662 INFO:teuthology.orchestra.run.trial071.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:48:03.680 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:03.681 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:03.681 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:03.702 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install librados-devel 2026-02-17T11:48:03.719 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:03.723 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:03.723 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:03.724 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 127 k 2026-02-17T11:48:03.725 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 456 k 2026-02-17T11:48:03.725 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:48:03.785 INFO:teuthology.orchestra.run.trial174.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:03.803 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:03.804 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:03.804 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:03.808 INFO:teuthology.orchestra.run.trial010.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.5 MB/s | 127 kB 00:00 2026-02-17T11:48:03.809 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:03.809 INFO:teuthology.orchestra.run.trial010.stdout:Total 1.5 MB/s | 127 kB 00:00 2026-02-17T11:48:03.809 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:48:03.811 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:48:03.811 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:48:03.826 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install libcephfs-devel 2026-02-17T11:48:03.842 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:48:03.842 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:48:03.896 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:48:03.912 INFO:teuthology.orchestra.run.trial010.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:03.995 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:04.010 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:04.052 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:04.053 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:04.053 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:48:04.053 INFO:teuthology.orchestra.run.trial010.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:04.053 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:04.053 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:04.080 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install libcephfs2 2026-02-17T11:48:04.093 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:04.094 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:04.094 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:48:04.094 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:04.094 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:48:04.094 INFO:teuthology.orchestra.run.trial071.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T11:48:04.094 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:04.094 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:48:04.094 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:04.095 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:48:04.095 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:04.095 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 127 k 2026-02-17T11:48:04.095 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 456 k 2026-02-17T11:48:04.095 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:48:04.140 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:04.180 INFO:teuthology.orchestra.run.trial071.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.4 MB/s | 127 kB 00:00 2026-02-17T11:48:04.180 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:04.181 INFO:teuthology.orchestra.run.trial071.stdout:Total 1.4 MB/s | 127 kB 00:00 2026-02-17T11:48:04.181 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:48:04.183 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:48:04.183 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:48:04.214 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:48:04.214 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:48:04.223 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:04.224 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:04.224 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:48:04.224 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:04.224 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:48:04.224 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T11:48:04.224 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:04.224 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:48:04.224 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:04.224 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:48:04.225 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:04.225 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 34 k 2026-02-17T11:48:04.225 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 153 k 2026-02-17T11:48:04.225 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:48:04.268 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:48:04.285 INFO:teuthology.orchestra.run.trial071.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:04.286 INFO:teuthology.orchestra.run.trial174.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 540 kB/s | 34 kB 00:00 2026-02-17T11:48:04.287 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:04.287 INFO:teuthology.orchestra.run.trial174.stdout:Total 533 kB/s | 34 kB 00:00 2026-02-17T11:48:04.287 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:48:04.289 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:48:04.289 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:48:04.291 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:48:04.291 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:48:04.311 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:48:04.327 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:04.365 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:04.380 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:04.396 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:04.422 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:04.422 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:04.422 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:48:04.422 INFO:teuthology.orchestra.run.trial071.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:04.422 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:04.422 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:04.437 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:04.437 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:04.437 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:48:04.437 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:04.437 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:04.437 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:04.448 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install libcephfs2 2026-02-17T11:48:04.460 INFO:teuthology.orchestra.run.trial010.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:04.464 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librados2 2026-02-17T11:48:04.478 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:04.479 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:04.479 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:04.501 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install libcephfs-devel 2026-02-17T11:48:04.614 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:48:04.764 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:04.772 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:04.811 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:04.828 INFO:teuthology.orchestra.run.trial071.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:04.838 INFO:teuthology.orchestra.run.trial174.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:04.846 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:04.847 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:04.847 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:04.856 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:04.856 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:04.856 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:04.868 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install libcephfs-devel 2026-02-17T11:48:04.877 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librbd1 2026-02-17T11:48:04.892 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:04.893 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:04.893 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 34 k 2026-02-17T11:48:04.894 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 153 k 2026-02-17T11:48:04.895 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:48:04.956 INFO:teuthology.orchestra.run.trial010.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 539 kB/s | 34 kB 00:00 2026-02-17T11:48:04.957 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:04.957 INFO:teuthology.orchestra.run.trial010.stdout:Total 528 kB/s | 34 kB 00:00 2026-02-17T11:48:04.957 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:48:04.958 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:48:04.959 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:48:04.960 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:48:04.961 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:48:04.982 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:48:04.998 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:05.054 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:05.110 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:05.110 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:05.111 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:48:05.111 INFO:teuthology.orchestra.run.trial010.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:05.111 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:05.111 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:05.138 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install librados2 2026-02-17T11:48:05.176 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:05.190 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:05.254 INFO:teuthology.orchestra.run.trial174.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:05.257 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:05.258 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:05.258 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:48:05.258 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:05.258 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:48:05.258 INFO:teuthology.orchestra.run.trial071.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T11:48:05.259 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:05.259 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:48:05.259 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:05.259 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:48:05.259 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:05.259 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 34 k 2026-02-17T11:48:05.259 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 153 k 2026-02-17T11:48:05.259 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:48:05.272 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:05.272 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:05.273 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:05.295 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rados 2026-02-17T11:48:05.321 INFO:teuthology.orchestra.run.trial071.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 537 kB/s | 34 kB 00:00 2026-02-17T11:48:05.321 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:05.321 INFO:teuthology.orchestra.run.trial071.stdout:Total 531 kB/s | 34 kB 00:00 2026-02-17T11:48:05.321 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:48:05.323 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:48:05.323 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:48:05.325 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:48:05.325 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:48:05.346 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:48:05.362 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:05.415 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:05.450 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:05.470 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:05.470 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:05.470 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:48:05.470 INFO:teuthology.orchestra.run.trial071.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:05.470 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:05.471 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:05.496 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install librados2 2026-02-17T11:48:05.514 INFO:teuthology.orchestra.run.trial010.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:05.532 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:05.532 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:05.533 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:05.554 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install librbd1 2026-02-17T11:48:05.604 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:05.668 INFO:teuthology.orchestra.run.trial174.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:05.685 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:05.685 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:05.686 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:05.706 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rgw 2026-02-17T11:48:05.805 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:05.867 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:05.869 INFO:teuthology.orchestra.run.trial071.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:05.880 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/3 2026-02-17T11:48:05.886 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:05.887 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:05.887 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:05.908 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install librbd1 2026-02-17T11:48:05.931 INFO:teuthology.orchestra.run.trial010.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:05.949 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:05.949 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:05.950 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:05.971 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install python3-rados 2026-02-17T11:48:06.020 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:06.083 INFO:teuthology.orchestra.run.trial174.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:06.101 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:06.101 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:06.102 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:06.123 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-cephfs 2026-02-17T11:48:06.218 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:06.278 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:06.284 INFO:teuthology.orchestra.run.trial071.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:06.301 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:06.302 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:06.302 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:06.324 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install python3-rados 2026-02-17T11:48:06.341 INFO:teuthology.orchestra.run.trial010.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:06.358 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:06.359 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:06.359 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:06.381 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install python3-rgw 2026-02-17T11:48:06.438 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:06.504 INFO:teuthology.orchestra.run.trial174.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:06.522 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:06.522 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:06.522 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:06.543 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rbd 2026-02-17T11:48:06.631 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:06.691 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:06.694 INFO:teuthology.orchestra.run.trial071.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:06.712 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:06.712 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:06.712 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:06.733 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install python3-rgw 2026-02-17T11:48:06.754 INFO:teuthology.orchestra.run.trial010.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:06.772 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:06.773 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:06.773 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:06.794 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install python3-cephfs 2026-02-17T11:48:06.856 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:06.922 INFO:teuthology.orchestra.run.trial174.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:06.939 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:06.940 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:48:06.940 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:06.961 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-fuse 2026-02-17T11:48:07.045 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:07.110 INFO:teuthology.orchestra.run.trial071.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:07.111 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:07.127 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:07.128 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:07.128 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:07.148 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install python3-cephfs 2026-02-17T11:48:07.175 INFO:teuthology.orchestra.run.trial010.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:07.193 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:07.194 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:07.194 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:07.217 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install python3-rbd 2026-02-17T11:48:07.272 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:07.357 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:07.357 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:07.357 INFO:teuthology.orchestra.run.trial174.stdout: Package Architecture Version Repository Size 2026-02-17T11:48:07.357 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:07.357 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:48:07.357 INFO:teuthology.orchestra.run.trial174.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T11:48:07.357 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:07.357 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:48:07.358 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:07.358 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:48:07.358 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:07.358 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 85 k 2026-02-17T11:48:07.358 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 227 k 2026-02-17T11:48:07.358 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:48:07.432 INFO:teuthology.orchestra.run.trial174.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T11:48:07.433 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:07.433 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T11:48:07.433 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:48:07.436 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:48:07.436 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:48:07.462 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:07.467 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:48:07.467 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:48:07.517 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:48:07.526 INFO:teuthology.orchestra.run.trial071.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:07.530 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:07.534 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:07.543 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:07.544 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:07.544 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:07.566 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install python3-rbd 2026-02-17T11:48:07.594 INFO:teuthology.orchestra.run.trial010.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:07.610 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:07.612 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:07.613 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:48:07.613 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:07.634 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install rbd-fuse 2026-02-17T11:48:07.667 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:07.668 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:07.668 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:48:07.668 INFO:teuthology.orchestra.run.trial174.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:07.668 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:07.668 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:07.695 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-mirror 2026-02-17T11:48:07.877 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:07.942 INFO:teuthology.orchestra.run.trial071.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:48:07.950 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:07.959 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:07.960 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:48:07.960 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:07.982 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install rbd-fuse 2026-02-17T11:48:08.010 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:08.032 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:08.032 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:08.033 INFO:teuthology.orchestra.run.trial010.stdout: Package Architecture Version Repository Size 2026-02-17T11:48:08.033 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:08.033 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:48:08.033 INFO:teuthology.orchestra.run.trial010.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T11:48:08.033 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:08.033 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:48:08.033 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:08.033 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:48:08.033 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:08.034 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 85 k 2026-02-17T11:48:08.034 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 227 k 2026-02-17T11:48:08.034 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:48:08.092 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial174.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:48:08.093 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:08.094 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:48:08.094 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:08.094 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 3.1 M 2026-02-17T11:48:08.094 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 13 M 2026-02-17T11:48:08.094 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:48:08.107 INFO:teuthology.orchestra.run.trial010.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T11:48:08.108 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:08.108 INFO:teuthology.orchestra.run.trial010.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T11:48:08.108 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:48:08.111 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:48:08.111 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:48:08.142 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:48:08.142 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:48:08.193 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:48:08.209 INFO:teuthology.orchestra.run.trial010.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:08.244 INFO:teuthology.orchestra.run.trial174.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T11:48:08.244 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:08.244 INFO:teuthology.orchestra.run.trial174.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T11:48:08.244 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:48:08.248 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:48:08.248 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:48:08.288 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:48:08.288 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:48:08.288 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:08.290 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:08.346 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:08.346 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:08.346 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:48:08.346 INFO:teuthology.orchestra.run.trial010.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:08.346 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:08.346 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:08.373 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:08.374 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout: Package Architecture Version Repository Size 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:08.375 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 85 k 2026-02-17T11:48:08.376 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 227 k 2026-02-17T11:48:08.376 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:48:08.377 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install rbd-mirror 2026-02-17T11:48:08.448 INFO:teuthology.orchestra.run.trial071.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T11:48:08.448 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:08.449 INFO:teuthology.orchestra.run.trial071.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T11:48:08.449 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:48:08.452 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:48:08.452 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:48:08.483 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:48:08.483 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:48:08.484 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:48:08.485 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:08.508 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:08.509 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:48:08.509 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:48:08.509 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:48:08.509 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:48:08.509 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:08.533 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:48:08.550 INFO:teuthology.orchestra.run.trial071.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:08.627 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:08.684 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:08.684 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:08.684 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:48:08.684 INFO:teuthology.orchestra.run.trial071.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:08.684 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:08.684 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:08.689 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:08.711 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install rbd-mirror 2026-02-17T11:48:08.771 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 3.1 M 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 13 M 2026-02-17T11:48:08.772 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:48:08.816 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:08.816 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:08.816 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:48:08.817 INFO:teuthology.orchestra.run.trial174.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:08.817 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:08.817 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:08.843 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-nbd 2026-02-17T11:48:08.922 INFO:teuthology.orchestra.run.trial010.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T11:48:08.922 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:08.923 INFO:teuthology.orchestra.run.trial010.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T11:48:08.923 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:48:08.926 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:48:08.926 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:48:08.966 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:48:08.966 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:48:09.022 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:09.104 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:09.104 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:09.105 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:48:09.105 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:09.105 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:48:09.105 INFO:teuthology.orchestra.run.trial071.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T11:48:09.105 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:09.105 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:48:09.105 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:09.105 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:48:09.105 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:09.106 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 3.1 M 2026-02-17T11:48:09.106 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 13 M 2026-02-17T11:48:09.106 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:48:09.156 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:09.159 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:48:09.160 INFO:teuthology.orchestra.run.trial010.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:09.184 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:09.184 INFO:teuthology.orchestra.run.trial010.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:48:09.184 INFO:teuthology.orchestra.run.trial010.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:48:09.185 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:48:09.185 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:48:09.185 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:09.238 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout: Package Architecture Version Repository Size 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:48:09.239 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:09.240 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 171 k 2026-02-17T11:48:09.240 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 490 k 2026-02-17T11:48:09.240 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:48:09.253 INFO:teuthology.orchestra.run.trial071.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T11:48:09.253 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:09.254 INFO:teuthology.orchestra.run.trial071.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T11:48:09.254 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:48:09.258 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:48:09.258 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:48:09.298 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:48:09.298 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:48:09.323 INFO:teuthology.orchestra.run.trial174.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T11:48:09.323 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:09.324 INFO:teuthology.orchestra.run.trial174.stdout:Total 2.0 MB/s | 171 kB 00:00 2026-02-17T11:48:09.324 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:48:09.327 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:48:09.327 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:48:09.358 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:48:09.358 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:48:09.414 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:48:09.431 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:09.490 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:48:09.491 INFO:teuthology.orchestra.run.trial071.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:09.501 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:09.501 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:09.501 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:48:09.501 INFO:teuthology.orchestra.run.trial010.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:09.501 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:09.501 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:09.511 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:09.514 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:09.514 INFO:teuthology.orchestra.run.trial071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:48:09.514 INFO:teuthology.orchestra.run.trial071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:48:09.514 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:48:09.514 INFO:teuthology.orchestra.run.trial071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:48:09.514 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:09.529 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install rbd-nbd 2026-02-17T11:48:09.563 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/3 2026-02-17T11:48:09.568 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:09.569 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:09.569 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:48:09.569 INFO:teuthology.orchestra.run.trial174.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:09.569 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:09.569 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:09.583 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 3/3 2026-02-17T11:48:09.596 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:48:09.833 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:09.834 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:09.834 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:48:09.834 INFO:teuthology.orchestra.run.trial071.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:09.834 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:09.834 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:09.844 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:09.860 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install rbd-nbd 2026-02-17T11:48:09.922 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:09.925 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:09.926 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:09.926 INFO:teuthology.orchestra.run.trial010.stdout: Package Architecture Version Repository Size 2026-02-17T11:48:09.926 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:09.926 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:48:09.927 INFO:teuthology.orchestra.run.trial010.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T11:48:09.927 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:09.927 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:48:09.927 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:09.927 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:48:09.927 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:09.927 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 171 k 2026-02-17T11:48:09.927 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 490 k 2026-02-17T11:48:09.927 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:48:10.005 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:10.007 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:10.007 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:48:10.007 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:10.007 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout: ceph-base-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 72 M 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout: ceph-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 24 M 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout:Installing weak dependencies: 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout: ceph-debugsource x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout:Install 3 Packages 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:10.008 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 107 M 2026-02-17T11:48:10.009 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 654 M 2026-02-17T11:48:10.009 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:48:10.012 INFO:teuthology.orchestra.run.trial010.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T11:48:10.012 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:10.013 INFO:teuthology.orchestra.run.trial010.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T11:48:10.013 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:48:10.016 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:48:10.017 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:48:10.047 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:48:10.047 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:48:10.103 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:48:10.119 INFO:teuthology.orchestra.run.trial010.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:10.120 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 3/3 2026-02-17T11:48:10.121 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/3 2026-02-17T11:48:10.121 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/3 2026-02-17T11:48:10.177 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:10.178 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/3 2026-02-17T11:48:10.178 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:10.179 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:48:10.179 INFO:teuthology.orchestra.run.trial153.stdout: ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:10.179 INFO:teuthology.orchestra.run.trial153.stdout: ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:10.179 INFO:teuthology.orchestra.run.trial153.stdout: ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:10.179 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:10.179 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:48:10.203 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:10.218 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-common-debuginfo 2026-02-17T11:48:10.259 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:10.260 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:10.260 INFO:teuthology.orchestra.run.trial071.stdout: Package Architecture Version Repository Size 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 171 k 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 490 k 2026-02-17T11:48:10.261 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:48:10.262 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:10.262 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:10.262 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:48:10.262 INFO:teuthology.orchestra.run.trial010.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:10.262 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:10.262 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:10.290 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:48:10.523 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:48:10.605 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:48:10.605 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout: ceph-common-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 474 M 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 474 M 2026-02-17T11:48:10.606 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 2.0 G 2026-02-17T11:48:10.607 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:48:10.607 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:10.688 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:10.688 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:10.688 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout: ceph-base-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 72 M 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:Installing dependencies: 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout: ceph-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 24 M 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:Installing weak dependencies: 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout: ceph-debugsource x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:Install 3 Packages 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 107 M 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 654 M 2026-02-17T11:48:10.689 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:48:10.726 INFO:teuthology.orchestra.run.trial174.stdout:(1/3): ceph-debugsource-19.2.3-675.g3c96dfb3.el 15 MB/s | 11 MB 00:00 2026-02-17T11:48:10.750 INFO:teuthology.orchestra.run.trial071.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 349 kB/s | 171 kB 00:00 2026-02-17T11:48:10.750 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:10.750 INFO:teuthology.orchestra.run.trial071.stdout:Total 348 kB/s | 171 kB 00:00 2026-02-17T11:48:10.750 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:48:10.754 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:48:10.754 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:48:10.785 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:48:10.786 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:48:10.841 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:48:10.858 INFO:teuthology.orchestra.run.trial071.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:10.933 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:10.992 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:48:10.992 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:10.992 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:48:10.992 INFO:teuthology.orchestra.run.trial071.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:10.992 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:10.992 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:11.021 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:48:11.340 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:11.407 INFO:teuthology.orchestra.run.trial174.stdout:(2/3): ceph-debuginfo-19.2.3-675.g3c96dfb3.el9. 17 MB/s | 24 MB 00:01 2026-02-17T11:48:11.424 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:11.425 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:11.425 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:48:11.425 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:11.425 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:48:11.426 INFO:teuthology.orchestra.run.trial071.stdout: ceph-base-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 72 M 2026-02-17T11:48:11.426 INFO:teuthology.orchestra.run.trial071.stdout:Installing dependencies: 2026-02-17T11:48:11.426 INFO:teuthology.orchestra.run.trial071.stdout: ceph-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 24 M 2026-02-17T11:48:11.426 INFO:teuthology.orchestra.run.trial071.stdout:Installing weak dependencies: 2026-02-17T11:48:11.426 INFO:teuthology.orchestra.run.trial071.stdout: ceph-debugsource x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:48:11.426 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:11.427 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:48:11.427 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:11.427 INFO:teuthology.orchestra.run.trial071.stdout:Install 3 Packages 2026-02-17T11:48:11.427 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:11.427 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 107 M 2026-02-17T11:48:11.427 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 654 M 2026-02-17T11:48:11.427 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:48:13.126 INFO:teuthology.orchestra.run.trial174.stdout:(3/3): ceph-base-debuginfo-19.2.3-675.g3c96dfb3 23 MB/s | 72 MB 00:03 2026-02-17T11:48:13.129 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:13.129 INFO:teuthology.orchestra.run.trial174.stdout:Total 34 MB/s | 107 MB 00:03 2026-02-17T11:48:13.129 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:48:13.134 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:48:13.134 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:48:13.517 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:48:13.517 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:48:13.620 INFO:teuthology.orchestra.run.trial010.stdout:(1/3): ceph-debugsource-19.2.3-675.g3c96dfb3.el 3.7 MB/s | 11 MB 00:02 2026-02-17T11:48:14.292 INFO:teuthology.orchestra.run.trial010.stdout:(2/3): ceph-debuginfo-19.2.3-675.g3c96dfb3.el9. 6.8 MB/s | 24 MB 00:03 2026-02-17T11:48:14.558 INFO:teuthology.orchestra.run.trial071.stdout:(1/3): ceph-debuginfo-19.2.3-675.g3c96dfb3.el9. 7.8 MB/s | 24 MB 00:03 2026-02-17T11:48:15.381 INFO:teuthology.orchestra.run.trial071.stdout:(2/3): ceph-debugsource-19.2.3-675.g3c96dfb3.el 2.7 MB/s | 11 MB 00:03 2026-02-17T11:48:15.977 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:48:17.174 INFO:teuthology.orchestra.run.trial010.stdout:(3/3): ceph-base-debuginfo-19.2.3-675.g3c96dfb3 11 MB/s | 72 MB 00:06 2026-02-17T11:48:17.176 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:17.177 INFO:teuthology.orchestra.run.trial010.stdout:Total 16 MB/s | 107 MB 00:06 2026-02-17T11:48:17.177 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:48:17.182 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:48:17.182 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:48:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/3 2026-02-17T11:48:17.563 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:48:17.563 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:48:20.014 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:48:20.933 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/3 2026-02-17T11:48:20.952 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 3/3 2026-02-17T11:48:21.303 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/3 2026-02-17T11:48:21.361 INFO:teuthology.orchestra.run.trial071.stdout:(3/3): ceph-base-debuginfo-19.2.3-675.g3c96dfb3 7.2 MB/s | 72 MB 00:09 2026-02-17T11:48:21.363 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:21.363 INFO:teuthology.orchestra.run.trial071.stdout:Total 11 MB/s | 107 MB 00:09 2026-02-17T11:48:21.364 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:48:21.368 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:48:21.369 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:48:21.472 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 3/3 2026-02-17T11:48:21.473 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/3 2026-02-17T11:48:21.473 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/3 2026-02-17T11:48:21.530 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/3 2026-02-17T11:48:21.531 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:21.531 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:48:21.531 INFO:teuthology.orchestra.run.trial174.stdout: ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:21.531 INFO:teuthology.orchestra.run.trial174.stdout: ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:21.531 INFO:teuthology.orchestra.run.trial174.stdout: ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:21.531 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:21.532 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:48:21.571 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-common-debuginfo 2026-02-17T11:48:21.749 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:48:21.749 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:48:21.898 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:21.980 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:48:21.981 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:21.981 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout: ceph-common-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 474 M 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 474 M 2026-02-17T11:48:21.982 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 2.0 G 2026-02-17T11:48:21.983 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:48:24.207 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:48:25.057 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/3 2026-02-17T11:48:25.076 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 3/3 2026-02-17T11:48:25.476 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/3 2026-02-17T11:48:25.575 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 3/3 2026-02-17T11:48:25.575 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/3 2026-02-17T11:48:25.575 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/3 2026-02-17T11:48:25.634 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/3 2026-02-17T11:48:25.634 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:25.634 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:48:25.634 INFO:teuthology.orchestra.run.trial010.stdout: ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:25.634 INFO:teuthology.orchestra.run.trial010.stdout: ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:25.634 INFO:teuthology.orchestra.run.trial010.stdout: ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:25.634 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:25.635 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:48:25.675 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-common-debuginfo 2026-02-17T11:48:25.981 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:01:01 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:48:26.063 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:48:26.063 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout: ceph-common-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 474 M 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:48:26.064 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 474 M 2026-02-17T11:48:26.065 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 2.0 G 2026-02-17T11:48:26.065 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:48:28.272 INFO:teuthology.orchestra.run.trial153.stdout:ceph-common-debuginfo-19.2.3-675.g3c96dfb3.el9. 27 MB/s | 474 MB 00:17 2026-02-17T11:48:28.273 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:28.273 INFO:teuthology.orchestra.run.trial153.stdout:Total 27 MB/s | 474 MB 00:17 2026-02-17T11:48:28.273 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:48:28.275 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:48:28.275 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:48:29.164 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/3 2026-02-17T11:48:29.183 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 3/3 2026-02-17T11:48:29.686 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:48:29.686 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:48:29.723 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 3/3 2026-02-17T11:48:29.724 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/3 2026-02-17T11:48:29.724 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/3 2026-02-17T11:48:29.781 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/3 2026-02-17T11:48:29.781 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:29.781 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:48:29.781 INFO:teuthology.orchestra.run.trial071.stdout: ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:29.781 INFO:teuthology.orchestra.run.trial071.stdout: ceph-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:29.781 INFO:teuthology.orchestra.run.trial071.stdout: ceph-debugsource-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:29.781 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:29.781 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:48:29.824 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-common-debuginfo 2026-02-17T11:48:30.140 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:01:04 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:48:30.222 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:48:30.222 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout: ceph-common-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 474 M 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 474 M 2026-02-17T11:48:30.223 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 2.0 G 2026-02-17T11:48:30.224 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:48:35.041 INFO:teuthology.orchestra.run.trial174.stdout:ceph-common-debuginfo-19.2.3-675.g3c96dfb3.el9. 36 MB/s | 474 MB 00:13 2026-02-17T11:48:35.042 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:35.042 INFO:teuthology.orchestra.run.trial174.stdout:Total 36 MB/s | 474 MB 00:13 2026-02-17T11:48:35.042 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:48:35.044 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:48:35.044 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:48:36.455 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:48:36.455 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:48:46.654 INFO:teuthology.orchestra.run.trial071.stdout:ceph-common-debuginfo-19.2.3-675.g3c96dfb3.el9. 29 MB/s | 474 MB 00:16 2026-02-17T11:48:46.655 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:46.655 INFO:teuthology.orchestra.run.trial071.stdout:Total 29 MB/s | 474 MB 00:16 2026-02-17T11:48:46.655 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:48:46.657 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:48:46.657 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:48:48.063 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:48:48.063 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:48:48.791 INFO:teuthology.orchestra.run.trial010.stdout:ceph-common-debuginfo-19.2.3-675.g3c96dfb3.el9. 21 MB/s | 474 MB 00:22 2026-02-17T11:48:48.791 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:48.792 INFO:teuthology.orchestra.run.trial010.stdout:Total 21 MB/s | 474 MB 00:22 2026-02-17T11:48:48.792 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:48:48.794 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:48:48.794 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:48:50.201 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:48:50.202 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:48:53.725 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:48:53.743 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:48:55.248 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:48:55.305 INFO:teuthology.orchestra.run.trial153.stdout: ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:55.306 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:55.306 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:48:55.380 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T11:48:55.689 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:48:55.771 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:48:55.772 INFO:teuthology.orchestra.run.trial153.stdout:======================================================================================= 2026-02-17T11:48:55.772 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:48:55.772 INFO:teuthology.orchestra.run.trial153.stdout:======================================================================================= 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.5 M 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout:======================================================================================= 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 1.5 M 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 7.6 M 2026-02-17T11:48:55.773 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:48:55.891 INFO:teuthology.orchestra.run.trial153.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 13 MB/s | 1.5 MB 00:00 2026-02-17T11:48:55.891 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:55.891 INFO:teuthology.orchestra.run.trial153.stdout:Total 13 MB/s | 1.5 MB 00:00 2026-02-17T11:48:55.891 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:48:55.892 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:48:55.893 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:48:55.914 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:48:55.914 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:48:56.028 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:48:56.045 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:48:56.105 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:48:56.163 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:48:56.163 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:56.164 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:48:56.164 INFO:teuthology.orchestra.run.trial153.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:48:56.164 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:56.164 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:48:56.190 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T11:48:56.504 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:48:56.585 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:48:56.586 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:48:56.586 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:48:56.586 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:48:56.586 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:48:56.586 INFO:teuthology.orchestra.run.trial153.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 200 M 2026-02-17T11:48:56.587 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:56.587 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:48:56.587 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:48:56.587 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:48:56.587 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:48:56.587 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 200 M 2026-02-17T11:48:56.587 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 893 M 2026-02-17T11:48:56.587 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:49:00.396 INFO:teuthology.orchestra.run.trial153.stdout:ceph-radosgw-debuginfo-19.2.3-675.g3c96dfb3.el9 53 MB/s | 200 MB 00:03 2026-02-17T11:49:00.396 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:00.397 INFO:teuthology.orchestra.run.trial153.stdout:Total 53 MB/s | 200 MB 00:03 2026-02-17T11:49:00.397 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:49:00.399 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:49:00.399 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:49:00.416 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:49:00.434 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:49:01.003 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:49:01.003 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:49:01.944 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:49:02.002 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:49:02.002 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:02.002 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:49:02.002 INFO:teuthology.orchestra.run.trial174.stdout: ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:02.002 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:02.002 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:49:02.075 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T11:49:02.388 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:49:02.473 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:49:02.473 INFO:teuthology.orchestra.run.trial174.stdout:======================================================================================= 2026-02-17T11:49:02.473 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:49:02.473 INFO:teuthology.orchestra.run.trial174.stdout:======================================================================================= 2026-02-17T11:49:02.473 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:49:02.474 INFO:teuthology.orchestra.run.trial174.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.5 M 2026-02-17T11:49:02.474 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:02.474 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:49:02.474 INFO:teuthology.orchestra.run.trial174.stdout:======================================================================================= 2026-02-17T11:49:02.474 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:49:02.474 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:02.474 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 1.5 M 2026-02-17T11:49:02.474 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 7.6 M 2026-02-17T11:49:02.474 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:49:02.595 INFO:teuthology.orchestra.run.trial174.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 13 MB/s | 1.5 MB 00:00 2026-02-17T11:49:02.595 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:02.595 INFO:teuthology.orchestra.run.trial174.stdout:Total 13 MB/s | 1.5 MB 00:00 2026-02-17T11:49:02.595 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:49:02.596 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:49:02.597 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:49:02.618 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:49:02.618 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:49:02.733 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:49:02.750 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:49:02.814 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:49:02.872 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:49:02.872 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:02.872 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:49:02.872 INFO:teuthology.orchestra.run.trial174.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:02.872 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:02.872 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:49:02.900 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T11:49:03.218 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:49:03.300 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 200 M 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:03.301 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 200 M 2026-02-17T11:49:03.302 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 893 M 2026-02-17T11:49:03.302 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:49:07.623 INFO:teuthology.orchestra.run.trial174.stdout:ceph-radosgw-debuginfo-19.2.3-675.g3c96dfb3.el9 46 MB/s | 200 MB 00:04 2026-02-17T11:49:07.624 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:07.624 INFO:teuthology.orchestra.run.trial174.stdout:Total 46 MB/s | 200 MB 00:04 2026-02-17T11:49:07.624 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:49:07.626 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:49:07.626 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:49:08.233 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:49:08.234 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:49:11.052 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:49:11.070 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:11.638 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:49:11.656 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:49:11.767 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:11.823 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:11.823 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:49:11.823 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:49:11.824 INFO:teuthology.orchestra.run.trial153.stdout: ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:11.824 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:49:11.824 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:49:11.869 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-test-debuginfo 2026-02-17T11:49:12.184 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:49:12.267 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:49:12.267 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:49:12.267 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:49:12.267 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:49:12.267 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:49:12.268 INFO:teuthology.orchestra.run.trial153.stdout: ceph-test-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 729 M 2026-02-17T11:49:12.268 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:49:12.268 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:49:12.268 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:49:12.268 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:49:12.268 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:49:12.268 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 729 M 2026-02-17T11:49:12.268 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 3.6 G 2026-02-17T11:49:12.268 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:49:13.174 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:49:13.231 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:49:13.231 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:13.232 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:49:13.232 INFO:teuthology.orchestra.run.trial071.stdout: ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:13.232 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:13.232 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:49:13.302 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T11:49:13.613 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:01:47 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:49:13.695 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:49:13.695 INFO:teuthology.orchestra.run.trial071.stdout:======================================================================================= 2026-02-17T11:49:13.695 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:49:13.695 INFO:teuthology.orchestra.run.trial071.stdout:======================================================================================= 2026-02-17T11:49:13.695 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:49:13.696 INFO:teuthology.orchestra.run.trial071.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.5 M 2026-02-17T11:49:13.696 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:13.696 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:49:13.696 INFO:teuthology.orchestra.run.trial071.stdout:======================================================================================= 2026-02-17T11:49:13.696 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:49:13.696 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:13.696 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 1.5 M 2026-02-17T11:49:13.696 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 7.6 M 2026-02-17T11:49:13.696 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:49:13.707 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:49:13.725 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:49:14.271 INFO:teuthology.orchestra.run.trial071.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 2.7 MB/s | 1.5 MB 00:00 2026-02-17T11:49:14.271 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:14.271 INFO:teuthology.orchestra.run.trial071.stdout:Total 2.7 MB/s | 1.5 MB 00:00 2026-02-17T11:49:14.271 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:49:14.273 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:49:14.273 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:49:14.294 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:49:14.294 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:49:14.409 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:49:14.426 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:49:14.484 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:49:14.541 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:49:14.541 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:14.541 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:49:14.541 INFO:teuthology.orchestra.run.trial071.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:14.541 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:14.541 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:49:14.568 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T11:49:14.873 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:49:14.955 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:49:14.955 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:49:14.955 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:49:14.955 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 200 M 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 200 M 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 893 M 2026-02-17T11:49:14.956 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:49:15.231 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:49:15.289 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:49:15.289 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:15.289 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:49:15.289 INFO:teuthology.orchestra.run.trial010.stdout: ceph-common-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:15.289 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:15.289 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:49:15.357 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T11:49:15.667 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:49:15.749 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:49:15.750 INFO:teuthology.orchestra.run.trial010.stdout:======================================================================================= 2026-02-17T11:49:15.750 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:49:15.750 INFO:teuthology.orchestra.run.trial010.stdout:======================================================================================= 2026-02-17T11:49:15.750 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:49:15.751 INFO:teuthology.orchestra.run.trial010.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.5 M 2026-02-17T11:49:15.751 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:15.751 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:49:15.751 INFO:teuthology.orchestra.run.trial010.stdout:======================================================================================= 2026-02-17T11:49:15.751 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:49:15.751 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:15.751 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 1.5 M 2026-02-17T11:49:15.751 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 7.6 M 2026-02-17T11:49:15.751 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:49:16.888 INFO:teuthology.orchestra.run.trial010.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 1.3 MB/s | 1.5 MB 00:01 2026-02-17T11:49:16.889 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:16.889 INFO:teuthology.orchestra.run.trial010.stdout:Total 1.3 MB/s | 1.5 MB 00:01 2026-02-17T11:49:16.889 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:49:16.890 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:49:16.891 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:49:16.912 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:49:16.912 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:49:17.030 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:49:17.047 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:49:17.105 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:49:17.162 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g 1/1 2026-02-17T11:49:17.163 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:17.163 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:49:17.163 INFO:teuthology.orchestra.run.trial010.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:17.163 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:17.163 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:49:17.189 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T11:49:17.497 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:01:53 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:49:17.578 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:49:17.578 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:49:17.579 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:49:17.579 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:49:17.579 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:49:17.579 INFO:teuthology.orchestra.run.trial010.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 200 M 2026-02-17T11:49:17.579 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:17.579 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:49:17.579 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:49:17.580 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:49:17.580 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:17.580 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 200 M 2026-02-17T11:49:17.580 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 893 M 2026-02-17T11:49:17.580 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:49:18.475 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:49:18.492 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:19.200 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:19.257 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:19.258 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:19.258 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:49:19.258 INFO:teuthology.orchestra.run.trial174.stdout: ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:19.258 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:19.258 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:49:19.301 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-test-debuginfo 2026-02-17T11:49:19.612 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:55 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:49:19.697 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:49:19.697 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:49:19.697 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:49:19.697 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:49:19.697 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:49:19.697 INFO:teuthology.orchestra.run.trial174.stdout: ceph-test-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 729 M 2026-02-17T11:49:19.698 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:19.698 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:49:19.698 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:49:19.698 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:49:19.698 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:49:19.698 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 729 M 2026-02-17T11:49:19.698 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 3.6 G 2026-02-17T11:49:19.698 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:49:27.370 INFO:teuthology.orchestra.run.trial071.stdout:ceph-radosgw-debuginfo-19.2.3-675.g3c96dfb3.el9 16 MB/s | 200 MB 00:12 2026-02-17T11:49:27.371 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:27.371 INFO:teuthology.orchestra.run.trial071.stdout:Total 16 MB/s | 200 MB 00:12 2026-02-17T11:49:27.371 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:49:27.372 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:49:27.373 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:49:27.980 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:49:27.980 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:49:34.281 INFO:teuthology.orchestra.run.trial153.stdout:ceph-test-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 33 MB/s | 729 MB 00:22 2026-02-17T11:49:34.282 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:34.282 INFO:teuthology.orchestra.run.trial153.stdout:Total 33 MB/s | 729 MB 00:22 2026-02-17T11:49:34.282 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:49:34.285 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:49:34.285 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:49:36.447 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:49:36.447 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:49:37.344 INFO:teuthology.orchestra.run.trial010.stdout:ceph-radosgw-debuginfo-19.2.3-675.g3c96dfb3.el9 10 MB/s | 200 MB 00:19 2026-02-17T11:49:37.345 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:37.345 INFO:teuthology.orchestra.run.trial010.stdout:Total 10 MB/s | 200 MB 00:19 2026-02-17T11:49:37.346 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:49:37.347 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:49:37.347 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:49:37.951 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:49:37.951 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:49:38.209 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:49:38.227 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:38.921 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:38.978 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:38.978 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:38.978 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:49:38.979 INFO:teuthology.orchestra.run.trial071.stdout: ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:38.979 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:38.979 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:49:39.023 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-test-debuginfo 2026-02-17T11:49:39.335 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:02:13 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:49:39.419 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:49:39.419 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:49:39.419 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:49:39.419 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:49:39.419 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:49:39.419 INFO:teuthology.orchestra.run.trial071.stdout: ceph-test-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 729 M 2026-02-17T11:49:39.420 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:39.420 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:49:39.420 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:49:39.420 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:49:39.420 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:49:39.420 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 729 M 2026-02-17T11:49:39.420 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 3.6 G 2026-02-17T11:49:39.420 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:49:48.001 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:49:48.019 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:48.703 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:48.760 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x8 1/1 2026-02-17T11:49:48.760 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:48.760 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:49:48.760 INFO:teuthology.orchestra.run.trial010.stdout: ceph-radosgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:48.760 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:48.760 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:49:48.803 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-test-debuginfo 2026-02-17T11:49:49.113 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:02:25 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:49:49.195 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:49:49.195 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:49:49.195 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout: ceph-test-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 729 M 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 729 M 2026-02-17T11:49:49.196 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 3.6 G 2026-02-17T11:49:49.197 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:49:59.381 INFO:teuthology.orchestra.run.trial174.stdout:ceph-test-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 18 MB/s | 729 MB 00:39 2026-02-17T11:49:59.382 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:59.382 INFO:teuthology.orchestra.run.trial174.stdout:Total 18 MB/s | 729 MB 00:39 2026-02-17T11:49:59.382 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:49:59.385 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:49:59.385 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:50:01.544 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:50:01.545 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:50:06.574 INFO:teuthology.orchestra.run.trial071.stdout:ceph-test-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 27 MB/s | 729 MB 00:27 2026-02-17T11:50:06.574 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:06.575 INFO:teuthology.orchestra.run.trial071.stdout:Total 27 MB/s | 729 MB 00:27 2026-02-17T11:50:06.575 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:50:06.577 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:50:06.577 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:50:08.739 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:50:08.739 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:50:14.867 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:50:14.887 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:15.568 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:15.626 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:15.626 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:15.626 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:50:15.626 INFO:teuthology.orchestra.run.trial153.stdout: ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:15.626 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:15.626 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:50:15.723 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:50:16.035 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:02:55 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:50:16.099 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:50:16.118 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:50:16.118 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T11:50:16.118 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:50:16.139 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T11:50:16.451 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:02:55 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:50:16.534 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:50:16.534 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:16.534 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:50:16.534 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 18 M 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 18 M 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 110 M 2026-02-17T11:50:16.535 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:50:17.051 INFO:teuthology.orchestra.run.trial153.stdout:ceph-mgr-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 35 MB/s | 18 MB 00:00 2026-02-17T11:50:17.052 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:17.052 INFO:teuthology.orchestra.run.trial153.stdout:Total 35 MB/s | 18 MB 00:00 2026-02-17T11:50:17.052 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:50:17.053 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:50:17.054 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:50:17.125 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:50:17.125 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:50:18.182 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:50:18.200 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:18.326 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:18.383 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:18.383 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:18.383 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:50:18.383 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:18.383 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:18.383 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:50:18.411 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T11:50:18.724 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:02:57 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:50:18.805 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 55 M 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 55 M 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 211 M 2026-02-17T11:50:18.806 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:50:20.213 INFO:teuthology.orchestra.run.trial153.stdout:ceph-mds-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 39 MB/s | 55 MB 00:01 2026-02-17T11:50:20.213 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:20.214 INFO:teuthology.orchestra.run.trial153.stdout:Total 39 MB/s | 55 MB 00:01 2026-02-17T11:50:20.214 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:50:20.215 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:50:20.216 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:50:20.396 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:50:20.396 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:50:23.208 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:50:23.226 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:23.419 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:23.475 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:23.475 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:23.476 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:50:23.476 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:23.476 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:23.476 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:50:23.508 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T11:50:23.661 INFO:teuthology.orchestra.run.trial010.stdout:ceph-test-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 21 MB/s | 729 MB 00:34 2026-02-17T11:50:23.662 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:23.662 INFO:teuthology.orchestra.run.trial010.stdout:Total 21 MB/s | 729 MB 00:34 2026-02-17T11:50:23.662 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:50:23.665 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:50:23.665 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:50:23.813 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:02 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:50:23.895 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 102 M 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 102 M 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 497 M 2026-02-17T11:50:23.896 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:50:25.828 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:50:25.829 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:50:26.573 INFO:teuthology.orchestra.run.trial153.stdout:ceph-mon-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 38 MB/s | 102 MB 00:02 2026-02-17T11:50:26.574 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:26.574 INFO:teuthology.orchestra.run.trial153.stdout:Total 38 MB/s | 102 MB 00:02 2026-02-17T11:50:26.574 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:50:26.575 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:50:26.575 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:50:26.893 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:50:26.893 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:50:32.135 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:50:32.152 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:32.553 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:32.609 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:32.609 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:32.610 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:50:32.610 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:32.610 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:32.610 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:50:32.645 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T11:50:32.953 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:11 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:50:33.034 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 298 M 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 298 M 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 1.4 G 2026-02-17T11:50:33.035 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:50:38.743 INFO:teuthology.orchestra.run.trial153.stdout:ceph-osd-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 52 MB/s | 298 MB 00:05 2026-02-17T11:50:38.744 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:38.744 INFO:teuthology.orchestra.run.trial153.stdout:Total 52 MB/s | 298 MB 00:05 2026-02-17T11:50:38.744 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:50:38.746 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:50:38.746 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:50:39.637 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:50:39.638 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:50:39.989 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:50:40.009 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:40.361 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:40.419 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:40.419 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:40.419 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:50:40.419 INFO:teuthology.orchestra.run.trial174.stdout: ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:40.419 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:40.420 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:50:40.513 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:50:40.825 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:03:16 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:50:40.890 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:50:40.907 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-17T11:50:40.908 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:50:40.930 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T11:50:41.236 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:03:17 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:50:41.318 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:50:41.318 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 18 M 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:41.319 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 18 M 2026-02-17T11:50:41.320 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 110 M 2026-02-17T11:50:41.320 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:50:41.742 INFO:teuthology.orchestra.run.trial174.stdout:ceph-mgr-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 43 MB/s | 18 MB 00:00 2026-02-17T11:50:41.743 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:41.743 INFO:teuthology.orchestra.run.trial174.stdout:Total 42 MB/s | 18 MB 00:00 2026-02-17T11:50:41.743 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:50:41.745 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:50:41.745 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:50:41.817 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:50:41.817 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:50:42.867 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:50:42.885 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:43.014 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:43.071 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:43.071 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:43.071 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:50:43.071 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:43.071 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:43.071 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:50:43.098 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T11:50:43.413 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:03:19 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:50:43.498 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:50:43.498 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:43.498 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:50:43.498 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 55 M 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 55 M 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 211 M 2026-02-17T11:50:43.499 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:50:44.611 INFO:teuthology.orchestra.run.trial174.stdout:ceph-mds-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 50 MB/s | 55 MB 00:01 2026-02-17T11:50:44.612 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:44.612 INFO:teuthology.orchestra.run.trial174.stdout:Total 50 MB/s | 55 MB 00:01 2026-02-17T11:50:44.612 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:50:44.614 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:50:44.615 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:50:44.794 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:50:44.794 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:50:47.106 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:50:47.126 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:47.461 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:50:47.478 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:47.683 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:47.740 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:47.740 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:47.740 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:50:47.740 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:47.741 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:47.741 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:50:47.770 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T11:50:48.083 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:03:24 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:50:48.168 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:50:48.168 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 102 M 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 102 M 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 497 M 2026-02-17T11:50:48.169 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:50:49.465 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:49.522 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:49.522 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:49.522 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:50:49.523 INFO:teuthology.orchestra.run.trial071.stdout: ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:49.523 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:49.523 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:50:49.620 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:50:49.935 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:03:23 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:50:50.002 INFO:teuthology.orchestra.run.trial071.stdout:Package ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:50:50.020 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:50:50.020 INFO:teuthology.orchestra.run.trial071.stdout:Nothing to do. 2026-02-17T11:50:50.021 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:50:50.043 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T11:50:50.154 INFO:teuthology.orchestra.run.trial174.stdout:ceph-mon-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 51 MB/s | 102 MB 00:01 2026-02-17T11:50:50.155 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:50.155 INFO:teuthology.orchestra.run.trial174.stdout:Total 51 MB/s | 102 MB 00:01 2026-02-17T11:50:50.155 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:50:50.157 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:50:50.157 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:50:50.358 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:03:24 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:50:50.441 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:50:50.441 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:50:50.441 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:50:50.441 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:50:50.441 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:50:50.441 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 18 M 2026-02-17T11:50:50.442 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:50.442 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:50:50.442 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:50:50.442 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:50:50.442 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:50.442 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 18 M 2026-02-17T11:50:50.442 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 110 M 2026-02-17T11:50:50.442 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:50:50.475 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:50:50.475 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:50:50.865 INFO:teuthology.orchestra.run.trial071.stdout:ceph-mgr-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 42 MB/s | 18 MB 00:00 2026-02-17T11:50:50.866 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:50.866 INFO:teuthology.orchestra.run.trial071.stdout:Total 42 MB/s | 18 MB 00:00 2026-02-17T11:50:50.866 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:50:50.868 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:50:50.868 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:50:50.939 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:50:51.955 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:50:51.973 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:52.118 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:52.176 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:52.177 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:52.177 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:50:52.177 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:52.177 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:52.177 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:50:52.205 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T11:50:52.517 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:03:26 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:50:52.600 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:50:52.600 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:50:52.600 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:50:52.600 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 55 M 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 55 M 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 211 M 2026-02-17T11:50:52.601 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:50:53.722 INFO:teuthology.orchestra.run.trial071.stdout:ceph-mds-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 49 MB/s | 55 MB 00:01 2026-02-17T11:50:53.723 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:53.723 INFO:teuthology.orchestra.run.trial071.stdout:Total 49 MB/s | 55 MB 00:01 2026-02-17T11:50:53.724 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:50:53.725 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:50:53.725 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:50:53.905 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:50:53.905 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:50:54.653 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:50:54.671 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:55.678 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:50:55.679 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:55.696 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:55.736 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:55.736 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:55.736 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:50:55.736 INFO:teuthology.orchestra.run.trial153.stdout: ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:55.736 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:55.736 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:50:55.789 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T11:50:56.100 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:35 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:50:56.128 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:56.182 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:50:56.183 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:56.183 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:50:56.183 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:56.183 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:50:56.183 INFO:teuthology.orchestra.run.trial153.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.8 M 2026-02-17T11:50:56.183 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:56.183 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:50:56.183 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:56.183 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:50:56.184 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:56.184 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 6.8 M 2026-02-17T11:50:56.184 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 36 M 2026-02-17T11:50:56.184 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:50:56.189 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:56.190 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:56.190 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:50:56.190 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:56.190 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:56.190 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:50:56.224 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T11:50:56.403 INFO:teuthology.orchestra.run.trial153.stdout:ceph-fuse-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 31 MB/s | 6.8 MB 00:00 2026-02-17T11:50:56.403 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:56.404 INFO:teuthology.orchestra.run.trial153.stdout:Total 31 MB/s | 6.8 MB 00:00 2026-02-17T11:50:56.404 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:50:56.405 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:50:56.405 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:50:56.443 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:50:56.444 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:50:56.533 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:03:32 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:50:56.578 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:50:56.596 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:56.614 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:50:56.614 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 298 M 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 298 M 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 1.4 G 2026-02-17T11:50:56.615 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:50:56.804 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:56.841 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:50:56.859 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:56.861 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:50:56.861 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:56.861 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:50:56.861 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:56.862 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:56.862 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:50:56.893 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T11:50:56.940 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:56.997 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:50:56.998 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:56.998 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:50:56.998 INFO:teuthology.orchestra.run.trial153.stdout: ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:56.998 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:56.998 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:50:57.025 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install librados-devel-debuginfo 2026-02-17T11:50:57.206 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:03:31 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 102 M 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 102 M 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 497 M 2026-02-17T11:50:57.291 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:50:57.330 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:36 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:50:57.410 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout: librados-devel-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 112 k 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 112 k 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 493 k 2026-02-17T11:50:57.411 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:50:57.774 INFO:teuthology.orchestra.run.trial153.stdout:librados-devel-debuginfo-19.2.3-675.g3c96dfb3.e 308 kB/s | 112 kB 00:00 2026-02-17T11:50:57.775 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:57.775 INFO:teuthology.orchestra.run.trial153.stdout:Total 308 kB/s | 112 kB 00:00 2026-02-17T11:50:57.775 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:50:57.777 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:50:57.777 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:50:57.796 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:50:57.797 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:50:57.835 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:50:57.853 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:50:57.906 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:50:57.963 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:50:57.963 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:57.963 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:50:57.963 INFO:teuthology.orchestra.run.trial153.stdout: librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:57.963 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:57.963 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:50:57.989 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T11:50:58.300 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:37 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:50:58.382 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:50:58.382 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:58.382 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.0 M 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 6.0 M 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 31 M 2026-02-17T11:50:58.383 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:50:59.403 INFO:teuthology.orchestra.run.trial153.stdout:libcephfs2-debuginfo-19.2.3-675.g3c96dfb3.el9.x 5.9 MB/s | 6.0 MB 00:01 2026-02-17T11:50:59.403 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:50:59.404 INFO:teuthology.orchestra.run.trial153.stdout:Total 5.9 MB/s | 6.0 MB 00:01 2026-02-17T11:50:59.404 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:50:59.406 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:50:59.406 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:50:59.442 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:50:59.442 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:50:59.787 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:50:59.805 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:50:59.883 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:50:59.940 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:50:59.940 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:59.940 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:50:59.940 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:50:59.941 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:50:59.941 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:50:59.966 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install librados2-debuginfo 2026-02-17T11:51:00.273 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:39 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:51:00.356 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:51:00.356 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:00.356 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:51:00.356 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout: librados2-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 47 M 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 47 M 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 302 M 2026-02-17T11:51:00.357 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:51:02.752 INFO:teuthology.orchestra.run.trial153.stdout:librados2-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 20 MB/s | 47 MB 00:02 2026-02-17T11:51:02.752 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:02.753 INFO:teuthology.orchestra.run.trial153.stdout:Total 20 MB/s | 47 MB 00:02 2026-02-17T11:51:02.753 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:51:02.754 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:51:02.755 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:51:02.913 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:51:02.913 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:51:04.044 INFO:teuthology.orchestra.run.trial174.stdout:ceph-osd-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 40 MB/s | 298 MB 00:07 2026-02-17T11:51:04.045 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:04.045 INFO:teuthology.orchestra.run.trial174.stdout:Total 40 MB/s | 298 MB 00:07 2026-02-17T11:51:04.045 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:04.047 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:04.047 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:04.336 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:51:04.355 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:04.747 INFO:teuthology.orchestra.run.trial071.stdout:ceph-mon-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 14 MB/s | 102 MB 00:07 2026-02-17T11:51:04.748 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:04.748 INFO:teuthology.orchestra.run.trial071.stdout:Total 14 MB/s | 102 MB 00:07 2026-02-17T11:51:04.748 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:04.750 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:04.750 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:04.941 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:04.941 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:05.067 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:05.067 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:05.552 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:51:05.570 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:05.848 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:05.906 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:05.906 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:05.906 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:51:05.906 INFO:teuthology.orchestra.run.trial153.stdout: librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:05.906 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:05.906 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:51:05.939 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install librbd1-debuginfo 2026-02-17T11:51:06.249 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:45 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:51:06.332 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:51:06.333 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:06.333 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:51:06.333 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:06.333 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:51:06.333 INFO:teuthology.orchestra.run.trial153.stdout: librbd1-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 54 M 2026-02-17T11:51:06.333 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:06.333 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:51:06.334 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:06.334 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:51:06.334 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:06.334 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 54 M 2026-02-17T11:51:06.334 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 374 M 2026-02-17T11:51:06.334 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:51:06.786 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:06.844 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:06.844 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:06.844 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:51:06.844 INFO:teuthology.orchestra.run.trial010.stdout: ceph-test-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:06.844 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:06.844 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:51:06.942 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:51:07.259 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:03:43 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:07.323 INFO:teuthology.orchestra.run.trial010.stdout:Package ceph-base-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:51:07.341 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:51:07.341 INFO:teuthology.orchestra.run.trial010.stdout:Nothing to do. 2026-02-17T11:51:07.342 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:51:07.363 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T11:51:07.678 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:03:43 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 18 M 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:07.761 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:51:07.762 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:07.762 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 18 M 2026-02-17T11:51:07.762 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 110 M 2026-02-17T11:51:07.762 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:51:10.292 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:10.309 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:10.688 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:10.745 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:10.745 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:10.745 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:10.746 INFO:teuthology.orchestra.run.trial071.stdout: ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:10.746 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:10.746 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:10.780 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T11:51:11.096 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:03:45 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:11.180 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:11.181 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:11.181 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:11.181 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:11.181 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:11.181 INFO:teuthology.orchestra.run.trial071.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 298 M 2026-02-17T11:51:11.181 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:11.181 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:11.182 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:11.182 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:11.182 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:11.182 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 298 M 2026-02-17T11:51:11.182 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 1.4 G 2026-02-17T11:51:11.182 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:12.288 INFO:teuthology.orchestra.run.trial010.stdout:ceph-mgr-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 4.0 MB/s | 18 MB 00:04 2026-02-17T11:51:12.288 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:12.289 INFO:teuthology.orchestra.run.trial010.stdout:Total 4.0 MB/s | 18 MB 00:04 2026-02-17T11:51:12.289 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:51:12.290 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:51:12.290 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:51:12.361 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:51:12.361 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:51:13.373 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:51:13.390 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:13.525 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:13.583 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:13.583 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:13.583 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:51:13.583 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:13.583 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:13.583 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:51:13.610 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T11:51:13.839 INFO:teuthology.orchestra.run.trial153.stdout:librbd1-debuginfo-19.2.3-675.g3c96dfb3.el9.x86_ 7.3 MB/s | 54 MB 00:07 2026-02-17T11:51:13.839 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:13.840 INFO:teuthology.orchestra.run.trial153.stdout:Total 7.3 MB/s | 54 MB 00:07 2026-02-17T11:51:13.840 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:51:13.842 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:51:13.842 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:51:13.930 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:03:49 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:14.012 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:51:14.013 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:14.013 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:51:14.013 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:14.013 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:51:14.013 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 55 M 2026-02-17T11:51:14.013 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:14.013 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:51:14.013 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:14.014 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:51:14.014 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:14.014 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 55 M 2026-02-17T11:51:14.014 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 211 M 2026-02-17T11:51:14.014 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:51:14.022 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:51:14.022 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:51:16.385 INFO:teuthology.orchestra.run.trial010.stdout:ceph-mds-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 23 MB/s | 55 MB 00:02 2026-02-17T11:51:16.386 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:16.386 INFO:teuthology.orchestra.run.trial010.stdout:Total 23 MB/s | 55 MB 00:02 2026-02-17T11:51:16.386 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:51:16.388 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:51:16.388 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:51:16.568 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:51:16.569 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:51:17.181 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:51:17.199 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:17.507 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:17.565 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:17.566 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:17.566 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:51:17.566 INFO:teuthology.orchestra.run.trial153.stdout: librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:17.566 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:17.566 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:51:17.599 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T11:51:17.908 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:56 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:51:17.990 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:51:17.990 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:17.991 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:51:17.991 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:17.991 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:51:17.991 INFO:teuthology.orchestra.run.trial153.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 628 k 2026-02-17T11:51:17.991 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:17.991 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:51:17.991 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:17.991 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:51:17.991 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:17.992 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 628 k 2026-02-17T11:51:17.992 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 2.1 M 2026-02-17T11:51:17.992 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:51:18.267 INFO:teuthology.orchestra.run.trial153.stdout:python3-cephfs-debuginfo-19.2.3-675.g3c96dfb3.e 2.2 MB/s | 628 kB 00:00 2026-02-17T11:51:18.268 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:18.268 INFO:teuthology.orchestra.run.trial153.stdout:Total 2.2 MB/s | 628 kB 00:00 2026-02-17T11:51:18.268 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:51:18.270 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:51:18.270 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:51:18.290 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:51:18.290 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:51:18.353 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:51:18.370 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:18.430 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:18.488 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:18.489 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:18.489 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:51:18.489 INFO:teuthology.orchestra.run.trial153.stdout: python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:18.489 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:18.489 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:51:18.516 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-rados-debuginfo 2026-02-17T11:51:18.826 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:57 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:51:18.907 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout: python3-rados-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 779 k 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 779 k 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 2.8 M 2026-02-17T11:51:18.908 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:51:19.007 INFO:teuthology.orchestra.run.trial071.stdout:ceph-osd-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 38 MB/s | 298 MB 00:07 2026-02-17T11:51:19.009 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:19.009 INFO:teuthology.orchestra.run.trial071.stdout:Total 38 MB/s | 298 MB 00:07 2026-02-17T11:51:19.009 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:19.010 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:19.011 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:19.016 INFO:teuthology.orchestra.run.trial153.stdout:python3-rados-debuginfo-19.2.3-675.g3c96dfb3.el 7.1 MB/s | 779 kB 00:00 2026-02-17T11:51:19.017 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:19.017 INFO:teuthology.orchestra.run.trial153.stdout:Total 7.0 MB/s | 779 kB 00:00 2026-02-17T11:51:19.017 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:51:19.019 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:51:19.019 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:51:19.039 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:51:19.039 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:51:19.112 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:51:19.129 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:51:19.185 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:51:19.237 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:51:19.242 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:51:19.242 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:19.242 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:51:19.242 INFO:teuthology.orchestra.run.trial153.stdout: python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:19.242 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:19.242 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:51:19.254 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:19.267 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T11:51:19.468 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:19.525 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:19.526 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:19.526 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:51:19.526 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mds-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:19.526 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:19.526 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:51:19.558 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T11:51:19.578 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:58 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:51:19.662 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:51:19.662 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:19.662 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:51:19.662 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:19.662 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:51:19.663 INFO:teuthology.orchestra.run.trial153.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:51:19.663 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:19.663 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:51:19.663 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:19.663 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:51:19.663 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:19.663 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 1.1 M 2026-02-17T11:51:19.663 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 4.3 M 2026-02-17T11:51:19.663 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:51:19.780 INFO:teuthology.orchestra.run.trial153.stdout:python3-rbd-debuginfo-19.2.3-675.g3c96dfb3.el9. 9.6 MB/s | 1.1 MB 00:00 2026-02-17T11:51:19.781 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:19.781 INFO:teuthology.orchestra.run.trial153.stdout:Total 9.5 MB/s | 1.1 MB 00:00 2026-02-17T11:51:19.782 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:51:19.783 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:51:19.783 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:51:19.805 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:51:19.805 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:51:19.870 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:03:55 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:19.894 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:51:19.900 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:19.900 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:19.911 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:19.952 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:51:19.953 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 102 M 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:19.954 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 102 M 2026-02-17T11:51:19.955 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 497 M 2026-02-17T11:51:19.955 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:51:19.974 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:20.032 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:20.033 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:20.033 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:51:20.033 INFO:teuthology.orchestra.run.trial153.stdout: python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:20.033 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:20.033 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:51:20.060 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T11:51:20.207 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:20.225 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:20.372 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:03:59 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:51:20.455 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:51:20.455 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:20.455 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 339 k 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 339 k 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 1.0 M 2026-02-17T11:51:20.456 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:51:20.870 INFO:teuthology.orchestra.run.trial153.stdout:python3-rgw-debuginfo-19.2.3-675.g3c96dfb3.el9. 818 kB/s | 339 kB 00:00 2026-02-17T11:51:20.870 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:20.870 INFO:teuthology.orchestra.run.trial153.stdout:Total 817 kB/s | 339 kB 00:00 2026-02-17T11:51:20.871 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:51:20.872 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:51:20.872 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:51:20.892 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:51:20.892 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:51:20.941 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:51:20.958 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:21.014 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:21.071 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:21.071 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:21.071 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:51:21.071 INFO:teuthology.orchestra.run.trial153.stdout: python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:21.072 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:21.072 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:51:21.099 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T11:51:21.300 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:21.357 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:21.357 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:21.357 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:21.357 INFO:teuthology.orchestra.run.trial174.stdout: ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:21.357 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:21.357 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:21.409 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:04:00 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:51:21.412 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T11:51:21.491 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 547 k 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 547 k 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 3.0 M 2026-02-17T11:51:21.492 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:51:21.719 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:03:57 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:21.803 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:21.803 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:21.803 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:21.804 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:21.804 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:21.804 INFO:teuthology.orchestra.run.trial174.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.8 M 2026-02-17T11:51:21.804 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:21.804 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:21.804 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:21.805 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:21.805 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:21.805 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 6.8 M 2026-02-17T11:51:21.805 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 36 M 2026-02-17T11:51:21.805 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:21.833 INFO:teuthology.orchestra.run.trial153.stdout:rbd-fuse-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 1.6 MB/s | 547 kB 00:00 2026-02-17T11:51:21.833 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:21.833 INFO:teuthology.orchestra.run.trial153.stdout:Total 1.6 MB/s | 547 kB 00:00 2026-02-17T11:51:21.833 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:51:21.835 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:51:21.835 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:51:21.854 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:51:21.854 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:51:21.917 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:51:21.934 INFO:teuthology.orchestra.run.trial153.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:21.948 INFO:teuthology.orchestra.run.trial010.stdout:ceph-mon-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 51 MB/s | 102 MB 00:01 2026-02-17T11:51:21.949 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:21.949 INFO:teuthology.orchestra.run.trial010.stdout:Total 51 MB/s | 102 MB 00:01 2026-02-17T11:51:21.950 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:51:21.951 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:51:21.951 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:51:21.990 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:22.020 INFO:teuthology.orchestra.run.trial174.stdout:ceph-fuse-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 32 MB/s | 6.8 MB 00:00 2026-02-17T11:51:22.021 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:22.021 INFO:teuthology.orchestra.run.trial174.stdout:Total 31 MB/s | 6.8 MB 00:00 2026-02-17T11:51:22.021 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:22.022 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:22.022 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:22.048 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:22.048 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:22.048 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:51:22.048 INFO:teuthology.orchestra.run.trial153.stdout: rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:22.048 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:22.048 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:51:22.060 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:22.061 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:22.076 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T11:51:22.268 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:51:22.268 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:51:22.386 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:04:01 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:51:22.450 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:22.467 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:22.470 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:51:22.470 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:22.470 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:51:22.470 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:22.471 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:51:22.471 INFO:teuthology.orchestra.run.trial153.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 54 M 2026-02-17T11:51:22.471 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:22.471 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:51:22.471 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:22.472 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:51:22.472 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:22.472 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 54 M 2026-02-17T11:51:22.472 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 353 M 2026-02-17T11:51:22.472 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:51:22.553 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:22.611 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:22.611 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:22.611 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:22.612 INFO:teuthology.orchestra.run.trial174.stdout: ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:22.612 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:22.612 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:22.639 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librados-devel-debuginfo 2026-02-17T11:51:22.948 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:03:58 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:23.031 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:23.031 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:23.032 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:23.032 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:23.032 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:23.032 INFO:teuthology.orchestra.run.trial174.stdout: librados-devel-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 112 k 2026-02-17T11:51:23.032 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:23.032 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:23.032 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:23.032 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:23.032 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:23.033 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 112 k 2026-02-17T11:51:23.033 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 493 k 2026-02-17T11:51:23.033 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:23.412 INFO:teuthology.orchestra.run.trial174.stdout:librados-devel-debuginfo-19.2.3-675.g3c96dfb3.e 294 kB/s | 112 kB 00:00 2026-02-17T11:51:23.412 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:23.413 INFO:teuthology.orchestra.run.trial174.stdout:Total 294 kB/s | 112 kB 00:00 2026-02-17T11:51:23.413 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:23.414 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:23.414 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:23.434 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:23.434 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:23.473 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:23.490 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:23.543 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:23.556 INFO:teuthology.orchestra.run.trial153.stdout:rbd-mirror-debuginfo-19.2.3-675.g3c96dfb3.el9.x 49 MB/s | 54 MB 00:01 2026-02-17T11:51:23.557 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:23.557 INFO:teuthology.orchestra.run.trial153.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-17T11:51:23.557 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:51:23.559 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:51:23.559 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:51:23.601 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:23.601 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:23.601 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:23.601 INFO:teuthology.orchestra.run.trial174.stdout: librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:23.601 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:23.601 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:23.629 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T11:51:23.735 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:51:23.735 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:51:23.937 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:03:59 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:24.022 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:24.022 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:24.022 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:24.022 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:24.022 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:24.022 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.0 M 2026-02-17T11:51:24.022 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:24.023 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:24.023 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:24.023 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:24.023 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:24.023 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 6.0 M 2026-02-17T11:51:24.023 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 31 M 2026-02-17T11:51:24.023 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:24.227 INFO:teuthology.orchestra.run.trial174.stdout:libcephfs2-debuginfo-19.2.3-675.g3c96dfb3.el9.x 29 MB/s | 6.0 MB 00:00 2026-02-17T11:51:24.227 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:24.228 INFO:teuthology.orchestra.run.trial174.stdout:Total 29 MB/s | 6.0 MB 00:00 2026-02-17T11:51:24.228 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:24.229 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:24.229 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:24.265 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:24.265 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:24.614 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:24.632 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:24.709 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:24.767 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:24.767 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:24.767 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:24.768 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:24.768 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:24.768 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:24.793 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librados2-debuginfo 2026-02-17T11:51:25.105 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:04:01 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:25.190 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:25.190 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:25.190 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:25.190 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:25.190 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:25.191 INFO:teuthology.orchestra.run.trial174.stdout: librados2-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 47 M 2026-02-17T11:51:25.191 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:25.191 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:25.191 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:25.191 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:25.191 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:25.191 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 47 M 2026-02-17T11:51:25.191 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 302 M 2026-02-17T11:51:25.191 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:26.158 INFO:teuthology.orchestra.run.trial174.stdout:librados2-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 49 MB/s | 47 MB 00:00 2026-02-17T11:51:26.159 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:26.159 INFO:teuthology.orchestra.run.trial174.stdout:Total 49 MB/s | 47 MB 00:00 2026-02-17T11:51:26.159 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:26.161 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:26.161 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:26.318 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:26.318 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:26.891 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:51:26.909 INFO:teuthology.orchestra.run.trial153.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:27.225 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:27.283 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:27.283 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:27.283 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:51:27.284 INFO:teuthology.orchestra.run.trial153.stdout: rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:27.284 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:27.284 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:51:27.315 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T11:51:27.593 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:51:27.610 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:27.630 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:04:06 ago on Tue 17 Feb 2026 11:47:21 AM UTC. 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.4 M 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T11:51:27.712 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T11:51:27.713 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:27.713 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 1.4 M 2026-02-17T11:51:27.713 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 6.6 M 2026-02-17T11:51:27.713 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T11:51:27.832 INFO:teuthology.orchestra.run.trial153.stdout:rbd-nbd-debuginfo-19.2.3-675.g3c96dfb3.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T11:51:27.833 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:27.833 INFO:teuthology.orchestra.run.trial153.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T11:51:27.834 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T11:51:27.835 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T11:51:27.835 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T11:51:27.858 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T11:51:27.858 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T11:51:27.962 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T11:51:27.979 INFO:teuthology.orchestra.run.trial153.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:28.021 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:28.039 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:28.079 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:28.079 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:28.079 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:51:28.079 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mon-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:28.079 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:28.079 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:51:28.097 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:28.097 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:28.097 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T11:51:28.097 INFO:teuthology.orchestra.run.trial153.stdout: rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:28.097 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:51:28.097 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T11:51:28.115 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T11:51:28.131 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:28.425 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:04 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:28.507 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:51:28.508 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:28.508 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:51:28.508 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:28.508 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:51:28.508 INFO:teuthology.orchestra.run.trial010.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 298 M 2026-02-17T11:51:28.509 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:28.509 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:51:28.509 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:28.509 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:51:28.509 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:28.509 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 298 M 2026-02-17T11:51:28.509 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 1.4 G 2026-02-17T11:51:28.509 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:51:29.003 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:29.021 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:29.286 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:29.344 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:29.344 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:29.344 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:29.344 INFO:teuthology.orchestra.run.trial174.stdout: librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:29.344 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:29.344 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:29.375 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librbd1-debuginfo 2026-02-17T11:51:29.691 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:04:05 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:29.774 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:29.775 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:29.775 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:29.775 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:29.775 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:29.775 INFO:teuthology.orchestra.run.trial174.stdout: librbd1-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 54 M 2026-02-17T11:51:29.775 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:29.775 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:29.775 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:29.776 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:29.776 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:29.776 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 54 M 2026-02-17T11:51:29.776 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 374 M 2026-02-17T11:51:29.776 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:34.735 INFO:teuthology.orchestra.run.trial174.stdout:librbd1-debuginfo-19.2.3-675.g3c96dfb3.el9.x86_ 11 MB/s | 54 MB 00:04 2026-02-17T11:51:34.736 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:34.736 INFO:teuthology.orchestra.run.trial174.stdout:Total 11 MB/s | 54 MB 00:04 2026-02-17T11:51:34.736 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:34.738 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:34.738 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:34.919 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:34.919 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:34.926 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:34.943 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:35.016 INFO:teuthology.orchestra.run.trial010.stdout:ceph-osd-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 46 MB/s | 298 MB 00:06 2026-02-17T11:51:35.017 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:35.017 INFO:teuthology.orchestra.run.trial010.stdout:Total 46 MB/s | 298 MB 00:06 2026-02-17T11:51:35.017 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:51:35.019 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:51:35.020 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:51:35.914 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:51:35.915 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:51:35.966 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:36.023 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:36.023 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:36.023 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:36.023 INFO:teuthology.orchestra.run.trial071.stdout: ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:36.024 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:36.024 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:36.079 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T11:51:36.392 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:10 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:36.475 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:36.475 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:36.475 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.8 M 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 6.8 M 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 36 M 2026-02-17T11:51:36.476 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:36.702 INFO:teuthology.orchestra.run.trial071.stdout:ceph-fuse-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 30 MB/s | 6.8 MB 00:00 2026-02-17T11:51:36.702 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:36.702 INFO:teuthology.orchestra.run.trial071.stdout:Total 30 MB/s | 6.8 MB 00:00 2026-02-17T11:51:36.702 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:36.704 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:36.704 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:36.741 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:36.742 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:37.135 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:37.152 INFO:teuthology.orchestra.run.trial071.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:37.238 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:37.296 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:37.296 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:37.297 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:37.297 INFO:teuthology.orchestra.run.trial071.stdout: ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:37.297 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:37.297 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:37.322 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install librados-devel-debuginfo 2026-02-17T11:51:37.637 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:11 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:37.719 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:37.719 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:37.719 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:37.719 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:37.719 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:37.719 INFO:teuthology.orchestra.run.trial071.stdout: librados-devel-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 112 k 2026-02-17T11:51:37.719 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:37.720 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:37.720 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:37.720 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:37.720 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:37.720 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 112 k 2026-02-17T11:51:37.720 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 493 k 2026-02-17T11:51:37.720 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:37.804 INFO:teuthology.orchestra.run.trial071.stdout:librados-devel-debuginfo-19.2.3-675.g3c96dfb3.e 1.3 MB/s | 112 kB 00:00 2026-02-17T11:51:37.805 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:37.805 INFO:teuthology.orchestra.run.trial071.stdout:Total 1.3 MB/s | 112 kB 00:00 2026-02-17T11:51:37.806 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:37.807 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:37.807 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:37.825 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:37.825 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:37.864 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:37.881 INFO:teuthology.orchestra.run.trial071.stdout: Installing : librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:37.935 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:37.992 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:37.992 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:37.992 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:37.993 INFO:teuthology.orchestra.run.trial071.stdout: librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:37.993 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:37.993 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:38.018 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T11:51:38.102 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:38.120 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:38.325 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:12 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:38.409 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:38.410 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:38.410 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.0 M 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 6.0 M 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 31 M 2026-02-17T11:51:38.411 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:38.450 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:38.508 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:38.508 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:38.508 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:38.508 INFO:teuthology.orchestra.run.trial174.stdout: librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:38.508 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:38.508 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:38.540 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T11:51:38.611 INFO:teuthology.orchestra.run.trial071.stdout:libcephfs2-debuginfo-19.2.3-675.g3c96dfb3.el9.x 30 MB/s | 6.0 MB 00:00 2026-02-17T11:51:38.612 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:38.612 INFO:teuthology.orchestra.run.trial071.stdout:Total 30 MB/s | 6.0 MB 00:00 2026-02-17T11:51:38.612 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:38.614 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:38.614 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:38.649 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:38.649 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:38.849 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:04:14 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:38.931 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:38.931 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:38.931 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:38.931 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 628 k 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 628 k 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 2.1 M 2026-02-17T11:51:38.932 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:39.003 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:39.020 INFO:teuthology.orchestra.run.trial071.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:39.039 INFO:teuthology.orchestra.run.trial174.stdout:python3-cephfs-debuginfo-19.2.3-675.g3c96dfb3.e 5.7 MB/s | 628 kB 00:00 2026-02-17T11:51:39.040 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:39.040 INFO:teuthology.orchestra.run.trial174.stdout:Total 5.6 MB/s | 628 kB 00:00 2026-02-17T11:51:39.040 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:39.042 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:39.042 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:39.062 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:39.062 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:39.096 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:39.126 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:39.143 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:39.154 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:39.154 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:39.154 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:39.154 INFO:teuthology.orchestra.run.trial071.stdout: libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:39.154 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:39.154 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:39.180 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install librados2-debuginfo 2026-02-17T11:51:39.199 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:39.256 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:39.256 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:39.256 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:39.257 INFO:teuthology.orchestra.run.trial174.stdout: python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:39.257 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:39.257 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:39.283 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rados-debuginfo 2026-02-17T11:51:39.490 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:13 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:39.573 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:39.573 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:39.573 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:39.573 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:39.573 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:39.573 INFO:teuthology.orchestra.run.trial071.stdout: librados2-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 47 M 2026-02-17T11:51:39.574 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:39.574 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:39.574 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:39.574 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:39.574 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:39.574 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 47 M 2026-02-17T11:51:39.574 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 302 M 2026-02-17T11:51:39.574 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:39.593 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:04:15 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:39.675 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout: python3-rados-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 779 k 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 779 k 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 2.8 M 2026-02-17T11:51:39.676 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:40.315 INFO:teuthology.orchestra.run.trial174.stdout:python3-rados-debuginfo-19.2.3-675.g3c96dfb3.el 1.2 MB/s | 779 kB 00:00 2026-02-17T11:51:40.317 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:40.318 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.2 MB/s | 779 kB 00:00 2026-02-17T11:51:40.318 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:40.320 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:40.320 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:40.340 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:40.340 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:40.411 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:40.428 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:51:40.484 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:51:40.542 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:51:40.542 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:40.542 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:40.542 INFO:teuthology.orchestra.run.trial174.stdout: python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:40.542 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:40.542 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:40.549 INFO:teuthology.orchestra.run.trial071.stdout:librados2-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 48 MB/s | 47 MB 00:00 2026-02-17T11:51:40.549 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:40.549 INFO:teuthology.orchestra.run.trial071.stdout:Total 48 MB/s | 47 MB 00:00 2026-02-17T11:51:40.550 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:40.551 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:40.552 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:40.567 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T11:51:40.709 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:40.709 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:40.874 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:04:16 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:40.958 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:40.958 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:40.958 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:40.958 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:40.958 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:40.958 INFO:teuthology.orchestra.run.trial174.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:51:40.958 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:40.959 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:40.959 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:40.959 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:40.959 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:40.959 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 1.1 M 2026-02-17T11:51:40.959 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 4.3 M 2026-02-17T11:51:40.959 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:41.077 INFO:teuthology.orchestra.run.trial174.stdout:python3-rbd-debuginfo-19.2.3-675.g3c96dfb3.el9. 9.6 MB/s | 1.1 MB 00:00 2026-02-17T11:51:41.077 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:41.077 INFO:teuthology.orchestra.run.trial174.stdout:Total 9.5 MB/s | 1.1 MB 00:00 2026-02-17T11:51:41.078 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:41.079 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:41.079 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:41.100 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:41.101 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:41.191 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:41.208 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:41.268 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:41.326 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:41.326 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:41.326 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:41.326 INFO:teuthology.orchestra.run.trial174.stdout: python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:41.326 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:41.326 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:41.355 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T11:51:41.661 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:04:17 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:41.745 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:41.745 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:41.745 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:41.745 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 339 k 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 339 k 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 1.0 M 2026-02-17T11:51:41.746 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:41.842 INFO:teuthology.orchestra.run.trial174.stdout:python3-rgw-debuginfo-19.2.3-675.g3c96dfb3.el9. 3.5 MB/s | 339 kB 00:00 2026-02-17T11:51:41.842 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:41.842 INFO:teuthology.orchestra.run.trial174.stdout:Total 3.4 MB/s | 339 kB 00:00 2026-02-17T11:51:41.842 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:41.844 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:41.844 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:41.863 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:41.863 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:41.912 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:41.929 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:41.985 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:42.042 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:42.042 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:42.043 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:42.043 INFO:teuthology.orchestra.run.trial174.stdout: python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:42.043 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:42.043 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:42.070 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T11:51:42.381 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:04:18 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:42.466 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:42.466 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:42.466 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:42.466 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 547 k 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 547 k 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 3.0 M 2026-02-17T11:51:42.467 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:42.574 INFO:teuthology.orchestra.run.trial174.stdout:rbd-fuse-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 5.0 MB/s | 547 kB 00:00 2026-02-17T11:51:42.575 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:42.575 INFO:teuthology.orchestra.run.trial174.stdout:Total 4.9 MB/s | 547 kB 00:00 2026-02-17T11:51:42.575 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:42.576 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:42.576 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:42.596 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:42.597 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:42.658 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:42.675 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:42.731 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:42.789 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:42.789 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:42.789 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:42.789 INFO:teuthology.orchestra.run.trial174.stdout: rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:42.789 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:42.789 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:42.815 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T11:51:43.120 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:04:19 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:43.204 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:43.204 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:43.205 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:43.205 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:43.205 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:43.205 INFO:teuthology.orchestra.run.trial174.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 54 M 2026-02-17T11:51:43.205 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:43.205 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:43.205 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:43.205 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:43.205 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:43.206 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 54 M 2026-02-17T11:51:43.206 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 353 M 2026-02-17T11:51:43.206 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:43.352 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:43.370 INFO:teuthology.orchestra.run.trial071.stdout: Installing : librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:43.634 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:43.692 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:43.692 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:43.692 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:43.692 INFO:teuthology.orchestra.run.trial071.stdout: librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:43.692 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:43.692 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:43.723 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install librbd1-debuginfo 2026-02-17T11:51:44.036 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:18 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:44.121 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:44.121 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:44.121 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:44.121 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout: librbd1-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 54 M 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 54 M 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 374 M 2026-02-17T11:51:44.122 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:44.298 INFO:teuthology.orchestra.run.trial174.stdout:rbd-mirror-debuginfo-19.2.3-675.g3c96dfb3.el9.x 49 MB/s | 54 MB 00:01 2026-02-17T11:51:44.299 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:44.300 INFO:teuthology.orchestra.run.trial174.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-17T11:51:44.300 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:44.302 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:44.302 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:44.477 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:44.477 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:45.294 INFO:teuthology.orchestra.run.trial071.stdout:librbd1-debuginfo-19.2.3-675.g3c96dfb3.el9.x86_ 46 MB/s | 54 MB 00:01 2026-02-17T11:51:45.295 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:45.295 INFO:teuthology.orchestra.run.trial071.stdout:Total 46 MB/s | 54 MB 00:01 2026-02-17T11:51:45.295 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:45.297 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:45.297 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:45.476 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:45.476 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:47.564 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:47.582 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:47.867 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:47.924 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:47.925 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:47.925 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:47.925 INFO:teuthology.orchestra.run.trial174.stdout: rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:47.925 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:47.925 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:47.957 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T11:51:48.275 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:04:24 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:48.359 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-17T11:51:48.359 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:48.359 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-17T11:51:48.359 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:48.359 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-17T11:51:48.359 INFO:teuthology.orchestra.run.trial174.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.4 M 2026-02-17T11:51:48.360 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:48.360 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-17T11:51:48.360 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-17T11:51:48.360 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-17T11:51:48.360 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:48.360 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 1.4 M 2026-02-17T11:51:48.360 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 6.6 M 2026-02-17T11:51:48.360 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-17T11:51:48.477 INFO:teuthology.orchestra.run.trial174.stdout:rbd-nbd-debuginfo-19.2.3-675.g3c96dfb3.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T11:51:48.478 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:48.478 INFO:teuthology.orchestra.run.trial174.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T11:51:48.478 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-17T11:51:48.480 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-17T11:51:48.480 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-17T11:51:48.503 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-17T11:51:48.503 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-17T11:51:48.606 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:48.607 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-17T11:51:48.624 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:48.624 INFO:teuthology.orchestra.run.trial071.stdout: Installing : librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:48.687 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:48.744 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:48.744 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:48.744 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-17T11:51:48.745 INFO:teuthology.orchestra.run.trial174.stdout: rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:48.745 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:51:48.745 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-17T11:51:48.777 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:48.955 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:49.012 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:49.012 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:49.012 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:49.012 INFO:teuthology.orchestra.run.trial071.stdout: librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:49.013 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:49.013 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:49.043 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T11:51:49.351 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:23 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:49.434 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:49.434 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 628 k 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:49.435 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 628 k 2026-02-17T11:51:49.436 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 2.1 M 2026-02-17T11:51:49.436 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:49.578 INFO:teuthology.orchestra.run.trial071.stdout:python3-cephfs-debuginfo-19.2.3-675.g3c96dfb3.e 4.3 MB/s | 628 kB 00:00 2026-02-17T11:51:49.580 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:49.580 INFO:teuthology.orchestra.run.trial071.stdout:Total 4.2 MB/s | 628 kB 00:00 2026-02-17T11:51:49.580 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:49.582 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:49.582 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:49.603 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:49.603 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:49.667 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:49.684 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:49.745 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:49.803 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:49.803 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:49.803 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:49.803 INFO:teuthology.orchestra.run.trial071.stdout: python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:49.803 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:49.803 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:49.830 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install python3-rados-debuginfo 2026-02-17T11:51:50.139 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:24 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout: python3-rados-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 779 k 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:50.222 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 779 k 2026-02-17T11:51:50.223 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 2.8 M 2026-02-17T11:51:50.223 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:50.331 INFO:teuthology.orchestra.run.trial071.stdout:python3-rados-debuginfo-19.2.3-675.g3c96dfb3.el 7.1 MB/s | 779 kB 00:00 2026-02-17T11:51:50.332 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:50.332 INFO:teuthology.orchestra.run.trial071.stdout:Total 7.0 MB/s | 779 kB 00:00 2026-02-17T11:51:50.332 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:50.333 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:50.333 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:50.353 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:50.353 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:50.425 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:50.443 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:51:50.504 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:51:50.562 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:51:50.562 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:50.563 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:50.563 INFO:teuthology.orchestra.run.trial071.stdout: python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:50.563 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:50.563 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:50.590 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T11:51:50.902 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:24 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:50.927 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:51:50.945 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:50.988 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:50.988 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:50.988 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:50.988 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:50.988 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:50.988 INFO:teuthology.orchestra.run.trial071.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:51:50.988 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:50.989 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:50.989 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:50.989 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:50.989 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:50.989 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 1.1 M 2026-02-17T11:51:50.989 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 4.3 M 2026-02-17T11:51:50.989 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:51.106 INFO:teuthology.orchestra.run.trial071.stdout:python3-rbd-debuginfo-19.2.3-675.g3c96dfb3.el9. 9.7 MB/s | 1.1 MB 00:00 2026-02-17T11:51:51.106 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:51.106 INFO:teuthology.orchestra.run.trial071.stdout:Total 9.6 MB/s | 1.1 MB 00:00 2026-02-17T11:51:51.106 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:51.107 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:51.108 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:51.129 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:51.129 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:51.221 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:51.239 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:51.295 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:51.352 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:51.353 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:51.353 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:51.353 INFO:teuthology.orchestra.run.trial071.stdout: python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:51.353 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:51.353 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:51.379 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T11:51:51.690 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:25 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:51.774 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:51.775 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:51.775 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:51.775 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:51.775 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:51.775 INFO:teuthology.orchestra.run.trial071.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 339 k 2026-02-17T11:51:51.775 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:51.775 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:51.775 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:51.775 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:51.776 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:51.776 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 339 k 2026-02-17T11:51:51.776 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 1.0 M 2026-02-17T11:51:51.776 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:51.870 INFO:teuthology.orchestra.run.trial071.stdout:python3-rgw-debuginfo-19.2.3-675.g3c96dfb3.el9. 3.5 MB/s | 339 kB 00:00 2026-02-17T11:51:51.871 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:51.872 INFO:teuthology.orchestra.run.trial071.stdout:Total 3.4 MB/s | 339 kB 00:00 2026-02-17T11:51:51.872 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:51.873 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:51.873 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:51.892 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:51.892 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:51.942 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:51.959 INFO:teuthology.orchestra.run.trial071.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:52.018 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:52.020 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:52.076 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:52.076 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:52.076 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:51:52.076 INFO:teuthology.orchestra.run.trial010.stdout: ceph-osd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:52.076 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:52.077 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:51:52.078 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:51:52.078 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:52.079 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:52.079 INFO:teuthology.orchestra.run.trial071.stdout: python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:52.079 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:52.079 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:52.107 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T11:51:52.131 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T11:51:52.415 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:26 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:52.444 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:28 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:52.499 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:52.499 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:52.499 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:52.499 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 547 k 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 547 k 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 3.0 M 2026-02-17T11:51:52.500 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:52.527 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:51:52.528 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:52.528 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:51:52.528 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.8 M 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 6.8 M 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 36 M 2026-02-17T11:51:52.529 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:51:52.607 INFO:teuthology.orchestra.run.trial071.stdout:rbd-fuse-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 5.0 MB/s | 547 kB 00:00 2026-02-17T11:51:52.607 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:52.608 INFO:teuthology.orchestra.run.trial071.stdout:Total 5.0 MB/s | 547 kB 00:00 2026-02-17T11:51:52.608 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:52.609 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:52.609 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:52.629 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:52.629 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:52.692 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:52.709 INFO:teuthology.orchestra.run.trial071.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:52.747 INFO:teuthology.orchestra.run.trial010.stdout:ceph-fuse-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 31 MB/s | 6.8 MB 00:00 2026-02-17T11:51:52.748 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:52.748 INFO:teuthology.orchestra.run.trial010.stdout:Total 31 MB/s | 6.8 MB 00:00 2026-02-17T11:51:52.748 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:51:52.750 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:51:52.750 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:51:52.765 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:52.788 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:51:52.789 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:51:52.823 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:52.824 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:52.824 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:52.824 INFO:teuthology.orchestra.run.trial071.stdout: rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:52.824 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:52.824 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:52.850 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T11:51:53.159 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:27 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:53.179 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:51:53.197 INFO:teuthology.orchestra.run.trial010.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:53.242 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:53.242 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:53.242 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:53.242 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:53.242 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:53.242 INFO:teuthology.orchestra.run.trial071.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 54 M 2026-02-17T11:51:53.243 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:53.243 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:53.243 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:53.243 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:53.243 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:53.243 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 54 M 2026-02-17T11:51:53.243 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 353 M 2026-02-17T11:51:53.243 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:53.280 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:53.338 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:51:53.339 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:53.339 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:51:53.339 INFO:teuthology.orchestra.run.trial010.stdout: ceph-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:53.339 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:53.339 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:51:53.364 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install librados-devel-debuginfo 2026-02-17T11:51:53.670 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:29 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:53.751 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:51:53.752 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:53.752 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:51:53.752 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:53.752 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:51:53.752 INFO:teuthology.orchestra.run.trial010.stdout: librados-devel-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 112 k 2026-02-17T11:51:53.752 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:53.752 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:51:53.753 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:53.753 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:51:53.753 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:53.753 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 112 k 2026-02-17T11:51:53.753 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 493 k 2026-02-17T11:51:53.753 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:51:54.119 INFO:teuthology.orchestra.run.trial010.stdout:librados-devel-debuginfo-19.2.3-675.g3c96dfb3.e 306 kB/s | 112 kB 00:00 2026-02-17T11:51:54.119 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:54.119 INFO:teuthology.orchestra.run.trial010.stdout:Total 305 kB/s | 112 kB 00:00 2026-02-17T11:51:54.119 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:51:54.121 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:51:54.121 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:51:54.140 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:51:54.141 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:51:54.179 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:51:54.196 INFO:teuthology.orchestra.run.trial010.stdout: Installing : librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:54.251 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:54.309 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:51:54.309 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:54.309 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:51:54.310 INFO:teuthology.orchestra.run.trial010.stdout: librados-devel-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:54.310 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:54.310 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:51:54.327 INFO:teuthology.orchestra.run.trial071.stdout:rbd-mirror-debuginfo-19.2.3-675.g3c96dfb3.el9.x 49 MB/s | 54 MB 00:01 2026-02-17T11:51:54.328 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:54.328 INFO:teuthology.orchestra.run.trial071.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-17T11:51:54.328 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:54.330 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:54.330 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:54.335 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T11:51:54.506 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:54.506 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:54.641 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:30 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:54.724 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:51:54.724 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:54.724 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:51:54.724 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:54.724 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:51:54.724 INFO:teuthology.orchestra.run.trial010.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.0 M 2026-02-17T11:51:54.724 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:54.724 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:51:54.724 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:54.725 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:51:54.725 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:54.725 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 6.0 M 2026-02-17T11:51:54.725 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 31 M 2026-02-17T11:51:54.725 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial010.stdout:libcephfs2-debuginfo-19.2.3-675.g3c96dfb3.el9.x 30 MB/s | 6.0 MB 00:00 2026-02-17T11:51:54.926 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial010.stdout:Total 30 MB/s | 6.0 MB 00:00 2026-02-17T11:51:54.927 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:51:54.928 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:51:54.964 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:51:55.310 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:51:55.328 INFO:teuthology.orchestra.run.trial010.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:55.406 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:55.464 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:55.464 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:55.464 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:51:55.465 INFO:teuthology.orchestra.run.trial010.stdout: libcephfs2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:55.465 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:55.465 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:51:55.491 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install librados2-debuginfo 2026-02-17T11:51:55.817 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:31 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:51:55.901 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:51:55.901 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout: librados2-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 47 M 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:51:55.902 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 47 M 2026-02-17T11:51:55.903 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 302 M 2026-02-17T11:51:55.903 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:51:56.874 INFO:teuthology.orchestra.run.trial010.stdout:librados2-debuginfo-19.2.3-675.g3c96dfb3.el9.x8 49 MB/s | 47 MB 00:00 2026-02-17T11:51:56.875 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:56.875 INFO:teuthology.orchestra.run.trial010.stdout:Total 48 MB/s | 47 MB 00:00 2026-02-17T11:51:56.875 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:51:56.877 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:51:56.877 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:51:57.036 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:51:57.036 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:51:57.598 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:57.616 INFO:teuthology.orchestra.run.trial071.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:57.923 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:57.980 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:51:57.981 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:57.981 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:57.981 INFO:teuthology.orchestra.run.trial071.stdout: rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:57.981 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:57.981 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:58.013 DEBUG:teuthology.orchestra.run.trial071:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T11:51:58.321 INFO:teuthology.orchestra.run.trial071.stdout:Last metadata expiration check: 0:04:32 ago on Tue 17 Feb 2026 11:47:26 AM UTC. 2026-02-17T11:51:58.405 INFO:teuthology.orchestra.run.trial071.stdout:Dependencies resolved. 2026-02-17T11:51:58.405 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:58.405 INFO:teuthology.orchestra.run.trial071.stdout: Package Arch Version Repo Size 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout:Installing: 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.4 M 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout:Transaction Summary 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout:================================================================================ 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout:Install 1 Package 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout:Total download size: 1.4 M 2026-02-17T11:51:58.406 INFO:teuthology.orchestra.run.trial071.stdout:Installed size: 6.6 M 2026-02-17T11:51:58.407 INFO:teuthology.orchestra.run.trial071.stdout:Downloading Packages: 2026-02-17T11:51:58.542 INFO:teuthology.orchestra.run.trial071.stdout:rbd-nbd-debuginfo-19.2.3-675.g3c96dfb3.el9.x86_ 9.9 MB/s | 1.4 MB 00:00 2026-02-17T11:51:58.543 INFO:teuthology.orchestra.run.trial071.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:51:58.543 INFO:teuthology.orchestra.run.trial071.stdout:Total 9.8 MB/s | 1.4 MB 00:00 2026-02-17T11:51:58.543 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction check 2026-02-17T11:51:58.544 INFO:teuthology.orchestra.run.trial071.stdout:Transaction check succeeded. 2026-02-17T11:51:58.544 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction test 2026-02-17T11:51:58.566 INFO:teuthology.orchestra.run.trial071.stdout:Transaction test succeeded. 2026-02-17T11:51:58.566 INFO:teuthology.orchestra.run.trial071.stdout:Running transaction 2026-02-17T11:51:58.671 INFO:teuthology.orchestra.run.trial071.stdout: Preparing : 1/1 2026-02-17T11:51:58.688 INFO:teuthology.orchestra.run.trial071.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:58.749 INFO:teuthology.orchestra.run.trial071.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:58.807 INFO:teuthology.orchestra.run.trial071.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:51:58.807 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:58.807 INFO:teuthology.orchestra.run.trial071.stdout:Installed: 2026-02-17T11:51:58.807 INFO:teuthology.orchestra.run.trial071.stdout: rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:51:58.807 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:51:58.808 INFO:teuthology.orchestra.run.trial071.stdout:Complete! 2026-02-17T11:51:58.837 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:59.788 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:51:59.806 INFO:teuthology.orchestra.run.trial010.stdout: Installing : librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:52:00.080 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:52:00.137 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_6 1/1 2026-02-17T11:52:00.137 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:00.138 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:52:00.138 INFO:teuthology.orchestra.run.trial010.stdout: librados2-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:52:00.138 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:00.138 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:52:00.169 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install librbd1-debuginfo 2026-02-17T11:52:00.482 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:36 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout: librbd1-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 54 M 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:00.563 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:52:00.564 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:00.564 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 54 M 2026-02-17T11:52:00.564 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 374 M 2026-02-17T11:52:00.564 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:52:01.667 INFO:teuthology.orchestra.run.trial010.stdout:librbd1-debuginfo-19.2.3-675.g3c96dfb3.el9.x86_ 49 MB/s | 54 MB 00:01 2026-02-17T11:52:01.668 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:52:01.668 INFO:teuthology.orchestra.run.trial010.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-17T11:52:01.668 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:52:01.670 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:52:01.670 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:52:01.852 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:52:01.852 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:52:05.033 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:52:05.051 INFO:teuthology.orchestra.run.trial010.stdout: Installing : librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:52:05.386 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:52:05.444 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:52:05.444 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:05.444 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:52:05.444 INFO:teuthology.orchestra.run.trial010.stdout: librbd1-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:52:05.444 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:05.444 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:52:05.476 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T11:52:05.787 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:41 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:52:05.870 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:52:05.870 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:05.870 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:52:05.870 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:05.870 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:52:05.870 INFO:teuthology.orchestra.run.trial010.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 628 k 2026-02-17T11:52:05.870 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:05.870 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:52:05.870 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:05.871 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:52:05.871 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:05.871 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 628 k 2026-02-17T11:52:05.871 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 2.1 M 2026-02-17T11:52:05.871 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:52:05.987 INFO:teuthology.orchestra.run.trial010.stdout:python3-cephfs-debuginfo-19.2.3-675.g3c96dfb3.e 5.3 MB/s | 628 kB 00:00 2026-02-17T11:52:05.988 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:52:05.988 INFO:teuthology.orchestra.run.trial010.stdout:Total 5.2 MB/s | 628 kB 00:00 2026-02-17T11:52:05.988 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:52:05.988 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:52:05.989 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:52:06.009 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:52:06.009 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:52:06.073 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:52:06.090 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:52:06.147 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:52:06.205 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9. 1/1 2026-02-17T11:52:06.205 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:06.206 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:52:06.206 INFO:teuthology.orchestra.run.trial010.stdout: python3-cephfs-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:52:06.206 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:06.206 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:52:06.234 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install python3-rados-debuginfo 2026-02-17T11:52:06.546 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:42 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:52:06.629 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:52:06.630 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:06.630 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:52:06.630 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:06.630 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:52:06.630 INFO:teuthology.orchestra.run.trial010.stdout: python3-rados-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 779 k 2026-02-17T11:52:06.630 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:06.631 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:52:06.631 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:06.631 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:52:06.631 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:06.631 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 779 k 2026-02-17T11:52:06.631 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 2.8 M 2026-02-17T11:52:06.631 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:52:06.755 INFO:teuthology.orchestra.run.trial010.stdout:python3-rados-debuginfo-19.2.3-675.g3c96dfb3.el 6.0 MB/s | 779 kB 00:00 2026-02-17T11:52:06.755 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:52:06.756 INFO:teuthology.orchestra.run.trial010.stdout:Total 6.0 MB/s | 779 kB 00:00 2026-02-17T11:52:06.756 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:52:06.757 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:52:06.757 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:52:06.778 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:52:06.778 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:52:06.851 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:52:06.869 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:52:06.926 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:52:06.983 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x 1/1 2026-02-17T11:52:06.983 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:06.983 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:52:06.983 INFO:teuthology.orchestra.run.trial010.stdout: python3-rados-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:52:06.983 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:06.983 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:52:07.010 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T11:52:07.319 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:43 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:52:07.401 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:07.402 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 1.1 M 2026-02-17T11:52:07.402 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 4.3 M 2026-02-17T11:52:07.402 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:52:07.522 INFO:teuthology.orchestra.run.trial010.stdout:python3-rbd-debuginfo-19.2.3-675.g3c96dfb3.el9. 9.6 MB/s | 1.1 MB 00:00 2026-02-17T11:52:07.522 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:52:07.522 INFO:teuthology.orchestra.run.trial010.stdout:Total 9.5 MB/s | 1.1 MB 00:00 2026-02-17T11:52:07.522 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:52:07.523 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:52:07.524 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:52:07.545 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:52:07.545 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:52:07.634 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:52:07.651 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:52:07.713 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:52:07.772 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:52:07.772 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:07.772 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:52:07.772 INFO:teuthology.orchestra.run.trial010.stdout: python3-rbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:52:07.772 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:07.773 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:52:07.800 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T11:52:08.115 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:44 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:52:08.197 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 339 k 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 339 k 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 1.0 M 2026-02-17T11:52:08.198 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:52:08.380 INFO:teuthology.orchestra.run.trial010.stdout:python3-rgw-debuginfo-19.2.3-675.g3c96dfb3.el9. 1.8 MB/s | 339 kB 00:00 2026-02-17T11:52:08.381 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:52:08.381 INFO:teuthology.orchestra.run.trial010.stdout:Total 1.8 MB/s | 339 kB 00:00 2026-02-17T11:52:08.381 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:52:08.382 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:52:08.382 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:52:08.401 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:52:08.401 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:52:08.451 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:52:08.468 INFO:teuthology.orchestra.run.trial010.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:52:08.524 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:52:08.582 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86 1/1 2026-02-17T11:52:08.583 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:08.583 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:52:08.583 INFO:teuthology.orchestra.run.trial010.stdout: python3-rgw-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:52:08.583 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:08.583 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:52:08.610 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T11:52:08.922 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:44 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:52:09.005 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:52:09.005 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:09.005 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:52:09.005 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:09.005 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:52:09.006 INFO:teuthology.orchestra.run.trial010.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 547 k 2026-02-17T11:52:09.006 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:09.006 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:52:09.006 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:09.006 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:52:09.006 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:09.006 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 547 k 2026-02-17T11:52:09.006 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 3.0 M 2026-02-17T11:52:09.006 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:52:09.113 INFO:teuthology.orchestra.run.trial010.stdout:rbd-fuse-debuginfo-19.2.3-675.g3c96dfb3.el9.x86 5.0 MB/s | 547 kB 00:00 2026-02-17T11:52:09.113 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:52:09.113 INFO:teuthology.orchestra.run.trial010.stdout:Total 4.9 MB/s | 547 kB 00:00 2026-02-17T11:52:09.113 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:52:09.115 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:52:09.115 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:52:09.135 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:52:09.135 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:52:09.198 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:52:09.216 INFO:teuthology.orchestra.run.trial010.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:52:09.279 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:52:09.338 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:52:09.339 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:09.339 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:52:09.339 INFO:teuthology.orchestra.run.trial010.stdout: rbd-fuse-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:52:09.339 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:09.339 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:52:09.366 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T11:52:09.677 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:45 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:52:09.761 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:52:09.761 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:09.761 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:52:09.761 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:09.761 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:52:09.761 INFO:teuthology.orchestra.run.trial010.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 54 M 2026-02-17T11:52:09.761 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:09.762 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:52:09.762 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:09.762 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:52:09.762 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:09.762 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 54 M 2026-02-17T11:52:09.762 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 353 M 2026-02-17T11:52:09.762 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:52:10.846 INFO:teuthology.orchestra.run.trial010.stdout:rbd-mirror-debuginfo-19.2.3-675.g3c96dfb3.el9.x 49 MB/s | 54 MB 00:01 2026-02-17T11:52:10.846 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:52:10.846 INFO:teuthology.orchestra.run.trial010.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-17T11:52:10.846 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:52:10.847 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:52:10.848 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:52:11.023 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:52:11.023 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:52:14.071 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:52:14.089 INFO:teuthology.orchestra.run.trial010.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:52:14.398 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:52:14.455 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_ 1/1 2026-02-17T11:52:14.456 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:14.456 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:52:14.456 INFO:teuthology.orchestra.run.trial010.stdout: rbd-mirror-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:52:14.456 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:14.456 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:52:14.489 DEBUG:teuthology.orchestra.run.trial010:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T11:52:14.800 INFO:teuthology.orchestra.run.trial010.stdout:Last metadata expiration check: 0:04:50 ago on Tue 17 Feb 2026 11:47:24 AM UTC. 2026-02-17T11:52:14.883 INFO:teuthology.orchestra.run.trial010.stdout:Dependencies resolved. 2026-02-17T11:52:14.883 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:14.883 INFO:teuthology.orchestra.run.trial010.stdout: Package Arch Version Repo Size 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout:Installing: 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.4 M 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout:Transaction Summary 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout:================================================================================ 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout:Install 1 Package 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout:Total download size: 1.4 M 2026-02-17T11:52:14.884 INFO:teuthology.orchestra.run.trial010.stdout:Installed size: 6.6 M 2026-02-17T11:52:14.885 INFO:teuthology.orchestra.run.trial010.stdout:Downloading Packages: 2026-02-17T11:52:15.010 INFO:teuthology.orchestra.run.trial010.stdout:rbd-nbd-debuginfo-19.2.3-675.g3c96dfb3.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T11:52:15.010 INFO:teuthology.orchestra.run.trial010.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:52:15.010 INFO:teuthology.orchestra.run.trial010.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T11:52:15.010 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction check 2026-02-17T11:52:15.011 INFO:teuthology.orchestra.run.trial010.stdout:Transaction check succeeded. 2026-02-17T11:52:15.011 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction test 2026-02-17T11:52:15.034 INFO:teuthology.orchestra.run.trial010.stdout:Transaction test succeeded. 2026-02-17T11:52:15.034 INFO:teuthology.orchestra.run.trial010.stdout:Running transaction 2026-02-17T11:52:15.139 INFO:teuthology.orchestra.run.trial010.stdout: Preparing : 1/1 2026-02-17T11:52:15.156 INFO:teuthology.orchestra.run.trial010.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:52:15.216 INFO:teuthology.orchestra.run.trial010.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:52:15.274 INFO:teuthology.orchestra.run.trial010.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:52:15.274 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:15.274 INFO:teuthology.orchestra.run.trial010.stdout:Installed: 2026-02-17T11:52:15.274 INFO:teuthology.orchestra.run.trial010.stdout: rbd-nbd-debuginfo-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:52:15.275 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:15.275 INFO:teuthology.orchestra.run.trial010.stdout:Complete! 2026-02-17T11:52:15.305 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:15.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:52:15.534 DEBUG:teuthology.orchestra.run.trial010:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:52:15.556 INFO:teuthology.orchestra.run.trial010.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T11:52:15.557 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T11:52:15.557 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T11:52:15.560 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:52:15.885 DEBUG:teuthology.orchestra.run.trial071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:52:15.907 INFO:teuthology.orchestra.run.trial071.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T11:52:15.907 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T11:52:15.907 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T11:52:15.910 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:52:16.069 DEBUG:teuthology.orchestra.run.trial153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:52:16.092 INFO:teuthology.orchestra.run.trial153.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T11:52:16.092 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T11:52:16.092 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T11:52:16.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:52:16.245 DEBUG:teuthology.orchestra.run.trial174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:52:16.265 INFO:teuthology.orchestra.run.trial174.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T11:52:16.265 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T11:52:16.265 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T11:52:16.267 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T11:52:16.267 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:16.267 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:52:16.292 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:52:16.293 DEBUG:teuthology.orchestra.run.trial071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:52:16.319 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:52:16.319 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:52:16.345 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:52:16.345 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:52:16.370 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T11:52:16.370 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:16.371 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:52:16.396 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:52:16.463 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:52:16.463 DEBUG:teuthology.orchestra.run.trial071:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:52:16.487 DEBUG:teuthology.orchestra.run.trial071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:52:16.551 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:52:16.552 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:52:16.578 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:52:16.642 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:52:16.642 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:52:16.667 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:52:16.731 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T11:52:16.731 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:16.732 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:52:16.757 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:52:16.823 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:52:16.823 DEBUG:teuthology.orchestra.run.trial071:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:52:16.849 DEBUG:teuthology.orchestra.run.trial071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:52:16.914 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:52:16.914 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:52:16.940 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:52:17.003 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:52:17.003 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:52:17.027 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:52:17.092 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T11:52:17.092 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:17.093 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:52:17.118 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:52:17.183 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:52:17.183 DEBUG:teuthology.orchestra.run.trial071:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:52:17.208 DEBUG:teuthology.orchestra.run.trial071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:52:17.273 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:52:17.273 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:52:17.297 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:52:17.363 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:52:17.364 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:52:17.389 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:52:17.453 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T11:52:17.557 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T11:52:17.557 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod 777 /var/log/ceph 2026-02-17T11:52:17.559 DEBUG:teuthology.orchestra.run.trial071:> sudo chmod 777 /var/log/ceph 2026-02-17T11:52:17.561 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod 777 /var/log/ceph 2026-02-17T11:52:17.563 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod 777 /var/log/ceph 2026-02-17T11:52:17.587 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T11:52:17.587 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:52:17.625 DEBUG:teuthology.orchestra.run.trial071:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:52:17.626 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:52:17.628 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:52:17.653 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T11:52:17.653 DEBUG:teuthology.orchestra.run.trial010:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:52:17.689 DEBUG:teuthology.orchestra.run.trial071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:52:17.691 DEBUG:teuthology.orchestra.run.trial153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:52:17.694 DEBUG:teuthology.orchestra.run.trial174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:52:17.727 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T11:52:17.727 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T11:52:17.727 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344', 'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51344', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 4581, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'targets': {'trial010.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEf/bQ1MNGU/QvYKo5aFg75PEXtp8roQTtlS12+yfEMeZh3MF6TY8pmHFlks3nxeGwsqcuNdTO4b+qG4tzKE3Q=', 'trial071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPKBnTEuPh6HXl/sovLXhgNf1DsjmASOmiEtNUiHGWo99gs5IgPegV6ee51rQO1yVS2h6beQ2P/SXuef3fnp58=', 'trial153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJRSXd4ODm0OaEPfAdo7UahGUwBBYoiD142C0lXYLpsYCZxC6baRuTuzAz1MBmPEjQ9pJdhQEdi6I3ArKain6ko=', 'trial174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLSwfnKaXenQlDDb6CSnXutvikC48a3wiUb/9Dsd+A4fGDEANrMdXJwi/frujcKvoFRRZ9ny14Ii2uu0kb1hpY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:10:36', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T11:52:17.728 DEBUG:teuthology.orchestra.run.trial010:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:52:17.754 DEBUG:teuthology.orchestra.run.trial071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:52:17.757 DEBUG:teuthology.orchestra.run.trial153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:52:17.760 DEBUG:teuthology.orchestra.run.trial174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:52:17.776 DEBUG:teuthology.orchestra.run.trial010:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:52:17.810 DEBUG:teuthology.orchestra.run.trial071:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:52:17.813 DEBUG:teuthology.orchestra.run.trial153:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:52:17.816 DEBUG:teuthology.orchestra.run.trial174:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:52:17.840 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:17.840 DEBUG:teuthology.orchestra.run.trial010:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:52:17.888 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:52:17.888 DEBUG:teuthology.orchestra.run.trial010:> stat /dev/vg_nvme/lv_1 2026-02-17T11:52:17.946 INFO:teuthology.orchestra.run.trial010.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:52:17.946 INFO:teuthology.orchestra.run.trial010.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:17.946 INFO:teuthology.orchestra.run.trial010.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-17T11:52:17.946 INFO:teuthology.orchestra.run.trial010.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:17.946 INFO:teuthology.orchestra.run.trial010.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:17.946 INFO:teuthology.orchestra.run.trial010.stdout:Access: 2026-02-17 11:48:09.327412475 +0000 2026-02-17T11:52:17.947 INFO:teuthology.orchestra.run.trial010.stdout:Modify: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:17.947 INFO:teuthology.orchestra.run.trial010.stdout:Change: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:17.947 INFO:teuthology.orchestra.run.trial010.stdout: Birth: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:17.947 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:52:18.009 INFO:teuthology.orchestra.run.trial010.stderr:1+0 records in 2026-02-17T11:52:18.009 INFO:teuthology.orchestra.run.trial010.stderr:1+0 records out 2026-02-17T11:52:18.009 INFO:teuthology.orchestra.run.trial010.stderr:512 bytes copied, 0.000165227 s, 3.1 MB/s 2026-02-17T11:52:18.010 DEBUG:teuthology.orchestra.run.trial010:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:52:18.069 DEBUG:teuthology.orchestra.run.trial010:> stat /dev/vg_nvme/lv_2 2026-02-17T11:52:18.124 INFO:teuthology.orchestra.run.trial010.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:52:18.125 INFO:teuthology.orchestra.run.trial010.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:18.125 INFO:teuthology.orchestra.run.trial010.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-17T11:52:18.125 INFO:teuthology.orchestra.run.trial010.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:18.125 INFO:teuthology.orchestra.run.trial010.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:18.125 INFO:teuthology.orchestra.run.trial010.stdout:Access: 2026-02-17 11:48:09.327412475 +0000 2026-02-17T11:52:18.125 INFO:teuthology.orchestra.run.trial010.stdout:Modify: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:18.125 INFO:teuthology.orchestra.run.trial010.stdout:Change: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:18.125 INFO:teuthology.orchestra.run.trial010.stdout: Birth: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:18.125 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:52:18.188 INFO:teuthology.orchestra.run.trial010.stderr:1+0 records in 2026-02-17T11:52:18.189 INFO:teuthology.orchestra.run.trial010.stderr:1+0 records out 2026-02-17T11:52:18.189 INFO:teuthology.orchestra.run.trial010.stderr:512 bytes copied, 0.000136985 s, 3.7 MB/s 2026-02-17T11:52:18.190 DEBUG:teuthology.orchestra.run.trial010:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:52:18.249 DEBUG:teuthology.orchestra.run.trial010:> stat /dev/vg_nvme/lv_3 2026-02-17T11:52:18.306 INFO:teuthology.orchestra.run.trial010.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:52:18.306 INFO:teuthology.orchestra.run.trial010.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:18.306 INFO:teuthology.orchestra.run.trial010.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-17T11:52:18.306 INFO:teuthology.orchestra.run.trial010.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:18.306 INFO:teuthology.orchestra.run.trial010.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:18.306 INFO:teuthology.orchestra.run.trial010.stdout:Access: 2026-02-17 11:48:09.328412458 +0000 2026-02-17T11:52:18.306 INFO:teuthology.orchestra.run.trial010.stdout:Modify: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:18.307 INFO:teuthology.orchestra.run.trial010.stdout:Change: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:18.307 INFO:teuthology.orchestra.run.trial010.stdout: Birth: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:18.307 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:52:18.368 INFO:teuthology.orchestra.run.trial010.stderr:1+0 records in 2026-02-17T11:52:18.369 INFO:teuthology.orchestra.run.trial010.stderr:1+0 records out 2026-02-17T11:52:18.369 INFO:teuthology.orchestra.run.trial010.stderr:512 bytes copied, 0.000165949 s, 3.1 MB/s 2026-02-17T11:52:18.370 DEBUG:teuthology.orchestra.run.trial010:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:52:18.427 DEBUG:teuthology.orchestra.run.trial010:> stat /dev/vg_nvme/lv_4 2026-02-17T11:52:18.482 INFO:teuthology.orchestra.run.trial010.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:52:18.482 INFO:teuthology.orchestra.run.trial010.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:18.482 INFO:teuthology.orchestra.run.trial010.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-17T11:52:18.482 INFO:teuthology.orchestra.run.trial010.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:18.482 INFO:teuthology.orchestra.run.trial010.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:18.482 INFO:teuthology.orchestra.run.trial010.stdout:Access: 2026-02-17 11:48:09.328412458 +0000 2026-02-17T11:52:18.483 INFO:teuthology.orchestra.run.trial010.stdout:Modify: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:18.483 INFO:teuthology.orchestra.run.trial010.stdout:Change: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:18.483 INFO:teuthology.orchestra.run.trial010.stdout: Birth: 2026-02-17 11:47:29.287127943 +0000 2026-02-17T11:52:18.483 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:52:18.546 INFO:teuthology.orchestra.run.trial010.stderr:1+0 records in 2026-02-17T11:52:18.546 INFO:teuthology.orchestra.run.trial010.stderr:1+0 records out 2026-02-17T11:52:18.546 INFO:teuthology.orchestra.run.trial010.stderr:512 bytes copied, 0.000145862 s, 3.5 MB/s 2026-02-17T11:52:18.548 DEBUG:teuthology.orchestra.run.trial010:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:52:18.607 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:18.607 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:52:18.607 DEBUG:teuthology.orchestra.run.trial071:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:52:18.625 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:52:18.626 DEBUG:teuthology.orchestra.run.trial071:> stat /dev/vg_nvme/lv_1 2026-02-17T11:52:18.681 INFO:teuthology.orchestra.run.trial071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:52:18.681 INFO:teuthology.orchestra.run.trial071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:18.681 INFO:teuthology.orchestra.run.trial071.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-17T11:52:18.681 INFO:teuthology.orchestra.run.trial071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:18.681 INFO:teuthology.orchestra.run.trial071.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:18.681 INFO:teuthology.orchestra.run.trial071.stdout:Access: 2026-02-17 11:48:09.653202875 +0000 2026-02-17T11:52:18.681 INFO:teuthology.orchestra.run.trial071.stdout:Modify: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:18.681 INFO:teuthology.orchestra.run.trial071.stdout:Change: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:18.681 INFO:teuthology.orchestra.run.trial071.stdout: Birth: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:18.681 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:52:18.744 INFO:teuthology.orchestra.run.trial071.stderr:1+0 records in 2026-02-17T11:52:18.745 INFO:teuthology.orchestra.run.trial071.stderr:1+0 records out 2026-02-17T11:52:18.745 INFO:teuthology.orchestra.run.trial071.stderr:512 bytes copied, 0.000151753 s, 3.4 MB/s 2026-02-17T11:52:18.746 DEBUG:teuthology.orchestra.run.trial071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:52:18.804 DEBUG:teuthology.orchestra.run.trial071:> stat /dev/vg_nvme/lv_2 2026-02-17T11:52:18.860 INFO:teuthology.orchestra.run.trial071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:52:18.861 INFO:teuthology.orchestra.run.trial071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:18.861 INFO:teuthology.orchestra.run.trial071.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-17T11:52:18.861 INFO:teuthology.orchestra.run.trial071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:18.861 INFO:teuthology.orchestra.run.trial071.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:18.861 INFO:teuthology.orchestra.run.trial071.stdout:Access: 2026-02-17 11:48:09.654202859 +0000 2026-02-17T11:52:18.861 INFO:teuthology.orchestra.run.trial071.stdout:Modify: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:18.861 INFO:teuthology.orchestra.run.trial071.stdout:Change: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:18.861 INFO:teuthology.orchestra.run.trial071.stdout: Birth: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:18.862 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:52:18.925 INFO:teuthology.orchestra.run.trial071.stderr:1+0 records in 2026-02-17T11:52:18.925 INFO:teuthology.orchestra.run.trial071.stderr:1+0 records out 2026-02-17T11:52:18.926 INFO:teuthology.orchestra.run.trial071.stderr:512 bytes copied, 0.00014466 s, 3.5 MB/s 2026-02-17T11:52:18.927 DEBUG:teuthology.orchestra.run.trial071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:52:18.984 DEBUG:teuthology.orchestra.run.trial071:> stat /dev/vg_nvme/lv_3 2026-02-17T11:52:19.040 INFO:teuthology.orchestra.run.trial071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:52:19.040 INFO:teuthology.orchestra.run.trial071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:19.040 INFO:teuthology.orchestra.run.trial071.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-17T11:52:19.040 INFO:teuthology.orchestra.run.trial071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:19.040 INFO:teuthology.orchestra.run.trial071.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:19.040 INFO:teuthology.orchestra.run.trial071.stdout:Access: 2026-02-17 11:48:09.654202859 +0000 2026-02-17T11:52:19.040 INFO:teuthology.orchestra.run.trial071.stdout:Modify: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:19.040 INFO:teuthology.orchestra.run.trial071.stdout:Change: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:19.040 INFO:teuthology.orchestra.run.trial071.stdout: Birth: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:19.040 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:52:19.103 INFO:teuthology.orchestra.run.trial071.stderr:1+0 records in 2026-02-17T11:52:19.103 INFO:teuthology.orchestra.run.trial071.stderr:1+0 records out 2026-02-17T11:52:19.103 INFO:teuthology.orchestra.run.trial071.stderr:512 bytes copied, 0.000144179 s, 3.6 MB/s 2026-02-17T11:52:19.105 DEBUG:teuthology.orchestra.run.trial071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:52:19.161 DEBUG:teuthology.orchestra.run.trial071:> stat /dev/vg_nvme/lv_4 2026-02-17T11:52:19.219 INFO:teuthology.orchestra.run.trial071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:52:19.220 INFO:teuthology.orchestra.run.trial071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:19.220 INFO:teuthology.orchestra.run.trial071.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-17T11:52:19.220 INFO:teuthology.orchestra.run.trial071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:19.220 INFO:teuthology.orchestra.run.trial071.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:19.220 INFO:teuthology.orchestra.run.trial071.stdout:Access: 2026-02-17 11:48:09.654202859 +0000 2026-02-17T11:52:19.220 INFO:teuthology.orchestra.run.trial071.stdout:Modify: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:19.220 INFO:teuthology.orchestra.run.trial071.stdout:Change: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:19.220 INFO:teuthology.orchestra.run.trial071.stdout: Birth: 2026-02-17 11:47:32.909789151 +0000 2026-02-17T11:52:19.221 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:52:19.282 INFO:teuthology.orchestra.run.trial071.stderr:1+0 records in 2026-02-17T11:52:19.283 INFO:teuthology.orchestra.run.trial071.stderr:1+0 records out 2026-02-17T11:52:19.283 INFO:teuthology.orchestra.run.trial071.stderr:512 bytes copied, 0.000144559 s, 3.5 MB/s 2026-02-17T11:52:19.284 DEBUG:teuthology.orchestra.run.trial071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:52:19.343 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:19.343 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:52:19.343 DEBUG:teuthology.orchestra.run.trial153:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:52:19.360 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:52:19.360 DEBUG:teuthology.orchestra.run.trial153:> stat /dev/vg_nvme/lv_1 2026-02-17T11:52:19.417 INFO:teuthology.orchestra.run.trial153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:52:19.417 INFO:teuthology.orchestra.run.trial153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:19.417 INFO:teuthology.orchestra.run.trial153.stdout:Device: 6h/6d Inode: 1317 Links: 1 2026-02-17T11:52:19.417 INFO:teuthology.orchestra.run.trial153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:19.418 INFO:teuthology.orchestra.run.trial153.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:19.418 INFO:teuthology.orchestra.run.trial153.stdout:Access: 2026-02-17 11:47:58.390549621 +0000 2026-02-17T11:52:19.418 INFO:teuthology.orchestra.run.trial153.stdout:Modify: 2026-02-17 11:47:26.626089283 +0000 2026-02-17T11:52:19.418 INFO:teuthology.orchestra.run.trial153.stdout:Change: 2026-02-17 11:47:26.626089283 +0000 2026-02-17T11:52:19.418 INFO:teuthology.orchestra.run.trial153.stdout: Birth: 2026-02-17 11:47:26.626089283 +0000 2026-02-17T11:52:19.419 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:52:19.479 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records in 2026-02-17T11:52:19.479 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records out 2026-02-17T11:52:19.479 INFO:teuthology.orchestra.run.trial153.stderr:512 bytes copied, 0.0001598 s, 3.2 MB/s 2026-02-17T11:52:19.480 DEBUG:teuthology.orchestra.run.trial153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:52:19.537 DEBUG:teuthology.orchestra.run.trial153:> stat /dev/vg_nvme/lv_2 2026-02-17T11:52:19.594 INFO:teuthology.orchestra.run.trial153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:52:19.595 INFO:teuthology.orchestra.run.trial153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:19.595 INFO:teuthology.orchestra.run.trial153.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-17T11:52:19.595 INFO:teuthology.orchestra.run.trial153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:19.595 INFO:teuthology.orchestra.run.trial153.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:19.595 INFO:teuthology.orchestra.run.trial153.stdout:Access: 2026-02-17 11:47:58.391549604 +0000 2026-02-17T11:52:19.595 INFO:teuthology.orchestra.run.trial153.stdout:Modify: 2026-02-17 11:47:26.626089283 +0000 2026-02-17T11:52:19.595 INFO:teuthology.orchestra.run.trial153.stdout:Change: 2026-02-17 11:47:26.626089283 +0000 2026-02-17T11:52:19.595 INFO:teuthology.orchestra.run.trial153.stdout: Birth: 2026-02-17 11:47:26.626089283 +0000 2026-02-17T11:52:19.596 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:52:19.657 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records in 2026-02-17T11:52:19.658 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records out 2026-02-17T11:52:19.658 INFO:teuthology.orchestra.run.trial153.stderr:512 bytes copied, 0.000139551 s, 3.7 MB/s 2026-02-17T11:52:19.659 DEBUG:teuthology.orchestra.run.trial153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:52:19.719 DEBUG:teuthology.orchestra.run.trial153:> stat /dev/vg_nvme/lv_3 2026-02-17T11:52:19.778 INFO:teuthology.orchestra.run.trial153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:52:19.778 INFO:teuthology.orchestra.run.trial153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:19.779 INFO:teuthology.orchestra.run.trial153.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-17T11:52:19.779 INFO:teuthology.orchestra.run.trial153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:19.779 INFO:teuthology.orchestra.run.trial153.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:19.779 INFO:teuthology.orchestra.run.trial153.stdout:Access: 2026-02-17 11:47:58.391549604 +0000 2026-02-17T11:52:19.779 INFO:teuthology.orchestra.run.trial153.stdout:Modify: 2026-02-17 11:47:26.626089283 +0000 2026-02-17T11:52:19.779 INFO:teuthology.orchestra.run.trial153.stdout:Change: 2026-02-17 11:47:26.626089283 +0000 2026-02-17T11:52:19.779 INFO:teuthology.orchestra.run.trial153.stdout: Birth: 2026-02-17 11:47:26.626089283 +0000 2026-02-17T11:52:19.780 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:52:19.842 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records in 2026-02-17T11:52:19.842 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records out 2026-02-17T11:52:19.842 INFO:teuthology.orchestra.run.trial153.stderr:512 bytes copied, 0.000147867 s, 3.5 MB/s 2026-02-17T11:52:19.843 DEBUG:teuthology.orchestra.run.trial153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:52:19.902 DEBUG:teuthology.orchestra.run.trial153:> stat /dev/vg_nvme/lv_4 2026-02-17T11:52:19.960 INFO:teuthology.orchestra.run.trial153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:52:19.960 INFO:teuthology.orchestra.run.trial153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:19.960 INFO:teuthology.orchestra.run.trial153.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-17T11:52:19.960 INFO:teuthology.orchestra.run.trial153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:19.960 INFO:teuthology.orchestra.run.trial153.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:19.960 INFO:teuthology.orchestra.run.trial153.stdout:Access: 2026-02-17 11:47:58.392549586 +0000 2026-02-17T11:52:19.960 INFO:teuthology.orchestra.run.trial153.stdout:Modify: 2026-02-17 11:47:26.625089300 +0000 2026-02-17T11:52:19.960 INFO:teuthology.orchestra.run.trial153.stdout:Change: 2026-02-17 11:47:26.625089300 +0000 2026-02-17T11:52:19.960 INFO:teuthology.orchestra.run.trial153.stdout: Birth: 2026-02-17 11:47:26.625089300 +0000 2026-02-17T11:52:19.960 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:52:20.022 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records in 2026-02-17T11:52:20.022 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records out 2026-02-17T11:52:20.022 INFO:teuthology.orchestra.run.trial153.stderr:512 bytes copied, 0.000127569 s, 4.0 MB/s 2026-02-17T11:52:20.023 DEBUG:teuthology.orchestra.run.trial153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:52:20.080 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:20.080 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:52:20.080 DEBUG:teuthology.orchestra.run.trial174:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:52:20.098 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:52:20.098 DEBUG:teuthology.orchestra.run.trial174:> stat /dev/vg_nvme/lv_1 2026-02-17T11:52:20.154 INFO:teuthology.orchestra.run.trial174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:52:20.154 INFO:teuthology.orchestra.run.trial174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:20.154 INFO:teuthology.orchestra.run.trial174.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-17T11:52:20.154 INFO:teuthology.orchestra.run.trial174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:20.154 INFO:teuthology.orchestra.run.trial174.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:20.154 INFO:teuthology.orchestra.run.trial174.stdout:Access: 2026-02-17 11:48:08.665212559 +0000 2026-02-17T11:52:20.154 INFO:teuthology.orchestra.run.trial174.stdout:Modify: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.154 INFO:teuthology.orchestra.run.trial174.stdout:Change: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.154 INFO:teuthology.orchestra.run.trial174.stdout: Birth: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.154 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:52:20.218 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records in 2026-02-17T11:52:20.219 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records out 2026-02-17T11:52:20.219 INFO:teuthology.orchestra.run.trial174.stderr:512 bytes copied, 0.000155128 s, 3.3 MB/s 2026-02-17T11:52:20.220 DEBUG:teuthology.orchestra.run.trial174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:52:20.278 DEBUG:teuthology.orchestra.run.trial174:> stat /dev/vg_nvme/lv_2 2026-02-17T11:52:20.334 INFO:teuthology.orchestra.run.trial174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:52:20.334 INFO:teuthology.orchestra.run.trial174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:20.334 INFO:teuthology.orchestra.run.trial174.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-17T11:52:20.334 INFO:teuthology.orchestra.run.trial174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:20.334 INFO:teuthology.orchestra.run.trial174.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:20.334 INFO:teuthology.orchestra.run.trial174.stdout:Access: 2026-02-17 11:48:08.665212559 +0000 2026-02-17T11:52:20.334 INFO:teuthology.orchestra.run.trial174.stdout:Modify: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.335 INFO:teuthology.orchestra.run.trial174.stdout:Change: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.335 INFO:teuthology.orchestra.run.trial174.stdout: Birth: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.335 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:52:20.397 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records in 2026-02-17T11:52:20.397 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records out 2026-02-17T11:52:20.397 INFO:teuthology.orchestra.run.trial174.stderr:512 bytes copied, 0.000188981 s, 2.7 MB/s 2026-02-17T11:52:20.399 DEBUG:teuthology.orchestra.run.trial174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:52:20.458 DEBUG:teuthology.orchestra.run.trial174:> stat /dev/vg_nvme/lv_3 2026-02-17T11:52:20.516 INFO:teuthology.orchestra.run.trial174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:52:20.517 INFO:teuthology.orchestra.run.trial174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:20.517 INFO:teuthology.orchestra.run.trial174.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-17T11:52:20.517 INFO:teuthology.orchestra.run.trial174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:20.517 INFO:teuthology.orchestra.run.trial174.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:20.517 INFO:teuthology.orchestra.run.trial174.stdout:Access: 2026-02-17 11:48:08.665212559 +0000 2026-02-17T11:52:20.517 INFO:teuthology.orchestra.run.trial174.stdout:Modify: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.517 INFO:teuthology.orchestra.run.trial174.stdout:Change: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.517 INFO:teuthology.orchestra.run.trial174.stdout: Birth: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.518 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:52:20.579 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records in 2026-02-17T11:52:20.580 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records out 2026-02-17T11:52:20.580 INFO:teuthology.orchestra.run.trial174.stderr:512 bytes copied, 0.000148476 s, 3.4 MB/s 2026-02-17T11:52:20.581 DEBUG:teuthology.orchestra.run.trial174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:52:20.639 DEBUG:teuthology.orchestra.run.trial174:> stat /dev/vg_nvme/lv_4 2026-02-17T11:52:20.694 INFO:teuthology.orchestra.run.trial174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:52:20.695 INFO:teuthology.orchestra.run.trial174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:52:20.695 INFO:teuthology.orchestra.run.trial174.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-17T11:52:20.695 INFO:teuthology.orchestra.run.trial174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:52:20.695 INFO:teuthology.orchestra.run.trial174.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:52:20.695 INFO:teuthology.orchestra.run.trial174.stdout:Access: 2026-02-17 11:48:08.666212529 +0000 2026-02-17T11:52:20.695 INFO:teuthology.orchestra.run.trial174.stdout:Modify: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.695 INFO:teuthology.orchestra.run.trial174.stdout:Change: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.695 INFO:teuthology.orchestra.run.trial174.stdout: Birth: 2026-02-17 11:47:32.131280138 +0000 2026-02-17T11:52:20.696 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:52:20.757 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records in 2026-02-17T11:52:20.757 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records out 2026-02-17T11:52:20.757 INFO:teuthology.orchestra.run.trial174.stderr:512 bytes copied, 0.000143696 s, 3.6 MB/s 2026-02-17T11:52:20.758 DEBUG:teuthology.orchestra.run.trial174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:52:20.815 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:20.816 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial010.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial071.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial153.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial174.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-17T11:52:20.816 INFO:tasks.ceph:Generating config... 2026-02-17T11:52:20.817 INFO:tasks.ceph:[client] debug monc = 20 2026-02-17T11:52:20.817 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T11:52:20.817 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-17T11:52:20.817 INFO:tasks.ceph:[client] debug rados = 20 2026-02-17T11:52:20.817 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T11:52:20.817 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T11:52:20.817 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-17T11:52:20.817 INFO:tasks.ceph:[global] ms type = async 2026-02-17T11:52:20.817 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-17T11:52:20.817 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-17T11:52:20.817 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-17T11:52:20.817 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T11:52:20.818 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-17T11:52:20.818 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T11:52:20.818 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T11:52:20.857 INFO:teuthology.orchestra.run.trial010.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T11:52:20.860 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T11:52:20.937 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:52:21.001 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.10'), ('mon.b', '10.20.193.71'), ('mon.c', '10.20.193.153')] 2026-02-17T11:52:21.002 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.10,10.20.193.71,10.20.193.153', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-17T11:52:21.004 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:21.004 DEBUG:teuthology.orchestra.run.trial010:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:52:21.056 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.10 --add b 10.20.193.71 --add c 10.20.193.153 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:21.130 INFO:teuthology.orchestra.run.trial010.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:21.130 INFO:teuthology.orchestra.run.trial010.stdout:monmaptool: generated fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:52:21.130 INFO:teuthology.orchestra.run.trial010.stdout:setting min_mon_release = quincy 2026-02-17T11:52:21.130 INFO:teuthology.orchestra.run.trial010.stdout:epoch 0 2026-02-17T11:52:21.130 INFO:teuthology.orchestra.run.trial010.stdout:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:52:21.130 INFO:teuthology.orchestra.run.trial010.stdout:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:52:21.131 INFO:teuthology.orchestra.run.trial010.stdout:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:52:21.131 INFO:teuthology.orchestra.run.trial010.stdout:min_mon_release 17 (quincy) 2026-02-17T11:52:21.131 INFO:teuthology.orchestra.run.trial010.stdout:election_strategy: 1 2026-02-17T11:52:21.131 INFO:teuthology.orchestra.run.trial010.stdout:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:52:21.131 INFO:teuthology.orchestra.run.trial010.stdout:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:52:21.131 INFO:teuthology.orchestra.run.trial010.stdout:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:52:21.131 INFO:teuthology.orchestra.run.trial010.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T11:52:21.133 DEBUG:teuthology.orchestra.run.trial010:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:52:21.191 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e6846c4e-39d4-4411-a0f7-efd9dc941974... 2026-02-17T11:52:21.192 DEBUG:teuthology.orchestra.run.trial010:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:52:21.233 DEBUG:teuthology.orchestra.run.trial071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:52:21.236 DEBUG:teuthology.orchestra.run.trial153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:52:21.239 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:52:21.272 INFO:teuthology.orchestra.run.trial010.stdout:[global] 2026-02-17T11:52:21.272 INFO:teuthology.orchestra.run.trial010.stdout: chdir = "" 2026-02-17T11:52:21.272 INFO:teuthology.orchestra.run.trial010.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:52:21.272 INFO:teuthology.orchestra.run.trial010.stdout: auth supported = cephx 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: filestore xattr use omap = true 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: mon clock drift allowed = 1.000 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: osd crush chooseleaf type = 0 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: auth debug = true 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: ms die on old message = true 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: ms die on bug = true 2026-02-17T11:52:21.273 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: mon pg warn max object skew = 0 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: osd pool default size = 2 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: mon osd allow primary affinity = true 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: mon osd allow pg remap = true 2026-02-17T11:52:21.274 INFO:teuthology.orchestra.run.trial010.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: mon warn on no sortbitwise = false 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: mon warn on too few osds = false 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: mon_allow_pool_size_one = true 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: osd default data pool replay window = 5 2026-02-17T11:52:21.275 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: mon allow pool delete = true 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: mon cluster log file level = debug 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: debug asserts on shutdown = true 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: mon health detail to clog = false 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: mon host = "10.20.193.10,10.20.193.71,10.20.193.153" 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: mon client directed command retry = 5 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: mon election default strategy = 1 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: ms inject socket failures = 5000 2026-02-17T11:52:21.276 INFO:teuthology.orchestra.run.trial010.stdout: ms type = async 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: osd heartbeat grace = 160 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: osd op thread timeout = 150 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: fsid = e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout:[osd] 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: osd journal size = 100 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: osd scrub load threshold = 5.0 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: osd scrub max interval = 600 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:52:21.277 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: osd recover clone overlap = true 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: osd recovery max chunk = 1048576 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: osd debug shutdown = true 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: osd debug op order = true 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: osd debug verify stray on activate = true 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: osd debug trim objects = true 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: osd open classes on start = true 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: osd debug pg log writeout = true 2026-02-17T11:52:21.278 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: osd map max advance = 10 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: journal zero on create = true 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: filestore apply finisher threads = 3 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: bdev debug aio = true 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: osd debug misdirected ops = true 2026-02-17T11:52:21.279 INFO:teuthology.orchestra.run.trial010.stdout: bdev async discard = True 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: bdev enable discard = True 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: bluestore allocator = bitmap 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: bluestore block size = 96636764160 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: bluestore fsck on mount = True 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: bluestore zero block detection = True 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: debug bluefs = 1 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: debug bluestore = 1 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: debug monc = 20 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: debug ms = 1 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: debug osd = 20 2026-02-17T11:52:21.280 INFO:teuthology.orchestra.run.trial010.stdout: debug rocksdb = 10 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: mon osd full ratio = 0.9 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: osd class default list = * 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: osd class load list = * 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: osd client watch timeout = 240 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: osd debug verify cached snaps = True 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: osd debug verify missing on start = True 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: osd fast shutdown = False 2026-02-17T11:52:21.281 INFO:teuthology.orchestra.run.trial010.stdout: osd mclock override recovery settings = True 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: osd objectstore = bluestore 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: osd op queue = debug_random 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: osd op queue cut off = debug_random 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: osd shutdown pgref assert = True 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout:[mgr] 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: debug ms = 1 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: debug mgr = 20 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: debug mon = 20 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: debug auth = 20 2026-02-17T11:52:21.282 INFO:teuthology.orchestra.run.trial010.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout: mgr/telemetry/nag = false 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout:[mon] 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout: debug ms = 1 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout: debug mon = 20 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout: debug paxos = 20 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout: debug auth = 20 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout: mon data avail warn = 5 2026-02-17T11:52:21.283 INFO:teuthology.orchestra.run.trial010.stdout: mon mgr mkfs grace = 240 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: mon osd reporter subtree level = osd 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: mon osd prime pg temp = true 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:52:21.284 INFO:teuthology.orchestra.run.trial010.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: # 1m isn't quite enough 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: mon min osdmap epochs = 50 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: mon osd crush smoke test = False 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: mon osdmap full prune interval = 2 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: mon osdmap full prune min = 15 2026-02-17T11:52:21.285 INFO:teuthology.orchestra.run.trial010.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout: mon scrub interval = 300 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout: mon warn on pool no app = False 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout: paxos service trim min = 10 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout:[client] 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout: rgw cache enabled = true 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout: rgw enable ops log = true 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout: rgw enable usage log = true 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:52:21.286 INFO:teuthology.orchestra.run.trial010.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:52:21.287 INFO:teuthology.orchestra.run.trial010.stdout: debug monc = 20 2026-02-17T11:52:21.287 INFO:teuthology.orchestra.run.trial010.stdout: debug ms = 1 2026-02-17T11:52:21.287 INFO:teuthology.orchestra.run.trial010.stdout: debug objecter = 20 2026-02-17T11:52:21.287 INFO:teuthology.orchestra.run.trial010.stdout: debug rados = 20 2026-02-17T11:52:21.287 INFO:teuthology.orchestra.run.trial010.stdout:[mon.a] 2026-02-17T11:52:21.287 INFO:teuthology.orchestra.run.trial010.stdout:[mon.b] 2026-02-17T11:52:21.287 INFO:teuthology.orchestra.run.trial010.stdout:[mon.c] 2026-02-17T11:52:21.289 INFO:teuthology.orchestra.run.trial174.stdout:[global] 2026-02-17T11:52:21.289 INFO:teuthology.orchestra.run.trial174.stdout: chdir = "" 2026-02-17T11:52:21.289 INFO:teuthology.orchestra.run.trial174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:52:21.289 INFO:teuthology.orchestra.run.trial174.stdout: auth supported = cephx 2026-02-17T11:52:21.289 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.289 INFO:teuthology.orchestra.run.trial174.stdout: filestore xattr use omap = true 2026-02-17T11:52:21.289 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.289 INFO:teuthology.orchestra.run.trial174.stdout: mon clock drift allowed = 1.000 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: osd crush chooseleaf type = 0 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: auth debug = true 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: ms die on old message = true 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: ms die on bug = true 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: mon pg warn max object skew = 0 2026-02-17T11:52:21.290 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: osd pool default size = 2 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: mon osd allow primary affinity = true 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: mon osd allow pg remap = true 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on no sortbitwise = false 2026-02-17T11:52:21.291 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on too few osds = false 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: mon_allow_pool_size_one = true 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: osd default data pool replay window = 5 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: mon allow pool delete = true 2026-02-17T11:52:21.292 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: mon cluster log file level = debug 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: debug asserts on shutdown = true 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: mon health detail to clog = false 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: mon host = "10.20.193.10,10.20.193.71,10.20.193.153" 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: mon client directed command retry = 5 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: mon election default strategy = 1 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: ms inject socket failures = 5000 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: ms type = async 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: osd heartbeat grace = 160 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: osd op thread timeout = 150 2026-02-17T11:52:21.293 INFO:teuthology.orchestra.run.trial174.stdout: fsid = e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout:[osd] 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: osd journal size = 100 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: osd scrub load threshold = 5.0 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: osd scrub max interval = 600 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: osd recover clone overlap = true 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: osd recovery max chunk = 1048576 2026-02-17T11:52:21.294 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: osd debug shutdown = true 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: osd debug op order = true 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: osd debug verify stray on activate = true 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: osd debug trim objects = true 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: osd open classes on start = true 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: osd debug pg log writeout = true 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:52:21.295 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.296 INFO:teuthology.orchestra.run.trial174.stdout: osd map max advance = 10 2026-02-17T11:52:21.296 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.296 INFO:teuthology.orchestra.run.trial174.stdout: journal zero on create = true 2026-02-17T11:52:21.296 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.296 INFO:teuthology.orchestra.run.trial174.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:52:21.296 INFO:teuthology.orchestra.run.trial174.stdout: filestore apply finisher threads = 3 2026-02-17T11:52:21.296 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.296 INFO:teuthology.orchestra.run.trial174.stdout: bdev debug aio = true 2026-02-17T11:52:21.296 INFO:teuthology.orchestra.run.trial174.stdout: osd debug misdirected ops = true 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: bdev async discard = True 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: bdev enable discard = True 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: bluestore allocator = bitmap 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: bluestore block size = 96636764160 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: bluestore fsck on mount = True 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: bluestore zero block detection = True 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: debug bluefs = 1 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: debug bluestore = 1 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: debug monc = 20 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: debug ms = 1 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: debug osd = 20 2026-02-17T11:52:21.297 INFO:teuthology.orchestra.run.trial174.stdout: debug rocksdb = 10 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: mon osd full ratio = 0.9 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: osd class default list = * 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: osd class load list = * 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: osd client watch timeout = 240 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: osd debug verify cached snaps = True 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: osd debug verify missing on start = True 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: osd fast shutdown = False 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: osd mclock override recovery settings = True 2026-02-17T11:52:21.298 INFO:teuthology.orchestra.run.trial174.stdout: osd objectstore = bluestore 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout: osd op queue = debug_random 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout: osd op queue cut off = debug_random 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout: osd shutdown pgref assert = True 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout:[mgr] 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout: debug ms = 1 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout: debug mgr = 20 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout: debug mon = 20 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout: debug auth = 20 2026-02-17T11:52:21.299 INFO:teuthology.orchestra.run.trial174.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: mgr/telemetry/nag = false 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout:[mon] 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: debug ms = 1 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: debug mon = 20 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: debug paxos = 20 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: debug auth = 20 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: mon data avail warn = 5 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: mon mgr mkfs grace = 240 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:52:21.300 INFO:teuthology.orchestra.run.trial174.stdout: mon osd reporter subtree level = osd 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: mon osd prime pg temp = true 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.301 INFO:teuthology.orchestra.run.trial174.stdout: # 1m isn't quite enough 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: mon min osdmap epochs = 50 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: mon osd crush smoke test = False 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: mon osdmap full prune interval = 2 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: mon osdmap full prune min = 15 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: mon scrub interval = 300 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on pool no app = False 2026-02-17T11:52:21.302 INFO:teuthology.orchestra.run.trial174.stdout: paxos service trim min = 10 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout:[client] 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: rgw cache enabled = true 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: rgw enable ops log = true 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: rgw enable usage log = true 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: debug monc = 20 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: debug ms = 1 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: debug objecter = 20 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout: debug rados = 20 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout:[mon.a] 2026-02-17T11:52:21.303 INFO:teuthology.orchestra.run.trial174.stdout:[mon.b] 2026-02-17T11:52:21.304 INFO:teuthology.orchestra.run.trial174.stdout:[mon.c] 2026-02-17T11:52:21.305 INFO:teuthology.orchestra.run.trial153.stdout:[global] 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: chdir = "" 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: auth supported = cephx 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: filestore xattr use omap = true 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: mon clock drift allowed = 1.000 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: osd crush chooseleaf type = 0 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: auth debug = true 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.306 INFO:teuthology.orchestra.run.trial153.stdout: ms die on old message = true 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: ms die on bug = true 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: mon pg warn max object skew = 0 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: osd pool default size = 2 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: mon osd allow primary affinity = true 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: mon osd allow pg remap = true 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:52:21.307 INFO:teuthology.orchestra.run.trial153.stdout: mon warn on no sortbitwise = false 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: mon warn on too few osds = false 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: mon_allow_pool_size_one = true 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: osd default data pool replay window = 5 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.308 INFO:teuthology.orchestra.run.trial153.stdout: mon allow pool delete = true 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: mon cluster log file level = debug 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: debug asserts on shutdown = true 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: mon health detail to clog = false 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: mon host = "10.20.193.10,10.20.193.71,10.20.193.153" 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: mon client directed command retry = 5 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: mon election default strategy = 1 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: ms inject socket failures = 5000 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: ms type = async 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: osd heartbeat grace = 160 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: osd op thread timeout = 150 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: fsid = e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.309 INFO:teuthology.orchestra.run.trial153.stdout:[osd] 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd journal size = 100 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd scrub load threshold = 5.0 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd scrub max interval = 600 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd recover clone overlap = true 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd recovery max chunk = 1048576 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd debug shutdown = true 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd debug op order = true 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd debug verify stray on activate = true 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: osd debug trim objects = true 2026-02-17T11:52:21.310 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: osd open classes on start = true 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: osd debug pg log writeout = true 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: osd map max advance = 10 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: journal zero on create = true 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: filestore apply finisher threads = 3 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: bdev debug aio = true 2026-02-17T11:52:21.311 INFO:teuthology.orchestra.run.trial153.stdout: osd debug misdirected ops = true 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: bdev async discard = True 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: bdev enable discard = True 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: bluestore allocator = bitmap 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: bluestore block size = 96636764160 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: bluestore fsck on mount = True 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: bluestore zero block detection = True 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: debug bluefs = 1 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: debug bluestore = 1 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: debug monc = 20 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: debug ms = 1 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: debug osd = 20 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: debug rocksdb = 10 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: mon osd full ratio = 0.9 2026-02-17T11:52:21.312 INFO:teuthology.orchestra.run.trial153.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd class default list = * 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd class load list = * 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd client watch timeout = 240 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd debug verify cached snaps = True 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd debug verify missing on start = True 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd fast shutdown = False 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd mclock override recovery settings = True 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd objectstore = bluestore 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd op queue = debug_random 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd op queue cut off = debug_random 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: osd shutdown pgref assert = True 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout:[mgr] 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: debug ms = 1 2026-02-17T11:52:21.313 INFO:teuthology.orchestra.run.trial153.stdout: debug mgr = 20 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: debug mon = 20 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: debug auth = 20 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: mgr/telemetry/nag = false 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout:[mon] 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: debug ms = 1 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: debug mon = 20 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: debug paxos = 20 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: debug auth = 20 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: mon data avail warn = 5 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: mon mgr mkfs grace = 240 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:52:21.314 INFO:teuthology.orchestra.run.trial153.stdout: mon osd reporter subtree level = osd 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: mon osd prime pg temp = true 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: # 1m isn't quite enough 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: mon min osdmap epochs = 50 2026-02-17T11:52:21.315 INFO:teuthology.orchestra.run.trial153.stdout: mon osd crush smoke test = False 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: mon osdmap full prune interval = 2 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: mon osdmap full prune min = 15 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: mon scrub interval = 300 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: mon warn on pool no app = False 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: paxos service trim min = 10 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout:[client] 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: rgw cache enabled = true 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: rgw enable ops log = true 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: rgw enable usage log = true 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: debug monc = 20 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: debug ms = 1 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: debug objecter = 20 2026-02-17T11:52:21.316 INFO:teuthology.orchestra.run.trial153.stdout: debug rados = 20 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial153.stdout:[mon.a] 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial153.stdout:[mon.b] 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial153.stdout:[mon.c] 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout:[global] 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout: chdir = "" 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout: auth supported = cephx 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout: filestore xattr use omap = true 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout: mon clock drift allowed = 1.000 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.317 INFO:teuthology.orchestra.run.trial071.stdout: osd crush chooseleaf type = 0 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: auth debug = true 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: ms die on old message = true 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: ms die on bug = true 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: mon pg warn max object skew = 0 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: osd pool default size = 2 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: mon osd allow primary affinity = true 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: mon osd allow pg remap = true 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:52:21.318 INFO:teuthology.orchestra.run.trial071.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon warn on no sortbitwise = false 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon warn on too few osds = false 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon_allow_pool_size_one = true 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: osd default data pool replay window = 5 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon allow pool delete = true 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon cluster log file level = debug 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: debug asserts on shutdown = true 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon health detail to clog = false 2026-02-17T11:52:21.319 INFO:teuthology.orchestra.run.trial071.stdout: mon host = "10.20.193.10,10.20.193.71,10.20.193.153" 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: mon client directed command retry = 5 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: mon election default strategy = 1 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: ms inject socket failures = 5000 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: ms type = async 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: osd heartbeat grace = 160 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: osd op thread timeout = 150 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: fsid = e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout:[osd] 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: osd journal size = 100 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: osd scrub load threshold = 5.0 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: osd scrub max interval = 600 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: osd recover clone overlap = true 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: osd recovery max chunk = 1048576 2026-02-17T11:52:21.320 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: osd debug shutdown = true 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: osd debug op order = true 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: osd debug verify stray on activate = true 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: osd debug trim objects = true 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: osd open classes on start = true 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: osd debug pg log writeout = true 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: osd map max advance = 10 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: journal zero on create = true 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: filestore apply finisher threads = 3 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: bdev debug aio = true 2026-02-17T11:52:21.321 INFO:teuthology.orchestra.run.trial071.stdout: osd debug misdirected ops = true 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: bdev async discard = True 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: bdev enable discard = True 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: bluestore allocator = bitmap 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: bluestore block size = 96636764160 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: bluestore fsck on mount = True 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: bluestore zero block detection = True 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: debug bluefs = 1 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: debug bluestore = 1 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: debug monc = 20 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: debug ms = 1 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: debug osd = 20 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: debug rocksdb = 10 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: mon osd full ratio = 0.9 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: osd class default list = * 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: osd class load list = * 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: osd client watch timeout = 240 2026-02-17T11:52:21.322 INFO:teuthology.orchestra.run.trial071.stdout: osd debug verify cached snaps = True 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: osd debug verify missing on start = True 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: osd fast shutdown = False 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: osd mclock override recovery settings = True 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: osd objectstore = bluestore 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: osd op queue = debug_random 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: osd op queue cut off = debug_random 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: osd shutdown pgref assert = True 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout:[mgr] 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: debug ms = 1 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: debug mgr = 20 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: debug mon = 20 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: debug auth = 20 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: mgr/telemetry/nag = false 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout:[mon] 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: debug ms = 1 2026-02-17T11:52:21.323 INFO:teuthology.orchestra.run.trial071.stdout: debug mon = 20 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: debug paxos = 20 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: debug auth = 20 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: mon data avail warn = 5 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: mon mgr mkfs grace = 240 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: mon osd reporter subtree level = osd 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: mon osd prime pg temp = true 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: # 1m isn't quite enough 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:52:21.324 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: mon min osdmap epochs = 50 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: mon osd crush smoke test = False 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: mon osdmap full prune interval = 2 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: mon osdmap full prune min = 15 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: mon scrub interval = 300 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: mon warn on pool no app = False 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: paxos service trim min = 10 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout:[client] 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: rgw cache enabled = true 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: rgw enable ops log = true 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: rgw enable usage log = true 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: debug monc = 20 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: debug ms = 1 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: debug objecter = 20 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout: debug rados = 20 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout:[mon.a] 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout:[mon.b] 2026-02-17T11:52:21.325 INFO:teuthology.orchestra.run.trial071.stdout:[mon.c] 2026-02-17T11:52:21.326 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T11:52:21.327 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T11:52:21.389 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T11:52:21.389 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:21.389 DEBUG:teuthology.orchestra.run.trial010:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T11:52:21.447 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:21.447 DEBUG:teuthology.orchestra.run.trial010:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T11:52:21.504 INFO:tasks.ceph:Sending monmap to node ubuntu@trial010.front.sepia.ceph.com 2026-02-17T11:52:21.504 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:21.504 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:52:21.504 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:52:21.576 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:52:21.576 DEBUG:teuthology.orchestra.run.trial010:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:21.631 INFO:tasks.ceph:Sending monmap to node ubuntu@trial071.front.sepia.ceph.com 2026-02-17T11:52:21.631 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:52:21.631 DEBUG:teuthology.orchestra.run.trial071:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:52:21.631 DEBUG:teuthology.orchestra.run.trial071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:52:21.662 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:52:21.662 DEBUG:teuthology.orchestra.run.trial071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:21.720 INFO:tasks.ceph:Sending monmap to node ubuntu@trial153.front.sepia.ceph.com 2026-02-17T11:52:21.721 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:52:21.721 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:52:21.721 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:52:21.756 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:52:21.756 DEBUG:teuthology.orchestra.run.trial153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:21.813 INFO:tasks.ceph:Sending monmap to node ubuntu@trial174.front.sepia.ceph.com 2026-02-17T11:52:21.814 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:52:21.814 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:52:21.814 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:52:21.848 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:52:21.849 DEBUG:teuthology.orchestra.run.trial174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:21.904 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T11:52:21.905 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T11:52:21.905 DEBUG:teuthology.orchestra.run.trial010:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T11:52:21.950 INFO:teuthology.orchestra.run.trial010.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T11:52:21.953 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:52:21.996 INFO:teuthology.orchestra.run.trial174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:52:21.998 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T11:52:21.999 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T11:52:21.999 DEBUG:teuthology.orchestra.run.trial174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T11:52:22.032 INFO:teuthology.orchestra.run.trial174.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T11:52:22.043 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T11:52:22.043 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial010.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial071.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial153.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial174.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-17T11:52:22.044 DEBUG:teuthology.orchestra.run.trial010:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T11:52:22.069 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:22.069 INFO:tasks.ceph:role: osd.0 2026-02-17T11:52:22.069 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial010.front.sepia.ceph.com 2026-02-17T11:52:22.069 DEBUG:teuthology.orchestra.run.trial010:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:52:22.134 INFO:teuthology.orchestra.run.trial010.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:52:22.134 INFO:teuthology.orchestra.run.trial010.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:52:22.135 INFO:teuthology.orchestra.run.trial010.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:52:22.135 INFO:teuthology.orchestra.run.trial010.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:52:22.135 INFO:teuthology.orchestra.run.trial010.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:52:22.135 INFO:teuthology.orchestra.run.trial010.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:52:22.135 INFO:teuthology.orchestra.run.trial010.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:52:22.135 INFO:teuthology.orchestra.run.trial010.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:52:22.135 INFO:teuthology.orchestra.run.trial010.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:52:22.135 INFO:teuthology.orchestra.run.trial010.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:52:22.710 INFO:teuthology.orchestra.run.trial010.stdout:Discarding blocks...Done. 2026-02-17T11:52:22.712 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial010.front.sepia.ceph.com -o noatime 2026-02-17T11:52:22.712 DEBUG:teuthology.orchestra.run.trial010:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T11:52:22.780 DEBUG:teuthology.orchestra.run.trial010:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T11:52:22.849 DEBUG:teuthology.orchestra.run.trial010:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-17T11:52:22.912 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:22.912 INFO:tasks.ceph:role: osd.4 2026-02-17T11:52:22.912 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial010.front.sepia.ceph.com 2026-02-17T11:52:22.913 DEBUG:teuthology.orchestra.run.trial010:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:52:22.979 INFO:teuthology.orchestra.run.trial010.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:52:23.536 INFO:teuthology.orchestra.run.trial010.stdout:Discarding blocks...Done. 2026-02-17T11:52:23.538 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial010.front.sepia.ceph.com -o noatime 2026-02-17T11:52:23.539 DEBUG:teuthology.orchestra.run.trial010:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-17T11:52:23.607 DEBUG:teuthology.orchestra.run.trial010:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-17T11:52:23.672 DEBUG:teuthology.orchestra.run.trial010:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-17T11:52:23.738 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:23.738 INFO:tasks.ceph:role: osd.8 2026-02-17T11:52:23.738 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial010.front.sepia.ceph.com 2026-02-17T11:52:23.739 DEBUG:teuthology.orchestra.run.trial010:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:52:23.803 INFO:teuthology.orchestra.run.trial010.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:52:23.803 INFO:teuthology.orchestra.run.trial010.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:52:23.803 INFO:teuthology.orchestra.run.trial010.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:52:23.803 INFO:teuthology.orchestra.run.trial010.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:52:23.803 INFO:teuthology.orchestra.run.trial010.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:52:23.803 INFO:teuthology.orchestra.run.trial010.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:52:23.803 INFO:teuthology.orchestra.run.trial010.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:52:23.803 INFO:teuthology.orchestra.run.trial010.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:52:23.804 INFO:teuthology.orchestra.run.trial010.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:52:23.804 INFO:teuthology.orchestra.run.trial010.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:52:24.363 INFO:teuthology.orchestra.run.trial010.stdout:Discarding blocks...Done. 2026-02-17T11:52:24.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial010.front.sepia.ceph.com -o noatime 2026-02-17T11:52:24.365 DEBUG:teuthology.orchestra.run.trial010:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-17T11:52:24.434 DEBUG:teuthology.orchestra.run.trial010:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-17T11:52:24.500 DEBUG:teuthology.orchestra.run.trial010:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-17T11:52:24.565 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:24.565 INFO:tasks.ceph:role: osd.12 2026-02-17T11:52:24.565 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial010.front.sepia.ceph.com 2026-02-17T11:52:24.565 DEBUG:teuthology.orchestra.run.trial010:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:52:24.630 INFO:teuthology.orchestra.run.trial010.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:52:25.188 INFO:teuthology.orchestra.run.trial010.stdout:Discarding blocks...Done. 2026-02-17T11:52:25.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial010.front.sepia.ceph.com -o noatime 2026-02-17T11:52:25.191 DEBUG:teuthology.orchestra.run.trial010:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-17T11:52:25.272 DEBUG:teuthology.orchestra.run.trial010:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-17T11:52:25.339 DEBUG:teuthology.orchestra.run.trial010:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:25.417+0000 7f6b0d6e9780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T11:52:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:25.417+0000 7f6b0d6e9780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T11:52:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:25.417+0000 7f6b0d6e9780 -1 bdev(0x5603bd683800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T11:52:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:25.417+0000 7f6b0d6e9780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T11:52:29.298 DEBUG:teuthology.orchestra.run.trial010:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T11:52:29.363 DEBUG:teuthology.orchestra.run.trial010:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:29.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:29.441+0000 7f6768fd4780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-17T11:52:29.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:29.441+0000 7f6768fd4780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-17T11:52:29.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:29.441+0000 7f6768fd4780 -1 bdev(0x556014601800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-17T11:52:29.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:29.441+0000 7f6768fd4780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-17T11:52:33.322 DEBUG:teuthology.orchestra.run.trial010:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-17T11:52:33.386 DEBUG:teuthology.orchestra.run.trial010:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:33.465 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:33.463+0000 7fd7d0814780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-17T11:52:33.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:33.463+0000 7fd7d0814780 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-17T11:52:33.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:33.463+0000 7fd7d0814780 -1 bdev(0x55c8d18d7800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-17T11:52:33.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:33.463+0000 7fd7d0814780 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-17T11:52:37.356 DEBUG:teuthology.orchestra.run.trial010:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-17T11:52:37.421 DEBUG:teuthology.orchestra.run.trial010:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:37.500 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:37.497+0000 7ff9393f7780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-17T11:52:37.500 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:37.497+0000 7ff9393f7780 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-17T11:52:37.500 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:37.497+0000 7ff9393f7780 -1 bdev(0x55ff26ddf800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-17T11:52:37.500 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:52:37.498+0000 7ff9393f7780 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-17T11:52:41.381 DEBUG:teuthology.orchestra.run.trial010:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-17T11:52:41.447 DEBUG:teuthology.orchestra.run.trial071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T11:52:41.472 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:41.472 INFO:tasks.ceph:role: osd.1 2026-02-17T11:52:41.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial071.front.sepia.ceph.com 2026-02-17T11:52:41.472 DEBUG:teuthology.orchestra.run.trial071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:52:41.537 INFO:teuthology.orchestra.run.trial071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:52:41.538 INFO:teuthology.orchestra.run.trial071.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:52:41.538 INFO:teuthology.orchestra.run.trial071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:52:41.538 INFO:teuthology.orchestra.run.trial071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:52:41.538 INFO:teuthology.orchestra.run.trial071.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:52:41.538 INFO:teuthology.orchestra.run.trial071.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:52:41.538 INFO:teuthology.orchestra.run.trial071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:52:41.538 INFO:teuthology.orchestra.run.trial071.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:52:41.538 INFO:teuthology.orchestra.run.trial071.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:52:41.539 INFO:teuthology.orchestra.run.trial071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:52:42.107 INFO:teuthology.orchestra.run.trial071.stdout:Discarding blocks...Done. 2026-02-17T11:52:42.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial071.front.sepia.ceph.com -o noatime 2026-02-17T11:52:42.109 DEBUG:teuthology.orchestra.run.trial071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-17T11:52:42.180 DEBUG:teuthology.orchestra.run.trial071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T11:52:42.247 DEBUG:teuthology.orchestra.run.trial071:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-17T11:52:42.312 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:42.312 INFO:tasks.ceph:role: osd.5 2026-02-17T11:52:42.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial071.front.sepia.ceph.com 2026-02-17T11:52:42.312 DEBUG:teuthology.orchestra.run.trial071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:52:42.376 INFO:teuthology.orchestra.run.trial071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:52:42.377 INFO:teuthology.orchestra.run.trial071.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:52:42.377 INFO:teuthology.orchestra.run.trial071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:52:42.377 INFO:teuthology.orchestra.run.trial071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:52:42.377 INFO:teuthology.orchestra.run.trial071.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:52:42.377 INFO:teuthology.orchestra.run.trial071.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:52:42.377 INFO:teuthology.orchestra.run.trial071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:52:42.377 INFO:teuthology.orchestra.run.trial071.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:52:42.377 INFO:teuthology.orchestra.run.trial071.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:52:42.378 INFO:teuthology.orchestra.run.trial071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:52:42.937 INFO:teuthology.orchestra.run.trial071.stdout:Discarding blocks...Done. 2026-02-17T11:52:42.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial071.front.sepia.ceph.com -o noatime 2026-02-17T11:52:42.939 DEBUG:teuthology.orchestra.run.trial071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-17T11:52:43.006 DEBUG:teuthology.orchestra.run.trial071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-17T11:52:43.071 DEBUG:teuthology.orchestra.run.trial071:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-17T11:52:43.136 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:43.136 INFO:tasks.ceph:role: osd.9 2026-02-17T11:52:43.136 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial071.front.sepia.ceph.com 2026-02-17T11:52:43.137 DEBUG:teuthology.orchestra.run.trial071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:52:43.200 INFO:teuthology.orchestra.run.trial071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:52:43.200 INFO:teuthology.orchestra.run.trial071.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:52:43.200 INFO:teuthology.orchestra.run.trial071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:52:43.201 INFO:teuthology.orchestra.run.trial071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:52:43.201 INFO:teuthology.orchestra.run.trial071.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:52:43.201 INFO:teuthology.orchestra.run.trial071.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:52:43.201 INFO:teuthology.orchestra.run.trial071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:52:43.201 INFO:teuthology.orchestra.run.trial071.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:52:43.201 INFO:teuthology.orchestra.run.trial071.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:52:43.201 INFO:teuthology.orchestra.run.trial071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:52:43.760 INFO:teuthology.orchestra.run.trial071.stdout:Discarding blocks...Done. 2026-02-17T11:52:43.762 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial071.front.sepia.ceph.com -o noatime 2026-02-17T11:52:43.762 DEBUG:teuthology.orchestra.run.trial071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-17T11:52:43.831 DEBUG:teuthology.orchestra.run.trial071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-17T11:52:43.897 DEBUG:teuthology.orchestra.run.trial071:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-17T11:52:43.961 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:52:43.961 INFO:tasks.ceph:role: osd.13 2026-02-17T11:52:43.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial071.front.sepia.ceph.com 2026-02-17T11:52:43.961 DEBUG:teuthology.orchestra.run.trial071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:52:44.025 INFO:teuthology.orchestra.run.trial071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:52:44.584 INFO:teuthology.orchestra.run.trial071.stdout:Discarding blocks...Done. 2026-02-17T11:52:44.586 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial071.front.sepia.ceph.com -o noatime 2026-02-17T11:52:44.586 DEBUG:teuthology.orchestra.run.trial071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-17T11:52:44.670 DEBUG:teuthology.orchestra.run.trial071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-17T11:52:44.737 DEBUG:teuthology.orchestra.run.trial071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:44.819 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:44.817+0000 7faf0081f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T11:52:44.820 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:44.817+0000 7faf0081f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T11:52:44.820 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:44.817+0000 7faf0081f780 -1 bdev(0x5652ded99800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T11:52:44.820 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:44.817+0000 7faf0081f780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T11:52:48.709 DEBUG:teuthology.orchestra.run.trial071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T11:52:48.774 DEBUG:teuthology.orchestra.run.trial071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:48.852 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:48.851+0000 7f29a4810780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-17T11:52:48.853 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:48.851+0000 7f29a4810780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-17T11:52:48.853 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:48.851+0000 7f29a4810780 -1 bdev(0x557066c13800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-17T11:52:48.853 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:48.851+0000 7f29a4810780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-17T11:52:52.746 DEBUG:teuthology.orchestra.run.trial071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-17T11:52:52.811 DEBUG:teuthology.orchestra.run.trial071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:52.889 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:52.887+0000 7f8139d62780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-17T11:52:52.889 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:52.887+0000 7f8139d62780 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-17T11:52:52.889 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:52.887+0000 7f8139d62780 -1 bdev(0x55ef14ef5800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-17T11:52:52.889 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:52.887+0000 7f8139d62780 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-17T11:52:56.768 DEBUG:teuthology.orchestra.run.trial071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-17T11:52:56.833 DEBUG:teuthology.orchestra.run.trial071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:52:56.911 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:56.909+0000 7f774aa10780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-17T11:52:56.911 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:56.909+0000 7f774aa10780 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-17T11:52:56.911 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:56.909+0000 7f774aa10780 -1 bdev(0x5588a3f75800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-17T11:52:56.912 INFO:teuthology.orchestra.run.trial071.stderr:2026-02-17T11:52:56.909+0000 7f774aa10780 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-17T11:53:00.791 DEBUG:teuthology.orchestra.run.trial071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-17T11:53:00.857 DEBUG:teuthology.orchestra.run.trial153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T11:53:00.883 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:53:00.883 INFO:tasks.ceph:role: osd.2 2026-02-17T11:53:00.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial153.front.sepia.ceph.com 2026-02-17T11:53:00.884 DEBUG:teuthology.orchestra.run.trial153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:00.948 INFO:teuthology.orchestra.run.trial153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:01.517 INFO:teuthology.orchestra.run.trial153.stdout:Discarding blocks...Done. 2026-02-17T11:53:01.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial153.front.sepia.ceph.com -o noatime 2026-02-17T11:53:01.520 DEBUG:teuthology.orchestra.run.trial153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-17T11:53:01.588 DEBUG:teuthology.orchestra.run.trial153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T11:53:01.655 DEBUG:teuthology.orchestra.run.trial153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-17T11:53:01.719 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:53:01.719 INFO:tasks.ceph:role: osd.6 2026-02-17T11:53:01.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial153.front.sepia.ceph.com 2026-02-17T11:53:01.719 DEBUG:teuthology.orchestra.run.trial153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:53:01.784 INFO:teuthology.orchestra.run.trial153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:01.784 INFO:teuthology.orchestra.run.trial153.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:01.784 INFO:teuthology.orchestra.run.trial153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:01.784 INFO:teuthology.orchestra.run.trial153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:01.785 INFO:teuthology.orchestra.run.trial153.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:01.785 INFO:teuthology.orchestra.run.trial153.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:01.785 INFO:teuthology.orchestra.run.trial153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:01.785 INFO:teuthology.orchestra.run.trial153.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:01.785 INFO:teuthology.orchestra.run.trial153.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:01.785 INFO:teuthology.orchestra.run.trial153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:02.356 INFO:teuthology.orchestra.run.trial153.stdout:Discarding blocks...Done. 2026-02-17T11:53:02.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial153.front.sepia.ceph.com -o noatime 2026-02-17T11:53:02.358 DEBUG:teuthology.orchestra.run.trial153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-17T11:53:02.429 DEBUG:teuthology.orchestra.run.trial153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-17T11:53:02.497 DEBUG:teuthology.orchestra.run.trial153:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-17T11:53:02.560 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:53:02.561 INFO:tasks.ceph:role: osd.10 2026-02-17T11:53:02.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial153.front.sepia.ceph.com 2026-02-17T11:53:02.561 DEBUG:teuthology.orchestra.run.trial153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:53:02.626 INFO:teuthology.orchestra.run.trial153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:02.626 INFO:teuthology.orchestra.run.trial153.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:02.626 INFO:teuthology.orchestra.run.trial153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:02.627 INFO:teuthology.orchestra.run.trial153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:02.627 INFO:teuthology.orchestra.run.trial153.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:02.627 INFO:teuthology.orchestra.run.trial153.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:02.627 INFO:teuthology.orchestra.run.trial153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:02.627 INFO:teuthology.orchestra.run.trial153.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:02.627 INFO:teuthology.orchestra.run.trial153.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:02.627 INFO:teuthology.orchestra.run.trial153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:03.194 INFO:teuthology.orchestra.run.trial153.stdout:Discarding blocks...Done. 2026-02-17T11:53:03.196 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial153.front.sepia.ceph.com -o noatime 2026-02-17T11:53:03.196 DEBUG:teuthology.orchestra.run.trial153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-17T11:53:03.264 DEBUG:teuthology.orchestra.run.trial153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-17T11:53:03.330 DEBUG:teuthology.orchestra.run.trial153:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-17T11:53:03.395 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:53:03.396 INFO:tasks.ceph:role: osd.14 2026-02-17T11:53:03.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial153.front.sepia.ceph.com 2026-02-17T11:53:03.396 DEBUG:teuthology.orchestra.run.trial153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:53:03.462 INFO:teuthology.orchestra.run.trial153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:03.462 INFO:teuthology.orchestra.run.trial153.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:03.462 INFO:teuthology.orchestra.run.trial153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:03.462 INFO:teuthology.orchestra.run.trial153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:03.463 INFO:teuthology.orchestra.run.trial153.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:03.463 INFO:teuthology.orchestra.run.trial153.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:03.463 INFO:teuthology.orchestra.run.trial153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:03.463 INFO:teuthology.orchestra.run.trial153.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:03.463 INFO:teuthology.orchestra.run.trial153.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:03.463 INFO:teuthology.orchestra.run.trial153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:04.021 INFO:teuthology.orchestra.run.trial153.stdout:Discarding blocks...Done. 2026-02-17T11:53:04.023 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial153.front.sepia.ceph.com -o noatime 2026-02-17T11:53:04.024 DEBUG:teuthology.orchestra.run.trial153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-17T11:53:04.099 DEBUG:teuthology.orchestra.run.trial153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-17T11:53:04.165 DEBUG:teuthology.orchestra.run.trial153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:04.246 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:04.243+0000 7f12464eb780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T11:53:04.246 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:04.244+0000 7f12464eb780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T11:53:04.246 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:04.244+0000 7f12464eb780 -1 bdev(0x559915443800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:04.246 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:04.244+0000 7f12464eb780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T11:53:08.123 DEBUG:teuthology.orchestra.run.trial153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T11:53:08.188 DEBUG:teuthology.orchestra.run.trial153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:08.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:08.264+0000 7f6d4d680780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-17T11:53:08.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:08.265+0000 7f6d4d680780 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-17T11:53:08.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:08.265+0000 7f6d4d680780 -1 bdev(0x55d150a21800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:08.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:08.265+0000 7f6d4d680780 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-17T11:53:12.149 DEBUG:teuthology.orchestra.run.trial153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-17T11:53:12.215 DEBUG:teuthology.orchestra.run.trial153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:12.295 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:12.292+0000 7fc58380c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-17T11:53:12.295 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:12.293+0000 7fc58380c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-17T11:53:12.295 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:12.293+0000 7fc58380c780 -1 bdev(0x5578a347d800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:12.295 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:12.293+0000 7fc58380c780 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-17T11:53:16.173 DEBUG:teuthology.orchestra.run.trial153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-17T11:53:16.242 DEBUG:teuthology.orchestra.run.trial153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:16.321 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:16.318+0000 7f6d49319780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-17T11:53:16.321 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:16.319+0000 7f6d49319780 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-17T11:53:16.321 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:16.319+0000 7f6d49319780 -1 bdev(0x5595d7a11800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:16.321 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T11:53:16.319+0000 7f6d49319780 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-17T11:53:20.203 DEBUG:teuthology.orchestra.run.trial153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-17T11:53:20.269 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T11:53:20.295 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:53:20.295 INFO:tasks.ceph:role: osd.3 2026-02-17T11:53:20.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial174.front.sepia.ceph.com 2026-02-17T11:53:20.296 DEBUG:teuthology.orchestra.run.trial174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:53:20.361 INFO:teuthology.orchestra.run.trial174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:20.361 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:20.361 INFO:teuthology.orchestra.run.trial174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:20.361 INFO:teuthology.orchestra.run.trial174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:20.361 INFO:teuthology.orchestra.run.trial174.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:20.361 INFO:teuthology.orchestra.run.trial174.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:20.362 INFO:teuthology.orchestra.run.trial174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:20.362 INFO:teuthology.orchestra.run.trial174.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:20.362 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:20.362 INFO:teuthology.orchestra.run.trial174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:20.931 INFO:teuthology.orchestra.run.trial174.stdout:Discarding blocks...Done. 2026-02-17T11:53:20.933 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial174.front.sepia.ceph.com -o noatime 2026-02-17T11:53:20.933 DEBUG:teuthology.orchestra.run.trial174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-17T11:53:21.002 DEBUG:teuthology.orchestra.run.trial174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T11:53:21.071 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-17T11:53:21.137 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:53:21.137 INFO:tasks.ceph:role: osd.7 2026-02-17T11:53:21.138 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial174.front.sepia.ceph.com 2026-02-17T11:53:21.138 DEBUG:teuthology.orchestra.run.trial174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:53:21.204 INFO:teuthology.orchestra.run.trial174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:21.204 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:21.204 INFO:teuthology.orchestra.run.trial174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:21.204 INFO:teuthology.orchestra.run.trial174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:21.204 INFO:teuthology.orchestra.run.trial174.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:21.205 INFO:teuthology.orchestra.run.trial174.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:21.205 INFO:teuthology.orchestra.run.trial174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:21.205 INFO:teuthology.orchestra.run.trial174.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:21.205 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:21.205 INFO:teuthology.orchestra.run.trial174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:21.775 INFO:teuthology.orchestra.run.trial174.stdout:Discarding blocks...Done. 2026-02-17T11:53:21.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial174.front.sepia.ceph.com -o noatime 2026-02-17T11:53:21.777 DEBUG:teuthology.orchestra.run.trial174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-17T11:53:21.846 DEBUG:teuthology.orchestra.run.trial174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-17T11:53:21.912 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-17T11:53:21.978 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:53:21.979 INFO:tasks.ceph:role: osd.11 2026-02-17T11:53:21.979 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial174.front.sepia.ceph.com 2026-02-17T11:53:21.979 DEBUG:teuthology.orchestra.run.trial174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:53:22.042 INFO:teuthology.orchestra.run.trial174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:22.042 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:22.042 INFO:teuthology.orchestra.run.trial174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:22.042 INFO:teuthology.orchestra.run.trial174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:22.042 INFO:teuthology.orchestra.run.trial174.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:22.042 INFO:teuthology.orchestra.run.trial174.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:22.042 INFO:teuthology.orchestra.run.trial174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:22.042 INFO:teuthology.orchestra.run.trial174.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:22.043 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:22.043 INFO:teuthology.orchestra.run.trial174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:22.598 INFO:teuthology.orchestra.run.trial174.stdout:Discarding blocks...Done. 2026-02-17T11:53:22.600 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial174.front.sepia.ceph.com -o noatime 2026-02-17T11:53:22.600 DEBUG:teuthology.orchestra.run.trial174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-17T11:53:22.669 DEBUG:teuthology.orchestra.run.trial174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-17T11:53:22.736 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-17T11:53:22.801 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:53:22.801 INFO:tasks.ceph:role: osd.15 2026-02-17T11:53:22.801 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial174.front.sepia.ceph.com 2026-02-17T11:53:22.801 DEBUG:teuthology.orchestra.run.trial174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:53:22.867 INFO:teuthology.orchestra.run.trial174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:22.867 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:22.867 INFO:teuthology.orchestra.run.trial174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:22.867 INFO:teuthology.orchestra.run.trial174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:22.868 INFO:teuthology.orchestra.run.trial174.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:22.868 INFO:teuthology.orchestra.run.trial174.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:22.868 INFO:teuthology.orchestra.run.trial174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:22.868 INFO:teuthology.orchestra.run.trial174.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:22.868 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:22.868 INFO:teuthology.orchestra.run.trial174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:23.422 INFO:teuthology.orchestra.run.trial174.stdout:Discarding blocks...Done. 2026-02-17T11:53:23.423 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial174.front.sepia.ceph.com -o noatime 2026-02-17T11:53:23.423 DEBUG:teuthology.orchestra.run.trial174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-17T11:53:23.506 DEBUG:teuthology.orchestra.run.trial174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-17T11:53:23.575 DEBUG:teuthology.orchestra.run.trial174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:23.654 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:23.653+0000 7efeca625780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T11:53:23.654 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:23.653+0000 7efeca625780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T11:53:23.655 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:23.653+0000 7efeca625780 -1 bdev(0x55a3b453d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:23.655 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:23.653+0000 7efeca625780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T11:53:27.533 DEBUG:teuthology.orchestra.run.trial174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T11:53:27.599 DEBUG:teuthology.orchestra.run.trial174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:27.677 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:27.674+0000 7f8a2793f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-17T11:53:27.678 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:27.674+0000 7f8a2793f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-17T11:53:27.678 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:27.675+0000 7f8a2793f780 -1 bdev(0x55d648579800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:27.678 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:27.675+0000 7f8a2793f780 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-17T11:53:31.558 DEBUG:teuthology.orchestra.run.trial174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-17T11:53:31.624 DEBUG:teuthology.orchestra.run.trial174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:31.701 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:31.699+0000 7f1dbf3b2780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-17T11:53:31.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:31.699+0000 7f1dbf3b2780 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-17T11:53:31.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:31.699+0000 7f1dbf3b2780 -1 bdev(0x560c90cfb800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:31.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:31.699+0000 7f1dbf3b2780 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-17T11:53:35.588 DEBUG:teuthology.orchestra.run.trial174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-17T11:53:35.652 DEBUG:teuthology.orchestra.run.trial174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:35.730 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:35.727+0000 7f38eae13780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-17T11:53:35.730 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:35.728+0000 7f38eae13780 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-17T11:53:35.731 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:35.728+0000 7f38eae13780 -1 bdev(0x559bea5cd800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:35.731 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:53:35.728+0000 7f38eae13780 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-17T11:53:39.607 DEBUG:teuthology.orchestra.run.trial174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-17T11:53:39.671 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T11:53:39.672 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:53:39.672 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-17T11:53:39.698 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:53:39.698 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T11:53:39.762 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:53:39.763 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-17T11:53:39.826 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:53:39.826 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-17T11:53:39.889 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:53:39.889 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-17T11:53:39.955 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:53:39.955 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T11:53:39.980 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:53:39.980 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-17T11:53:40.043 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:53:40.044 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-17T11:53:40.107 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:53:40.107 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-17T11:53:40.171 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:53:40.171 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T11:53:40.198 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:53:40.198 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-17T11:53:40.262 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:53:40.262 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-17T11:53:40.325 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:53:40.325 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-17T11:53:40.389 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:53:40.389 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T11:53:40.414 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:53:40.415 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T11:53:40.478 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:53:40.479 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-17T11:53:40.542 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:53:40.542 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-17T11:53:40.606 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:53:40.606 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-17T11:53:40.670 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:53:40.670 DEBUG:teuthology.orchestra.run.trial174:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T11:53:40.725 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T11:53:40.725 DEBUG:teuthology.orchestra.run.trial010:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:53:40.727 DEBUG:teuthology.orchestra.run.trial071:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:53:40.729 DEBUG:teuthology.orchestra.run.trial153:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout:[mgr.y] 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout: key = AQB1VpRpFpeWOBAAi0MoywLSVlfUEw3kltCNKQ== 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout:[osd.0] 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout: key = AQB5VpRp8v/zGBAA+/xLPF/jTCQHsrdrXxMa2w== 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout:[osd.4] 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout: key = AQB9VpRphYtdGhAACbMeNYbv5N1FtdYJ2h+gfw== 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout:[osd.8] 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCBVpRpUiqzGxAA1TEgTMadCaxESubVggZCbg== 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout:[osd.12] 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCFVpRpF8C8HRAAE5sDbas78NI03ocwcIynfw== 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout:[osd.1] 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCMVpRpEWnEMBAA9R1AMHMFIcfW3zVWMzXNtA== 2026-02-17T11:53:40.749 INFO:teuthology.orchestra.run.trial010.stdout:[osd.5] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCQVpRpnPnFMhAAqiFlP0ZIKqJqUfiVAPgtrQ== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.9] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCUVpRpqMXsNBAAx7vc7JMcNF+fO4Oegr4psw== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.13] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCYVpRpD488NhAAH8ygiNsVozj36EnS+QW+Ew== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.2] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCgVpRplmKaDhAA4ofPfsoS/PNF+U+MP2Ky5w== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.6] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCkVpRp8vDaDxAA7oJqqm/RjE4FkoD1cW7Clg== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.10] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCoVpRpNoqEERAAaFpqjQm7m/iGfVUxYneN6w== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.14] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCsVpRpV0IQExAARFUUgeWUOpki/B75eBa0FA== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[mgr.x] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQB1VpRpHmVWOxAAOLgaVn+i/0tIz7oC6AFTwg== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.3] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQCzVpRpmFr1JhAA+N+KVtsDcYw0KjbsjVVU4A== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.7] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQC3VpRp9epNKBAACUJdBj9EyrBTGJ/DoZ4HfA== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.11] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQC7VpRp3jLCKRAAAe6So3VDdY6/afvGHASbQg== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[osd.15] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQC/VpRpbxh5KxAAcFWcSKhpiPDHDySAp+CmDQ== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout:[client.0] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial010.stdout: key = AQB2VpRpSRvnARAAu0DGoeME/xQta/hwFELUhA== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial071.stdout:[mgr.y] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial071.stdout: key = AQB1VpRpFpeWOBAAi0MoywLSVlfUEw3kltCNKQ== 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial071.stdout:[osd.0] 2026-02-17T11:53:40.750 INFO:teuthology.orchestra.run.trial071.stdout: key = AQB5VpRp8v/zGBAA+/xLPF/jTCQHsrdrXxMa2w== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.4] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQB9VpRphYtdGhAACbMeNYbv5N1FtdYJ2h+gfw== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.8] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCBVpRpUiqzGxAA1TEgTMadCaxESubVggZCbg== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.12] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCFVpRpF8C8HRAAE5sDbas78NI03ocwcIynfw== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.1] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCMVpRpEWnEMBAA9R1AMHMFIcfW3zVWMzXNtA== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.5] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCQVpRpnPnFMhAAqiFlP0ZIKqJqUfiVAPgtrQ== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.9] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCUVpRpqMXsNBAAx7vc7JMcNF+fO4Oegr4psw== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.13] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCYVpRpD488NhAAH8ygiNsVozj36EnS+QW+Ew== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.2] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCgVpRplmKaDhAA4ofPfsoS/PNF+U+MP2Ky5w== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.6] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCkVpRp8vDaDxAA7oJqqm/RjE4FkoD1cW7Clg== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.10] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCoVpRpNoqEERAAaFpqjQm7m/iGfVUxYneN6w== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.14] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCsVpRpV0IQExAARFUUgeWUOpki/B75eBa0FA== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[mgr.x] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQB1VpRpHmVWOxAAOLgaVn+i/0tIz7oC6AFTwg== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.3] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQCzVpRpmFr1JhAA+N+KVtsDcYw0KjbsjVVU4A== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.7] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQC3VpRp9epNKBAACUJdBj9EyrBTGJ/DoZ4HfA== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.11] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQC7VpRp3jLCKRAAAe6So3VDdY6/afvGHASbQg== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[osd.15] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQC/VpRpbxh5KxAAcFWcSKhpiPDHDySAp+CmDQ== 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout:[client.0] 2026-02-17T11:53:40.751 INFO:teuthology.orchestra.run.trial071.stdout: key = AQB2VpRpSRvnARAAu0DGoeME/xQta/hwFELUhA== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[mgr.y] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQB1VpRpFpeWOBAAi0MoywLSVlfUEw3kltCNKQ== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.0] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQB5VpRp8v/zGBAA+/xLPF/jTCQHsrdrXxMa2w== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.4] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQB9VpRphYtdGhAACbMeNYbv5N1FtdYJ2h+gfw== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.8] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCBVpRpUiqzGxAA1TEgTMadCaxESubVggZCbg== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.12] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCFVpRpF8C8HRAAE5sDbas78NI03ocwcIynfw== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.1] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCMVpRpEWnEMBAA9R1AMHMFIcfW3zVWMzXNtA== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.5] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCQVpRpnPnFMhAAqiFlP0ZIKqJqUfiVAPgtrQ== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.9] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCUVpRpqMXsNBAAx7vc7JMcNF+fO4Oegr4psw== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.13] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCYVpRpD488NhAAH8ygiNsVozj36EnS+QW+Ew== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.2] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCgVpRplmKaDhAA4ofPfsoS/PNF+U+MP2Ky5w== 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout:[osd.6] 2026-02-17T11:53:40.752 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCkVpRp8vDaDxAA7oJqqm/RjE4FkoD1cW7Clg== 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout:[osd.10] 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCoVpRpNoqEERAAaFpqjQm7m/iGfVUxYneN6w== 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout:[osd.14] 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCsVpRpV0IQExAARFUUgeWUOpki/B75eBa0FA== 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout:[mgr.x] 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout: key = AQB1VpRpHmVWOxAAOLgaVn+i/0tIz7oC6AFTwg== 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout:[osd.3] 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout: key = AQCzVpRpmFr1JhAA+N+KVtsDcYw0KjbsjVVU4A== 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout:[osd.7] 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout: key = AQC3VpRp9epNKBAACUJdBj9EyrBTGJ/DoZ4HfA== 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout:[osd.11] 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout: key = AQC7VpRp3jLCKRAAAe6So3VDdY6/afvGHASbQg== 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout:[osd.15] 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout: key = AQC/VpRpbxh5KxAAcFWcSKhpiPDHDySAp+CmDQ== 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout:[client.0] 2026-02-17T11:53:40.753 INFO:teuthology.orchestra.run.trial153.stdout: key = AQB2VpRpSRvnARAAu0DGoeME/xQta/hwFELUhA== 2026-02-17T11:53:40.754 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:53:40.794 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:53:40.797 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:53:40.836 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:40.874 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:40.877 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:40.919 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:40.955 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:40.958 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:40.999 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.033 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.036 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.078 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.122 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.132 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.177 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.204 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.216 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.254 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.283 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.295 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.334 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.363 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.372 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.412 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.444 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.453 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.496 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.523 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.534 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.577 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.603 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.613 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.656 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.682 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.693 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.734 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.763 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.772 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.812 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:53:41.840 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:53:41.850 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:53:41.891 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.920 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.928 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.970 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:41.998 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:42.005 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:42.049 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:42.077 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:42.085 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:42.128 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:42.156 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:42.165 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:42.207 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:53:42.235 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:53:42.243 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:53:42.288 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T11:53:42.288 DEBUG:teuthology.orchestra.run.trial010:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T11:53:42.337 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:53:42.425 DEBUG:teuthology.orchestra.run.trial010:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T11:53:42.450 DEBUG:teuthology.orchestra.run.trial071:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T11:53:42.475 DEBUG:teuthology.orchestra.run.trial071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:53:42.563 DEBUG:teuthology.orchestra.run.trial071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T11:53:42.588 DEBUG:teuthology.orchestra.run.trial153:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T11:53:42.613 DEBUG:teuthology.orchestra.run.trial153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:53:42.698 DEBUG:teuthology.orchestra.run.trial153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T11:53:42.723 DEBUG:teuthology.orchestra.run.trial010:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:42.726 DEBUG:teuthology.orchestra.run.trial071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:42.728 DEBUG:teuthology.orchestra.run.trial153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:42.778 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T11:53:42.778 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T11:53:42.779 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:53:42.779 DEBUG:teuthology.orchestra.run.trial010:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-17T11:53:42.783 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:53:42.784 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T11:53:42.784 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T11:53:42.784 DEBUG:teuthology.orchestra.run.trial071:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-17T11:53:42.787 INFO:tasks.ceph.mon.b:Started 2026-02-17T11:53:42.787 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T11:53:42.787 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:53:42.787 DEBUG:teuthology.orchestra.run.trial153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-17T11:53:42.821 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:53:42.821 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T11:53:42.822 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-17T11:53:42.822 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-17T11:53:42.824 INFO:tasks.ceph.mgr.y:Started 2026-02-17T11:53:42.824 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T11:53:42.825 DEBUG:teuthology.orchestra.run.trial174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-17T11:53:42.827 INFO:tasks.ceph.mgr.x:Started 2026-02-17T11:53:42.827 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T11:53:42.827 DEBUG:teuthology.orchestra.run.trial010:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T11:53:42.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.892+0000 7fa240fe6640 10 monclient: get_monmap_and_config 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.892+0000 7fa240fe6640 10 monclient: build_initial_monmap 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.892+0000 7fa240fe6640 10 monclient: monmap: 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:53:42.892604+0000 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:53:42.892604+0000 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:53:42.895 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.892+0000 7fa240fe6640 1 Processor -- start 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.892+0000 7fa240fe6640 1 -- start start 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.892+0000 7fa240fe6640 10 monclient: init 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 10 monclient: _reopen_session rank -1 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 10 monclient: _add_conns ranks=[2,0,4,3,1,5] 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa23c15d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa23c0c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:53:42.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 0x7fa23c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:42.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 10 monclient(hunting): picked mon.noname-b con 0x7fa23c153d60 addr v2:10.20.193.71:3300/0 2026-02-17T11:53:42.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c58a0 con 0x7fa23c0c92f0 2026-02-17T11:53:42.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c55c0 con 0x7fa23c15d220 2026-02-17T11:53:42.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:42.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0c7e20 con 0x7fa23c153d60 2026-02-17T11:53:42.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:42.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa240fe6640 10 monclient(hunting): authenticate will time out at 892.614313s 2026-02-17T11:53:42.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.893+0000 7fa239d74640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa23c0c92f0 legacy=0x7fa23c153650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:42.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.898+0000 7fa23ad76640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 msgr2=0x7fa23c15d600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:42.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.898+0000 7fa23ad76640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 0x7fa23c15d600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:42.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:42.899+0000 7fa23a575640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa23c15d220 legacy=0x7fa23c0c8be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:43.094+0000 7fa239d74640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa23c0c92f0 legacy=0x7fa23c153650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:43.099+0000 7fa23ad76640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 msgr2=0x7fa23c15d600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:43.099+0000 7fa23ad76640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 0x7fa23c15d600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:43.100+0000 7fa23a575640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa23c15d220 legacy=0x7fa23c0c8be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:43.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:43.495+0000 7fa239d74640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa23c0c92f0 legacy=0x7fa23c153650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:43.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:43.500+0000 7fa23ad76640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 msgr2=0x7fa23c15d600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:43.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:43.500+0000 7fa23ad76640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 0x7fa23c15d600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:43.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:43.501+0000 7fa23a575640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa23c15d220 legacy=0x7fa23c0c8be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:44.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:44.296+0000 7fa239d74640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa23c0c92f0 legacy=0x7fa23c153650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:44.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:44.301+0000 7fa23ad76640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 msgr2=0x7fa23c15d600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:44.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:44.301+0000 7fa23ad76640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 0x7fa23c15d600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:44.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:44.302+0000 7fa23a575640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa23c15d220 legacy=0x7fa23c0c8be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:45.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient(hunting): tick 2026-02-17T11:53:45.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:53:45.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:53:45.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:53:45.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 msgr2=0x7fa23c15d600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:45.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa23c153d60 0x7fa23c15d600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:45.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa23c15d220 legacy=0x7fa23c0c8be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:45.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa23c0c92f0 legacy=0x7fa23c153650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:45.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient: _add_conns ranks=[5,1,3] 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 0x7fa218005c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-c con 0x7fa218003800 addr v2:10.20.193.153:3300/0 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa2180062a0 addr v1:10.20.193.71:6789/0 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 0x7fa21800c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-a con 0x7fa21800a030 addr v2:10.20.193.10:3300/0 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c8100 con 0x7fa2180062a0 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0c7e20 con 0x7fa21800a030 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa21800dc50 con 0x7fa218003800 2026-02-17T11:53:45.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa223fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:45.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa23ad76640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:45.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa23ad76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:45.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 msgr2=0x7fa218005c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:45.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 0x7fa218005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:45.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:45.892+0000 7fa239d74640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa2180062a0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:46.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.093+0000 7fa23ad76640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:46.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.093+0000 7fa23ad76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:46.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.093+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 msgr2=0x7fa218005c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:46.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.093+0000 7fa239d74640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa2180062a0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:46.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.093+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 0x7fa218005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:46.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.494+0000 7fa23ad76640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:46.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.494+0000 7fa23ad76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:46.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.494+0000 7fa239d74640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa2180062a0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:46.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.494+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 msgr2=0x7fa218005c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:46.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:46.494+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 0x7fa218005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:47.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:47.295+0000 7fa23ad76640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:47.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:47.295+0000 7fa23ad76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:47.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:47.295+0000 7fa239d74640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa2180062a0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:47.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:47.295+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 msgr2=0x7fa218005c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:47.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:47.295+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 0x7fa218005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:48.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 10 monclient(hunting): tick 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 msgr2=0x7fa218005c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218003800 0x7fa218005c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800a030 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa2180062a0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa23ad76640 1 -- reap_dead start 2026-02-17T11:53:48.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 10 monclient: _add_conns ranks=[4,2,0,3,1,5] 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa23ad76640 1 -- reap_dead start 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 0x7fa21800c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-b con 0x7fa21800cc50 addr v2:10.20.193.71:3300/0 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa21800d0d0 addr v1:10.20.193.153:6789/0 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa218005cb0 addr v1:10.20.193.10:6789/0 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c58a0 con 0x7fa218005cb0 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c8100 con 0x7fa21800d0d0 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0c7e20 con 0x7fa21800cc50 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa223fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa23ad76640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:48.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa23a575640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:48.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa239d74640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa21800d0d0 legacy=0x7fa21800d4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:48.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:48.892+0000 7fa23a575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:49.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:49.093+0000 7fa23ad76640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:49.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:49.093+0000 7fa239d74640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa21800d0d0 legacy=0x7fa21800d4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:49.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:49.093+0000 7fa23a575640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:49.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:49.093+0000 7fa23a575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:49.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:49.494+0000 7fa23ad76640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:49.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:49.494+0000 7fa239d74640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa21800d0d0 legacy=0x7fa21800d4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:49.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:49.494+0000 7fa23a575640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:49.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:49.494+0000 7fa23a575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:50.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:50.295+0000 7fa23ad76640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:50.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:50.295+0000 7fa239d74640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa21800d0d0 legacy=0x7fa21800d4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:50.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:50.295+0000 7fa23a575640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:50.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:50.295+0000 7fa23a575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient(hunting): tick 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 msgr2=0x7fa21800c4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800cc50 0x7fa21800c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa21800d0d0 legacy=0x7fa21800d4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa218008760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient: _add_conns ranks=[5,3,1] 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 0x7fa21800f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-c con 0x7fa21800f100 addr v2:10.20.193.153:3300/0 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 0x7fa21800ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:51.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-a con 0x7fa21800fbb0 addr v2:10.20.193.10:3300/0 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa218010690 addr v1:10.20.193.71:6789/0 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c55c0 con 0x7fa218010690 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0c7e20 con 0x7fa21800fbb0 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa21800dc50 con 0x7fa21800f100 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa223fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa239d74640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 msgr2=0x7fa21800ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa239d74640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 0x7fa21800ffc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 msgr2=0x7fa21800f4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 0x7fa21800f4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:51.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:51.892+0000 7fa23ad76640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218010690 legacy=0x7fa2180171a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:52.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.093+0000 7fa239d74640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 msgr2=0x7fa21800ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:52.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.093+0000 7fa239d74640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 0x7fa21800ffc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:52.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.093+0000 7fa23ad76640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218010690 legacy=0x7fa2180171a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:52.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.093+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 msgr2=0x7fa21800f4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:52.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.093+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 0x7fa21800f4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:52.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.494+0000 7fa239d74640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 msgr2=0x7fa21800ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:52.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.494+0000 7fa239d74640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 0x7fa21800ffc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:52.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.494+0000 7fa23ad76640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218010690 legacy=0x7fa2180171a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:52.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.494+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 msgr2=0x7fa21800f4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:52.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:52.494+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 0x7fa21800f4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:53.229 INFO:tasks.ceph.mon.a.trial010.stderr:--00:00:00:10.397 44673-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/30/3a2af75e36a6fae6242833b92fa3378e78649e.debug 2026-02-17T11:53:53.276 INFO:tasks.ceph.mon.c.trial153.stderr:--00:00:00:10.404 44611-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/30/3a2af75e36a6fae6242833b92fa3378e78649e.debug 2026-02-17T11:53:53.294 INFO:tasks.ceph.mon.b.trial071.stderr:--00:00:00:10.457 44365-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/30/3a2af75e36a6fae6242833b92fa3378e78649e.debug 2026-02-17T11:53:53.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:53.295+0000 7fa239d74640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 msgr2=0x7fa21800ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:53.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:53.295+0000 7fa239d74640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 0x7fa21800ffc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:53.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:53.295+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 msgr2=0x7fa21800f4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:53.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:53.295+0000 7fa23ad76640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218010690 legacy=0x7fa2180171a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:53.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:53.295+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 0x7fa21800f4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient(hunting): tick 2026-02-17T11:53:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:53:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:53:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:53:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 msgr2=0x7fa21800f4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa21800f100 0x7fa21800f4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 msgr2=0x7fa21800ffc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800fbb0 0x7fa21800ffc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218010690 legacy=0x7fa2180171a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa23ad76640 1 -- reap_dead start 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient: _add_conns ranks=[5,0,3,1,4,2] 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa23ad76640 1 -- reap_dead start 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 0x7fa21800ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-c con 0x7fa218010690 addr v2:10.20.193.153:3300/0 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa218005cb0 addr v1:10.20.193.10:6789/0 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 0x7fa21800d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-a con 0x7fa21800c490 addr v2:10.20.193.10:3300/0 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c58a0 con 0x7fa218005cb0 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0c7e20 con 0x7fa21800c490 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa21800dc50 con 0x7fa218010690 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa223fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa23ad76640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 msgr2=0x7fa21800d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa239d74640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa21800cc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa23ad76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 0x7fa21800d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:54.892+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 0x7fa21800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:55.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.093+0000 7fa239d74640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa21800cc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:55.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.093+0000 7fa23ad76640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 msgr2=0x7fa21800d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:55.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.093+0000 7fa23ad76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 0x7fa21800d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:55.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.093+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:55.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.093+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 0x7fa21800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:55.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.494+0000 7fa23ad76640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 msgr2=0x7fa21800d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:55.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.494+0000 7fa239d74640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa21800cc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:55.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.494+0000 7fa23ad76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 0x7fa21800d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:55.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.494+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:55.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:55.494+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 0x7fa21800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:56.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:56.295+0000 7fa23ad76640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 msgr2=0x7fa21800d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.10:3300/0 2026-02-17T11:53:56.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:56.295+0000 7fa239d74640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa21800cc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.10:6789/0 2026-02-17T11:53:56.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:56.295+0000 7fa23ad76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 0x7fa21800d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:56.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:56.295+0000 7fa23a575640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.153:3300/0 2026-02-17T11:53:56.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:56.295+0000 7fa23a575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 0x7fa21800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:53:57.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 10 monclient(hunting): tick 2026-02-17T11:53:57.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:53:57.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:53:57.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:53:57.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 -- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:57.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa218010690 0x7fa21800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:57.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 -- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 msgr2=0x7fa21800d320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:57.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa21800c490 0x7fa21800d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:53:57.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 -- >> v1:10.20.193.10:6789/0 conn(0x7fa218005cb0 legacy=0x7fa21800cc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 10 monclient: _add_conns ranks=[4,2,1] 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 0x7fa21800f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-b con 0x7fa21800f030 addr v2:10.20.193.71:3300/0 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa218008760 addr v1:10.20.193.153:6789/0 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa218009280 addr v1:10.20.193.71:6789/0 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c55c0 con 0x7fa218009280 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c58a0 con 0x7fa218008760 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0c7e20 con 0x7fa21800f030 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa223fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa23a575640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 msgr2=0x7fa21800f440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:57.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa23ad76640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218009280 legacy=0x7fa218009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:57.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa23a575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 0x7fa21800f440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:53:57.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:57.892+0000 7fa239d74640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa218008760 legacy=0x7fa218008b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:58.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:58.093+0000 7fa23a575640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 msgr2=0x7fa21800f440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:58.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:58.093+0000 7fa239d74640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa218008760 legacy=0x7fa218008b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:58.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:58.093+0000 7fa23ad76640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218009280 legacy=0x7fa218009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:58.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:58.093+0000 7fa23a575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 0x7fa21800f440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:53:58.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:58.494+0000 7fa239d74640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa218008760 legacy=0x7fa218008b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:58.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:58.494+0000 7fa23ad76640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218009280 legacy=0x7fa218009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:58.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:58.494+0000 7fa23a575640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 msgr2=0x7fa21800f440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:58.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:58.494+0000 7fa23a575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 0x7fa21800f440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:53:58.762 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:00:15.930 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:53:58.818 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:00:15.946 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:53:58.891 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:00:16.054 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:53:58.910 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:00:16.078 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:53:58.969 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:00:16.097 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:53:59.040 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:00:16.203 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:53:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:59.295+0000 7fa239d74640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa218008760 legacy=0x7fa218008b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.153:6789/0 2026-02-17T11:53:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:59.295+0000 7fa23ad76640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218009280 legacy=0x7fa218009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.71:6789/0 2026-02-17T11:53:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:59.295+0000 7fa23a575640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 msgr2=0x7fa21800f440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.71:3300/0 2026-02-17T11:53:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:53:59.295+0000 7fa23a575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 0x7fa21800f440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:54:00.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa223fff640 10 monclient(hunting): tick 2026-02-17T11:54:00.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa223fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:54:00.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa223fff640 1 monclient(hunting): continuing hunt 2026-02-17T11:54:00.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa223fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:54:00.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa223fff640 1 -- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 msgr2=0x7fa21800f440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:00.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa223fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa21800f030 0x7fa21800f440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:00.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa223fff640 1 -- >> v1:10.20.193.153:6789/0 conn(0x7fa218008760 legacy=0x7fa218008b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa223fff640 1 -- >> v1:10.20.193.71:6789/0 conn(0x7fa218009280 legacy=0x7fa218009690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa23ad76640 1 -- reap_dead start 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.892+0000 7fa223fff640 10 monclient: _add_conns ranks=[3,0,1,2,5,4] 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa23ad76640 1 -- reap_dead start 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa223fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 0x7fa21800ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-a con 0x7fa218005cb0 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa218010690 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa223fff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa21800c490 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa223fff640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c8100 con 0x7fa218010690 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa223fff640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0c55c0 con 0x7fa21800c490 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa223fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:00.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa223fff640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0c7e20 con 0x7fa218005cb0 2026-02-17T11:54:00.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.893+0000 7fa223fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.906+0000 7fa23ad76640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fa21800c490 0x7fa21800f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:55476/0 (socket says 10.20.193.10:55476) 2026-02-17T11:54:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.906+0000 7fa23ad76640 1 -- 10.20.193.10:0/230962106 learned_addr learned my addr 10.20.193.10:0/230962106 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:54:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.911+0000 7fa23a575640 1 --2- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 0x7fa21800ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.912+0000 7fa23a575640 10 monclient(hunting): get_auth_request con 0x7fa218005cb0 auth_method 0 2026-02-17T11:54:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.912+0000 7fa23a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.912+0000 7fa23a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.912+0000 7fa23a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.916+0000 7fa23a575640 1 -- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:54:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.916+0000 7fa23a575640 1 -- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.916+0000 7fa23a575640 1 --2- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 0x7fa21800ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:00.916+0000 7fa23a575640 1 --2- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 0x7fa21800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:01.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.180+0000 7fa23a575640 1 --2- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 0x7fa21800ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:01.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.181+0000 7fa23a575640 10 monclient(hunting): get_auth_request con 0x7fa218005cb0 auth_method 0 2026-02-17T11:54:01.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.181+0000 7fa23a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:01.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.181+0000 7fa23a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:01.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.181+0000 7fa23a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:01.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.234+0000 7fa23a575640 1 -- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:54:01.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.234+0000 7fa23a575640 1 -- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:01.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.234+0000 7fa23a575640 1 --2- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 0x7fa21800ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:01.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.234+0000 7fa23a575640 1 --2- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 0x7fa21800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:54:01.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.415+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3142637027 0 0) 0x7fa23c0c8100 con 0x7fa218010690 2026-02-17T11:54:01.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.416+0000 7fa239573640 10 monclient(hunting): _negotiate 2026-02-17T11:54:01.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.416+0000 7fa239573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:01.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.416+0000 7fa239573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:01.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.416+0000 7fa239573640 10 monclient(hunting): my global_id is 4098 2026-02-17T11:54:01.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.416+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa228003620 con 0x7fa218010690 2026-02-17T11:54:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 604143004 0 0) 0x7fa228003620 con 0x7fa218010690 2026-02-17T11:54:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 msgr2=0x7fa21800ff90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 --2- 10.20.193.10:0/230962106 >> v2:10.20.193.10:3300/0 conn(0x7fa218005cb0 0x7fa21800ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 >> v1:10.20.193.71:6789/0 conn(0x7fa21800c490 legacy=0x7fa21800f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient: _finish_hunting 0 2026-02-17T11:54:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:54:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:54:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c0c58a0 con 0x7fa218010690 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient: _finish_auth 0 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient: _check_auth_tickets 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fa224004260 con 0x7fa218010690 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient: dump: 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.452 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 >> v1:10.20.193.10:6789/0 conn(0x7fa218010690 legacy=0x7fa21800cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa228003ab0 0x7fa228003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient(hunting): picked mon.b con 0x7fa228003ab0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa228004900 0x7fa228004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient(hunting): picked mon.c con 0x7fa228004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa2280054c0 0x7fa22800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient(hunting): picked mon.a con 0x7fa2280054c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c0c7e20 con 0x7fa2280054c0 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa22800c350 con 0x7fa228003ab0 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa22800c550 con 0x7fa228004900 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:54:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239d74640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa228004900 0x7fa228004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:01.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239d74640 10 monclient(hunting): get_auth_request con 0x7fa228004900 auth_method 0 2026-02-17T11:54:01.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:01.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:01.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.447+0000 7fa239d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:01.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.449+0000 7fa239d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:01.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.449+0000 7fa239d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:01.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.449+0000 7fa239d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:54:01.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.467+0000 7fa23a575640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa228003ab0 0x7fa228003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:01.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.470+0000 7fa23a575640 10 monclient(hunting): get_auth_request con 0x7fa228003ab0 auth_method 0 2026-02-17T11:54:01.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.470+0000 7fa23a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:01.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.470+0000 7fa23a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:01.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.470+0000 7fa23a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:01.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 10 monclient(hunting): handle_auth_done global_id 4098 payload 293 2026-02-17T11:54:01.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 1 -- 10.20.193.10:0/230962106 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa228003ab0 msgr2=0x7fa228003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:01.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa228003ab0 0x7fa228003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 1 -- 10.20.193.10:0/230962106 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa2280054c0 msgr2=0x7fa22800bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa2280054c0 0x7fa22800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 10 monclient: _finish_hunting 0 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 1 monclient: found mon.c 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 1 -- 10.20.193.10:0/230962106 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa228003620 con 0x7fa228004900 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 10 monclient: _finish_auth 0 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 10 monclient: _check_auth_tickets 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa239d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa23ad76640 1 -- 10.20.193.10:0/230962106 reap_dead start 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa240fe6640 5 monclient: authenticate success, global_id 4098 2026-02-17T11:54:01.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.471+0000 7fa240fe6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:01.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.475+0000 7fa239d74640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa228004900 0x7fa228004d80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa224003d60 tx=0x7fa22402f4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f4f29e04f6bef6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224007d50 con 0x7fa228004900 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 10 monclient: dump: 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa224033030 con 0x7fa228004900 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 1 -- 10.20.193.10:0/230962106 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224038420 con 0x7fa228004900 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa239573640 10 monclient: dump: 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:01.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 4 set_mon_vals no callback set 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 10 monclient: shutdown 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 1 -- 10.20.193.10:0/230962106 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa228004900 msgr2=0x7fa228004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa228004900 0x7fa228004d80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa224003d60 tx=0x7fa22402f4d0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 1 -- 10.20.193.10:0/230962106 shutdown_connections 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 1 --2- 10.20.193.10:0/230962106 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa228004900 0x7fa228004d80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 1 -- 10.20.193.10:0/230962106 >> 10.20.193.10:0/230962106 conn(0x7fa23c0c9d80 msgr2=0x7fa23c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 1 -- 10.20.193.10:0/230962106 shutdown_connections 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.508+0000 7fa240fe6640 1 -- 10.20.193.10:0/230962106 wait complete. 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient: build_initial_monmap 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient: monmap: 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:01.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 librados: starting msgr at 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 librados: starting objecter 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 Processor -- start 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 -- start start 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 librados: setting wanted keys 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 librados: calling monclient init 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient: init 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa228004900 0x7fa23c0c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient(hunting): picked mon.noname-a con 0x7fa228004900 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa23c1f6e40 0x7fa23c1f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient(hunting): picked mon.noname-c con 0x7fa23c1f6e40 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa23c1e91f0 0x7fa23c15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient(hunting): picked mon.noname-b con 0x7fa23c1e91f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c0c86c0 con 0x7fa228004900 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:01.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c0c7c80 con 0x7fa23c1e91f0 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c15d600 con 0x7fa23c1f6e40 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.509+0000 7fa240fe6640 10 monclient(hunting): authenticate will time out at 911.231993s 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.510+0000 7fa239d74640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa23c1f6e40 0x7fa23c1f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.510+0000 7fa239d74640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa23c1f6e40 0x7fa23c1f4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:59676/0 (socket says 10.20.193.10:59676) 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.510+0000 7fa239d74640 1 -- 10.20.193.10:0/2019706036 learned_addr learned my addr 10.20.193.10:0/2019706036 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.510+0000 7fa239d74640 10 monclient(hunting): get_auth_request con 0x7fa23c1f6e40 auth_method 0 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.510+0000 7fa239d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.510+0000 7fa239d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.510+0000 7fa239d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.511+0000 7fa239d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.511+0000 7fa239d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.511+0000 7fa239d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.511+0000 7fa23ad76640 1 --2- 10.20.193.10:0/2019706036 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa23c1e91f0 0x7fa23c15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.512+0000 7fa23ad76640 10 monclient(hunting): get_auth_request con 0x7fa23c1e91f0 auth_method 0 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.512+0000 7fa23ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.512+0000 7fa23ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:01.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.512+0000 7fa23ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:01.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.513+0000 7fa23a575640 1 --2- 10.20.193.10:0/2019706036 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa228004900 0x7fa23c0c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:01.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.513+0000 7fa23a575640 10 monclient(hunting): get_auth_request con 0x7fa228004900 auth_method 0 2026-02-17T11:54:01.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.513+0000 7fa23a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:01.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.513+0000 7fa23a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:01.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.513+0000 7fa23a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:01.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.514+0000 7fa23a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:01.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.514+0000 7fa23a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:01.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.514+0000 7fa23a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:01.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.514+0000 7fa23ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:01.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.514+0000 7fa23ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:01.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.514+0000 7fa23ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:01.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 10 monclient(hunting): handle_auth_done global_id 4103 payload 824 2026-02-17T11:54:01.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 1 -- 10.20.193.10:0/2019706036 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa23c1e91f0 msgr2=0x7fa23c15ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:01.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 1 --2- 10.20.193.10:0/2019706036 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa23c1e91f0 0x7fa23c15ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 1 -- 10.20.193.10:0/2019706036 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa228004900 msgr2=0x7fa23c0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:01.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 1 --2- 10.20.193.10:0/2019706036 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa228004900 0x7fa23c0c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 10 monclient: _finish_hunting 0 2026-02-17T11:54:01.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 1 monclient: found mon.noname-c 2026-02-17T11:54:01.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:01.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:01.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.517+0000 7fa239d74640 1 -- 10.20.193.10:0/2019706036 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c0c4d10 con 0x7fa23c1f6e40 2026-02-17T11:54:01.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.518+0000 7fa239d74640 1 --2- 10.20.193.10:0/2019706036 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa23c1f6e40 0x7fa23c1f4310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa22402f9e0 tx=0x7fa224006420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:01.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.518+0000 7fa222ffd640 10 client.?.objecter ms_handle_connect 0x7fa23c1f6e40 2026-02-17T11:54:01.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.518+0000 7fa222ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 1 -- 10.20.193.10:0/2019706036 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2240076a0 con 0x7fa23c1f6e40 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 10 monclient: dump: 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 10 monclient: _finish_auth 0 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa240fe6640 5 monclient: authenticate success, global_id 4103 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 1 -- 10.20.193.10:0/2019706036 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2240399f0 con 0x7fa23c1f6e40 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 1 -- 10.20.193.10:0/2019706036 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224039dc0 con 0x7fa23c1f6e40 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa238d72640 4 set_mon_vals no callback set 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa222ffd640 10 monclient: dump: 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:01.532 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa240fe6640 10 monclient: _renew_subs 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa240fe6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa240fe6640 1 -- 10.20.193.10:0/2019706036 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa23c1f75a0 con 0x7fa23c1f6e40 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa240fe6640 10 client.4103.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa240fe6640 10 monclient: _renew_subs 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa240fe6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa240fe6640 1 -- 10.20.193.10:0/2019706036 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa23c1f7b60 con 0x7fa23c1f6e40 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.530+0000 7fa240fe6640 1 librados: init done 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.531+0000 7fa240fe6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.531+0000 7fa240fe6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.531+0000 7fa240fe6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.531+0000 7fa240fe6640 1 -- 10.20.193.10:0/2019706036 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23c074920 con 0x7fa23c1f6e40 2026-02-17T11:54:01.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.623+0000 7fa222ffd640 1 -- 10.20.193.10:0/2019706036 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa224043800 con 0x7fa23c1f6e40 2026-02-17T11:54:01.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.627+0000 7fa222ffd640 1 -- 10.20.193.10:0/2019706036 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa2240373d0 con 0x7fa23c1f6e40 2026-02-17T11:54:01.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.627+0000 7fa222ffd640 10 client.4103.objecter ms_dispatch2 0x7fa23c000b90 osd_map(1..1 src has 1..1) 2026-02-17T11:54:01.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.627+0000 7fa222ffd640 3 client.4103.objecter handle_osd_map got epochs [1,1] > 0 2026-02-17T11:54:01.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.627+0000 7fa222ffd640 3 client.4103.objecter handle_osd_map decoding full epoch 1 2026-02-17T11:54:01.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.627+0000 7fa222ffd640 20 client.4103.objecter dump_active .. 0 homeless 2026-02-17T11:54:01.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.628+0000 7fa222ffd640 1 -- 10.20.193.10:0/2019706036 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fa22404c420 con 0x7fa23c1f6e40 2026-02-17T11:54:01.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.628+0000 7fa222ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:01.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.628+0000 7fa222ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:01.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.660+0000 7fa240fe6640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T11:54:01.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.660+0000 7fa240fe6640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T11:54:01.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.660+0000 7fa240fe6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:01.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.660+0000 7fa240fe6640 1 -- 10.20.193.10:0/2019706036 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa23c1f7d30 con 0x7fa23c1f6e40 2026-02-17T11:54:01.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.838+0000 7fa222ffd640 1 -- 10.20.193.10:0/2019706036 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fa22404c600 con 0x7fa23c1f6e40 2026-02-17T11:54:01.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.838+0000 7fa222ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T11:54:01.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.838+0000 7fa222ffd640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-17T11:54:01.840 INFO:teuthology.orchestra.run.trial010.stderr:adjusted tunables profile to default 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 10 librados: watch_flush enter 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 10 librados: watch_flush exit 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 20 client.4103.objecter shutdown clearing up homeless session... 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 10 client.4103.objecter successfully canceled tick 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 10 monclient: shutdown 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 -- 10.20.193.10:0/2019706036 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa23c1f6e40 msgr2=0x7fa23c1f4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 --2- 10.20.193.10:0/2019706036 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa23c1f6e40 0x7fa23c1f4310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa22402f9e0 tx=0x7fa224006420 comp rx=0 tx=0).stop 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 -- 10.20.193.10:0/2019706036 shutdown_connections 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 --2- 10.20.193.10:0/2019706036 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa23c1e91f0 0x7fa23c15ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 --2- 10.20.193.10:0/2019706036 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa23c1f6e40 0x7fa23c1f4310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 --2- 10.20.193.10:0/2019706036 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa228004900 0x7fa23c0c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 -- 10.20.193.10:0/2019706036 >> 10.20.193.10:0/2019706036 conn(0x7fa23c0c9d80 msgr2=0x7fa23c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 -- 10.20.193.10:0/2019706036 shutdown_connections 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 -- 10.20.193.10:0/2019706036 wait complete. 2026-02-17T11:54:01.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:01.839+0000 7fa240fe6640 1 librados: shutdown 2026-02-17T11:54:01.850 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T11:54:01.850 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T11:54:01.850 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:54:01.850 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T11:54:01.876 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:54:01.876 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-17T11:54:01.887 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:01.884+0000 7f39f7433140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T11:54:01.911 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:54:01.911 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-17T11:54:01.912 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:01.910+0000 7f670d7d8140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T11:54:01.974 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-17T11:54:01.974 DEBUG:teuthology.orchestra.run.trial010:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-17T11:54:02.008 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.006+0000 7f39f7433140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T11:54:02.033 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:54:02.033 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T11:54:02.033 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.031+0000 7f670d7d8140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T11:54:02.035 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.033+0000 7f39f7433140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T11:54:02.060 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:54:02.060 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-17T11:54:02.061 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.058+0000 7f670d7d8140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T11:54:02.068 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.067+0000 7f39f7433140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T11:54:02.091 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.090+0000 7f39f7433140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T11:54:02.094 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.091+0000 7f670d7d8140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T11:54:02.117 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.115+0000 7f670d7d8140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T11:54:02.117 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.116+0000 7f39f7433140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T11:54:02.124 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:54:02.124 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-17T11:54:02.143 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.141+0000 7f670d7d8140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T11:54:02.173 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.171+0000 7f39f7433140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T11:54:02.187 DEBUG:teuthology.orchestra.run.trial071:> set -ex 2026-02-17T11:54:02.188 DEBUG:teuthology.orchestra.run.trial071:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-17T11:54:02.199 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.197+0000 7f670d7d8140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T11:54:02.234 INFO:tasks.ceph.mgr.y.trial010.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T11:54:02.234 INFO:tasks.ceph.mgr.y.trial010.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T11:54:02.234 INFO:tasks.ceph.mgr.y.trial010.stderr: from numpy import show_config as show_numpy_config 2026-02-17T11:54:02.237 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.235+0000 7f39f7433140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T11:54:02.252 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:54:02.252 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T11:54:02.260 INFO:tasks.ceph.mgr.x.trial174.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T11:54:02.260 INFO:tasks.ceph.mgr.x.trial174.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T11:54:02.260 INFO:tasks.ceph.mgr.x.trial174.stderr: from numpy import show_config as show_numpy_config 2026-02-17T11:54:02.262 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.261+0000 7f39f7433140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T11:54:02.263 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.261+0000 7f670d7d8140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T11:54:02.279 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:54:02.279 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-17T11:54:02.289 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.287+0000 7f670d7d8140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T11:54:02.318 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.316+0000 7f39f7433140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T11:54:02.344 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:54:02.344 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-17T11:54:02.345 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.343+0000 7f670d7d8140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T11:54:02.361 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.359+0000 7f39f7433140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T11:54:02.387 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.385+0000 7f39f7433140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T11:54:02.388 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.386+0000 7f670d7d8140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T11:54:02.408 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T11:54:02.408 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-17T11:54:02.411 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.410+0000 7f39f7433140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T11:54:02.415 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.412+0000 7f670d7d8140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T11:54:02.437 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.435+0000 7f39f7433140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T11:54:02.439 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.437+0000 7f670d7d8140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T11:54:02.460 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.458+0000 7f39f7433140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T11:54:02.465 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.463+0000 7f670d7d8140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T11:54:02.473 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:54:02.473 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T11:54:02.488 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.485+0000 7f670d7d8140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T11:54:02.498 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:54:02.499 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-17T11:54:02.562 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:54:02.562 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-17T11:54:02.625 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-17T11:54:02.626 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-17T11:54:02.653 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.651+0000 7f39f7433140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T11:54:02.683 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.681+0000 7f670d7d8140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T11:54:02.689 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 482785ad-8055-4bcf-9dbe-dab7f981cdfc 0 2026-02-17T11:54:02.707 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.705+0000 7f39f7433140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T11:54:02.730 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.728+0000 7f39f7433140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T11:54:02.738 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.736+0000 7f670d7d8140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T11:54:02.753 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.751+0000 7f39f7433140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T11:54:02.761 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.759+0000 7f670d7d8140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T11:54:02.785 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.782+0000 7f670d7d8140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T11:54:02.798 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient: get_monmap_and_config 2026-02-17T11:54:02.798 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient: build_initial_monmap 2026-02-17T11:54:02.798 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient: monmap: 2026-02-17T11:54:02.798 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:02.798 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:02.798 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:02.793670+0000 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:02.793670+0000 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 1 Processor -- start 2026-02-17T11:54:02.799 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 1 -- start start 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient: init 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient: _add_conns ranks=[2,1,3,0,4,5] 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa3e0118490 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa3e00740e0 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa3e0125a60 0x7fa3e0127e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient(hunting): picked mon.noname-a con 0x7fa3e0125a60 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e0128390 con 0x7fa3e00740e0 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e0129570 con 0x7fa3e0118490 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e012a750 con 0x7fa3e0125a60 2026-02-17T11:54:02.800 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.792+0000 7fa3e50c7640 10 monclient(hunting): authenticate will time out at 917.430792s 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3ded76640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fa3e0118490 0x7fa3e00739d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.174:41738/0 (socket says 10.20.193.174:41738) 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3ded76640 1 -- 10.20.193.174:0/2914178434 learned_addr learned my addr 10.20.193.174:0/2914178434 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3de575640 1 --1- 10.20.193.174:0/2914178434 >> v1:10.20.193.71:6789/0 conn(0x7fa3e00740e0 0x7fa3e0124340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.174:43068/0 (socket says 10.20.193.174:43068) 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3df577640 1 --2- 10.20.193.174:0/2914178434 >> v2:10.20.193.10:3300/0 conn(0x7fa3e0125a60 0x7fa3e0127e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3df577640 10 monclient(hunting): get_auth_request con 0x7fa3e0125a60 auth_method 0 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3df577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3df577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3df577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3df577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:02.801 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3df577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:02.802 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.793+0000 7fa3df577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:02.802 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.794+0000 7fa3ddd74640 1 -- 10.20.193.174:0/2914178434 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4689184 0 0) 0x7fa3e0128390 con 0x7fa3e00740e0 2026-02-17T11:54:02.802 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.794+0000 7fa3ddd74640 10 monclient(hunting): _negotiate 2026-02-17T11:54:02.802 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.794+0000 7fa3ddd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:02.802 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.794+0000 7fa3ddd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:02.802 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.794+0000 7fa3ddd74640 10 monclient(hunting): my global_id is 4108 2026-02-17T11:54:02.802 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.794+0000 7fa3ddd74640 1 -- 10.20.193.174:0/2914178434 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3cc003620 con 0x7fa3e00740e0 2026-02-17T11:54:02.802 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3ddd74640 1 -- 10.20.193.174:0/2914178434 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520899112 0 0) 0x7fa3e0129570 con 0x7fa3e0118490 2026-02-17T11:54:02.802 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3ddd74640 10 monclient(hunting): _negotiate 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3ddd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3ddd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3ddd74640 10 monclient(hunting): my global_id is 4112 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3ddd74640 1 -- 10.20.193.174:0/2914178434 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3e0128390 con 0x7fa3e0118490 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3df577640 10 monclient(hunting): handle_auth_done global_id 4113 payload 274 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3df577640 1 -- 10.20.193.174:0/2914178434 >> v1:10.20.193.153:6789/0 conn(0x7fa3e0118490 legacy=0x7fa3e00739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3df577640 1 -- 10.20.193.174:0/2914178434 >> v1:10.20.193.71:6789/0 conn(0x7fa3e00740e0 legacy=0x7fa3e0124340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3df577640 10 monclient: _finish_hunting 0 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3df577640 1 monclient: found mon.noname-a 2026-02-17T11:54:02.803 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3df577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:02.804 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3df577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:02.804 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.795+0000 7fa3df577640 1 -- 10.20.193.174:0/2914178434 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e012a8d0 con 0x7fa3e0125a60 2026-02-17T11:54:02.804 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.796+0000 7fa3df577640 1 --2- 10.20.193.174:0/2914178434 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e0125a60 0x7fa3e0127e50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009d90 tx=0x7fa3d002f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4486024be1ea9935 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:02.810 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.805+0000 7f39f7433140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:54:02.812 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 1 -- 10.20.193.174:0/2914178434 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d003c070 con 0x7fa3e0125a60 2026-02-17T11:54:02.812 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:02.812 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 10 monclient: dump: 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:02.813 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 10 monclient: _finish_auth 0 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 10 monclient: _check_auth_tickets 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 1 -- 10.20.193.174:0/2914178434 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d0037440 con 0x7fa3e0125a60 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 5 monclient: authenticate success, global_id 4113 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 1 -- 10.20.193.174:0/2914178434 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0037810 con 0x7fa3e0125a60 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 4 set_mon_vals no callback set 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:02.814 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3ddd74640 10 monclient: dump: 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:02.815 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 10 monclient: shutdown 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 1 -- 10.20.193.174:0/2914178434 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e0125a60 msgr2=0x7fa3e0127e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 1 --2- 10.20.193.174:0/2914178434 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e0125a60 0x7fa3e0127e50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009d90 tx=0x7fa3d002f230 comp rx=0 tx=0).stop 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 1 -- 10.20.193.174:0/2914178434 shutdown_connections 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 1 --2- 10.20.193.174:0/2914178434 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e0125a60 0x7fa3e0127e50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 1 -- 10.20.193.174:0/2914178434 >> 10.20.193.174:0/2914178434 conn(0x7fa3e006f950 msgr2=0x7fa3e0071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 1 -- 10.20.193.174:0/2914178434 shutdown_connections 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.798+0000 7fa3e50c7640 1 -- 10.20.193.174:0/2914178434 wait complete. 2026-02-17T11:54:02.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient: build_initial_monmap 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient: monmap: 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:02.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 librados: starting msgr at 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 librados: starting objecter 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 Processor -- start 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 -- start start 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 librados: setting wanted keys 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 librados: calling monclient init 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient: init 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e00740e0 0x7fa3e0116700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient(hunting): picked mon.noname-a con 0x7fa3e00740e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa3e0118490 0x7fa3e0116d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:02.818 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient(hunting): picked mon.noname-c con 0x7fa3e0118490 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa3e0125a60 0x7fa3e01bb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient(hunting): picked mon.noname-b con 0x7fa3e0125a60 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e01289e0 con 0x7fa3e00740e0 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0128860 con 0x7fa3e0125a60 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0128b60 con 0x7fa3e0118490 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.799+0000 7fa3e50c7640 10 monclient(hunting): authenticate will time out at 917.437759s 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa3e0118490 0x7fa3e0116d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:02.819 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3ded76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e00740e0 0x7fa3e0116700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3df577640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa3e0125a60 0x7fa3e01bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa3e0118490 0x7fa3e0116d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.174:57532/0 (socket says 10.20.193.174:57532) 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 1 -- 10.20.193.174:0/573700521 learned_addr learned my addr 10.20.193.174:0/573700521 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 10 monclient(hunting): get_auth_request con 0x7fa3e0118490 auth_method 0 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3ded76640 10 monclient(hunting): get_auth_request con 0x7fa3e00740e0 auth_method 0 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3ded76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3ded76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:02.820 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3ded76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3df577640 10 monclient(hunting): get_auth_request con 0x7fa3e0125a60 auth_method 0 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3df577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3df577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3df577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3de575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3ded76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3ded76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3ded76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:02.821 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3df577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3df577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.800+0000 7fa3df577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 10 monclient(hunting): handle_auth_done global_id 4115 payload 824 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 1 -- 10.20.193.174:0/573700521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa3e0125a60 msgr2=0x7fa3e01bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 1 --2- 10.20.193.174:0/573700521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa3e0125a60 0x7fa3e01bb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 1 -- 10.20.193.174:0/573700521 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e00740e0 msgr2=0x7fa3e0116700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 1 --2- 10.20.193.174:0/573700521 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e00740e0 0x7fa3e0116700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 10 monclient: _finish_hunting 0 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 1 monclient: found mon.noname-c 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:02.822 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3de575640 1 -- 10.20.193.174:0/573700521 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e01bc0c0 con 0x7fa3e0118490 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.801+0000 7fa3ded76640 1 --2- 10.20.193.174:0/573700521 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e00740e0 0x7fa3e0116700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.802+0000 7fa3de575640 1 --2- 10.20.193.174:0/573700521 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa3e0118490 0x7fa3e0116d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c700 tx=0x7fa3c800cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.802+0000 7fa3bf7fe640 10 client.?.objecter ms_handle_connect 0x7fa3e0118490 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.802+0000 7fa3bf7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 1 -- 10.20.193.174:0/573700521 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8004ae0 con 0x7fa3e0118490 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 10 monclient: dump: 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:02.823 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 1 -- 10.20.193.174:0/573700521 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c8004ca0 con 0x7fa3e0118490 2026-02-17T11:54:02.824 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 1 -- 10.20.193.174:0/573700521 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80072b0 con 0x7fa3e0118490 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3bf7fe640 10 monclient: dump: 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:02.825 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3dd573640 4 set_mon_vals no callback set 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3e50c7640 5 monclient: authenticate success, global_id 4115 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3e50c7640 10 monclient: _renew_subs 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3e50c7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3e50c7640 1 -- 10.20.193.174:0/573700521 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e01bc350 con 0x7fa3e0118490 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3e50c7640 10 client.4115.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3e50c7640 10 monclient: _renew_subs 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3e50c7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3e50c7640 1 -- 10.20.193.174:0/573700521 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e01bc850 con 0x7fa3e0118490 2026-02-17T11:54:02.826 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.804+0000 7fa3e50c7640 1 librados: init done 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.805+0000 7fa3e50c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.805+0000 7fa3e50c7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.805+0000 7fa3e50c7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.805+0000 7fa3e50c7640 1 -- 10.20.193.174:0/573700521 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e0128fc0 con 0x7fa3e0118490 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.806+0000 7fa3bf7fe640 1 -- 10.20.193.174:0/573700521 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa3c800a640 con 0x7fa3e0118490 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.806+0000 7fa3bf7fe640 1 -- 10.20.193.174:0/573700521 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa3c8013710 con 0x7fa3e0118490 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.806+0000 7fa3bf7fe640 10 client.4115.objecter ms_dispatch2 0x7fa3e0000b90 osd_map(2..2 src has 1..2) 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.806+0000 7fa3bf7fe640 3 client.4115.objecter handle_osd_map got epochs [2,2] > 0 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.806+0000 7fa3bf7fe640 3 client.4115.objecter handle_osd_map decoding full epoch 2 2026-02-17T11:54:02.827 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.806+0000 7fa3bf7fe640 20 client.4115.objecter dump_active .. 0 homeless 2026-02-17T11:54:02.828 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.826+0000 7f39f7433140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T11:54:02.839 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.836+0000 7f670d7d8140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:54:02.851 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.848+0000 7fa3bf7fe640 1 -- 10.20.193.174:0/573700521 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fa3c8021070 con 0x7fa3e0118490 2026-02-17T11:54:02.851 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.848+0000 7fa3bf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:02.851 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.848+0000 7fa3bf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:02.860 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.858+0000 7f670d7d8140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T11:54:02.879 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:02.878+0000 7f39f7433140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:54:02.883 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.881+0000 7fa3e50c7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "482785ad-8055-4bcf-9dbe-dab7f981cdfc", "id": 0}] 2026-02-17T11:54:02.883 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.881+0000 7fa3e50c7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "482785ad-8055-4bcf-9dbe-dab7f981cdfc", "id": 0}] 2026-02-17T11:54:02.884 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.881+0000 7fa3e50c7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:02.884 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.881+0000 7fa3e50c7640 1 -- 10.20.193.174:0/573700521 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "482785ad-8055-4bcf-9dbe-dab7f981cdfc", "id": 0} v 0) -- 0x7fa3e01234b0 con 0x7fa3e0118490 2026-02-17T11:54:02.912 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:02.910+0000 7f670d7d8140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:54:02.964 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.962+0000 7fa3bf7fe640 1 -- 10.20.193.174:0/573700521 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "482785ad-8055-4bcf-9dbe-dab7f981cdfc", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa3e01234b0 con 0x7fa3e0118490 2026-02-17T11:54:02.964 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.962+0000 7fa3bf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "482785ad-8055-4bcf-9dbe-dab7f981cdfc", "id": 0}] 2026-02-17T11:54:02.965 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.962+0000 7fa3bf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:02.965 INFO:teuthology.orchestra.run.trial174.stdout:0 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 10 librados: watch_flush enter 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 10 librados: watch_flush exit 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 20 client.4115.objecter shutdown clearing up homeless session... 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 10 client.4115.objecter successfully canceled tick 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 10 monclient: shutdown 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 -- 10.20.193.174:0/573700521 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa3e0118490 msgr2=0x7fa3e0116d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 --2- 10.20.193.174:0/573700521 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa3e0118490 0x7fa3e0116d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c700 tx=0x7fa3c800cbd0 comp rx=0 tx=0).stop 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 -- 10.20.193.174:0/573700521 shutdown_connections 2026-02-17T11:54:02.967 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 --2- 10.20.193.174:0/573700521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa3e0125a60 0x7fa3e01bb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:02.968 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 --2- 10.20.193.174:0/573700521 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa3e0118490 0x7fa3e0116d70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:02.968 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 --2- 10.20.193.174:0/573700521 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa3e00740e0 0x7fa3e0116700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:02.968 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 -- 10.20.193.174:0/573700521 >> 10.20.193.174:0/573700521 conn(0x7fa3e006f950 msgr2=0x7fa3e0072bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:02.968 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 -- 10.20.193.174:0/573700521 shutdown_connections 2026-02-17T11:54:02.968 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 -- 10.20.193.174:0/573700521 wait complete. 2026-02-17T11:54:02.968 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:02.963+0000 7fa3e50c7640 1 librados: shutdown 2026-02-17T11:54:02.974 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new b7e7bb47-4367-42c9-b270-1d89a95aa623 1 2026-02-17T11:54:03.079 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient: get_monmap_and_config 2026-02-17T11:54:03.079 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient: build_initial_monmap 2026-02-17T11:54:03.079 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient: monmap: 2026-02-17T11:54:03.079 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:03.078505+0000 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:03.078505+0000 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:03.080 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:03.081 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.089 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 1 Processor -- start 2026-02-17T11:54:03.089 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 1 -- start start 2026-02-17T11:54:03.089 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient: init 2026-02-17T11:54:03.089 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:03.089 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient: _add_conns ranks=[5,2,4,3,1,0] 2026-02-17T11:54:03.089 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f8c5c1156f0 0x7f8c5c115ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient(hunting): picked mon.noname-c con 0x7f8c5c1156f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8c5c11a520 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8c5c11b0a0 0x7f8c5c122620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient(hunting): picked mon.noname-b con 0x7f8c5c11b0a0 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c5c122c90 con 0x7f8c5c11a520 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8c5c123e90 con 0x7f8c5c11b0a0 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8c5c124010 con 0x7f8c5c1156f0 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.077+0000 7f8c623ba640 10 monclient(hunting): authenticate will time out at 917.715792s 2026-02-17T11:54:03.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c5bfff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f8c5c1156f0 0x7f8c5c115ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.091 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c60930640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8c5c11b0a0 0x7f8c5c122620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.091 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c5b7fe640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f8c5c11a520 0x7f8c5c11a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.174:41750/0 (socket says 10.20.193.174:41750) 2026-02-17T11:54:03.091 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c5b7fe640 1 -- 10.20.193.174:0/3439720449 learned_addr learned my addr 10.20.193.174:0/3439720449 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-17T11:54:03.091 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c60930640 10 monclient(hunting): get_auth_request con 0x7f8c5c11b0a0 auth_method 0 2026-02-17T11:54:03.091 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c60930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.091 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c60930640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.091 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c60930640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c5bfff640 10 monclient(hunting): get_auth_request con 0x7f8c5c1156f0 auth_method 0 2026-02-17T11:54:03.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c60930640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c60930640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.078+0000 7f8c60930640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.093 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.093 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.093 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c60930640 10 monclient(hunting): handle_auth_done global_id 4114 payload 274 2026-02-17T11:54:03.093 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c60930640 1 -- 10.20.193.174:0/3439720449 >> v2:10.20.193.153:3300/0 conn(0x7f8c5c1156f0 msgr2=0x7f8c5c115ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:03.093 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c60930640 1 --2- 10.20.193.174:0/3439720449 >> v2:10.20.193.153:3300/0 conn(0x7f8c5c1156f0 0x7f8c5c115ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.093 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c60930640 1 -- 10.20.193.174:0/3439720449 >> v1:10.20.193.153:6789/0 conn(0x7f8c5c11a520 legacy=0x7f8c5c11a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.093 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c60930640 10 monclient: _finish_hunting 0 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c60930640 1 monclient: found mon.noname-b 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c60930640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c60930640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.079+0000 7f8c60930640 1 -- 10.20.193.174:0/3439720449 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c1241c0 con 0x7f8c5c11b0a0 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.080+0000 7f8c60930640 1 --2- 10.20.193.174:0/3439720449 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c5c11b0a0 0x7f8c5c122620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c06bd60 tx=0x7f8c5002f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823ee3c1d4bc2b93 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.081+0000 7f8c5affd640 1 -- 10.20.193.174:0/3439720449 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5003c070 con 0x7f8c5c11b0a0 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.081+0000 7f8c5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.081+0000 7f8c5affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.081+0000 7f8c5affd640 10 monclient: dump: 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.094 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.081+0000 7f8c5affd640 10 monclient: _finish_auth 0 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.081+0000 7f8c5affd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.081+0000 7f8c5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.081+0000 7f8c623ba640 5 monclient: authenticate success, global_id 4114 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.081+0000 7f8c623ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:03.095 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c5affd640 1 -- 10.20.193.174:0/3439720449 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5002fe40 con 0x7f8c5c11b0a0 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c5affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c5affd640 1 -- 10.20.193.174:0/3439720449 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50037660 con 0x7f8c5c11b0a0 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c5affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c5affd640 10 monclient: dump: 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.096 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 4 set_mon_vals no callback set 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 10 monclient: shutdown 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 1 -- 10.20.193.174:0/3439720449 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c5c11b0a0 msgr2=0x7f8c5c122620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 1 --2- 10.20.193.174:0/3439720449 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c5c11b0a0 0x7f8c5c122620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c06bd60 tx=0x7f8c5002f130 comp rx=0 tx=0).stop 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 1 -- 10.20.193.174:0/3439720449 shutdown_connections 2026-02-17T11:54:03.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 1 --2- 10.20.193.174:0/3439720449 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c5c11b0a0 0x7f8c5c122620 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 1 --2- 10.20.193.174:0/3439720449 >> v2:10.20.193.153:3300/0 conn(0x7f8c5c1156f0 0x7f8c5c115ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 1 -- 10.20.193.174:0/3439720449 >> 10.20.193.174:0/3439720449 conn(0x7f8c5c06e030 msgr2=0x7f8c5c06e440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 1 -- 10.20.193.174:0/3439720449 shutdown_connections 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.082+0000 7f8c623ba640 1 -- 10.20.193.174:0/3439720449 wait complete. 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient: build_initial_monmap 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient: monmap: 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.098 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 librados: starting msgr at 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 librados: starting objecter 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 Processor -- start 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 -- start start 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 librados: setting wanted keys 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 librados: calling monclient init 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient: init 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:03.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c5c1156f0 0x7f8c5c1aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient(hunting): picked mon.noname-b con 0x7f8c5c1156f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c5c11a520 0x7f8c5c1abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient(hunting): picked mon.noname-c con 0x7f8c5c11a520 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c5c11b0a0 0x7f8c5c1b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient(hunting): picked mon.noname-a con 0x7f8c5c11b0a0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c123320 con 0x7f8c5c11b0a0 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1231a0 con 0x7f8c5c1156f0 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1234a0 con 0x7f8c5c11a520 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c623ba640 10 monclient(hunting): authenticate will time out at 917.721478s 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c5b7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c5c11a520 0x7f8c5c1abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c5bfff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c5c1156f0 0x7f8c5c1aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c5b7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c5c11a520 0x7f8c5c1abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.174:57540/0 (socket says 10.20.193.174:57540) 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c5b7fe640 1 -- 10.20.193.174:0/81183912 learned_addr learned my addr 10.20.193.174:0/81183912 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c5b7fe640 10 monclient(hunting): get_auth_request con 0x7f8c5c11a520 auth_method 0 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.083+0000 7f8c5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c60930640 1 --2- 10.20.193.174:0/81183912 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c5c11b0a0 0x7f8c5c1b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5bfff640 10 monclient(hunting): get_auth_request con 0x7f8c5c1156f0 auth_method 0 2026-02-17T11:54:03.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c60930640 10 monclient(hunting): get_auth_request con 0x7f8c5c11b0a0 auth_method 0 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c60930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c60930640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c60930640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c60930640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c60930640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.084+0000 7f8c60930640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 10 monclient(hunting): handle_auth_done global_id 4124 payload 824 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 1 -- 10.20.193.174:0/81183912 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c5c1156f0 msgr2=0x7f8c5c1aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 1 --2- 10.20.193.174:0/81183912 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c5c1156f0 0x7f8c5c1aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 1 -- 10.20.193.174:0/81183912 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c5c11b0a0 msgr2=0x7f8c5c1b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 1 --2- 10.20.193.174:0/81183912 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c5c11b0a0 0x7f8c5c1b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 1 monclient: found mon.noname-c 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.085+0000 7f8c5b7fe640 1 -- 10.20.193.174:0/81183912 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c1b0a20 con 0x7f8c5c11a520 2026-02-17T11:54:03.104 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.086+0000 7f8c5b7fe640 1 --2- 10.20.193.174:0/81183912 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c5c11a520 0x7f8c5c1abfa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00c520 tx=0x7f8c4c00c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:03.104 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.086+0000 7f8c58ff9640 10 client.?.objecter ms_handle_connect 0x7f8c5c11a520 2026-02-17T11:54:03.104 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.086+0000 7f8c58ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:03.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 1 -- 10.20.193.174:0/81183912 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c017070 con 0x7f8c5c11a520 2026-02-17T11:54:03.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 10 monclient: dump: 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.107 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 10 monclient: _finish_auth 0 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 1 -- 10.20.193.174:0/81183912 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4c005de0 con 0x7f8c5c11a520 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 5 monclient: authenticate success, global_id 4124 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 10 monclient: _renew_subs 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 1 -- 10.20.193.174:0/81183912 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5c1b0d10 con 0x7f8c5c11a520 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 1 -- 10.20.193.174:0/81183912 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0072b0 con 0x7f8c5c11a520 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c58ff9640 10 monclient: dump: 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.109 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c5a7fc640 4 set_mon_vals no callback set 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 10 client.4124.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 10 monclient: _renew_subs 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 1 -- 10.20.193.174:0/81183912 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c5c1b85a0 con 0x7f8c5c11a520 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 1 librados: init done 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.088+0000 7f8c623ba640 1 -- 10.20.193.174:0/81183912 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c5c115ad0 con 0x7f8c5c11a520 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.090+0000 7f8c58ff9640 1 -- 10.20.193.174:0/81183912 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f8c4c007450 con 0x7f8c5c11a520 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.090+0000 7f8c58ff9640 1 -- 10.20.193.174:0/81183912 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8c4c0127b0 con 0x7f8c5c11a520 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.090+0000 7f8c58ff9640 10 client.4124.objecter ms_dispatch2 0x7f8c5c000b90 osd_map(3..3 src has 1..3) 2026-02-17T11:54:03.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.090+0000 7f8c58ff9640 3 client.4124.objecter handle_osd_map got epochs [3,3] > 0 2026-02-17T11:54:03.111 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.090+0000 7f8c58ff9640 3 client.4124.objecter handle_osd_map decoding full epoch 3 2026-02-17T11:54:03.111 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.090+0000 7f8c58ff9640 20 client.4124.objecter dump_active .. 0 homeless 2026-02-17T11:54:03.132 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.130+0000 7f8c58ff9640 1 -- 10.20.193.174:0/81183912 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f8c4c021020 con 0x7f8c5c11a520 2026-02-17T11:54:03.132 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.130+0000 7f8c58ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.132 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.130+0000 7f8c58ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:03.166 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.163+0000 7f8c623ba640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b7e7bb47-4367-42c9-b270-1d89a95aa623", "id": 1}] 2026-02-17T11:54:03.166 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.163+0000 7f8c623ba640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b7e7bb47-4367-42c9-b270-1d89a95aa623", "id": 1}] 2026-02-17T11:54:03.166 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.163+0000 7f8c623ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.166 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.163+0000 7f8c623ba640 1 -- 10.20.193.174:0/81183912 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b7e7bb47-4367-42c9-b270-1d89a95aa623", "id": 1} v 0) -- 0x7f8c5c11c740 con 0x7f8c5c11a520 2026-02-17T11:54:03.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.208+0000 7f8c58ff9640 1 -- 10.20.193.174:0/81183912 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7e7bb47-4367-42c9-b270-1d89a95aa623", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8c4c01ce20 con 0x7f8c5c11a520 2026-02-17T11:54:03.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.208+0000 7f8c58ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b7e7bb47-4367-42c9-b270-1d89a95aa623", "id": 1}] 2026-02-17T11:54:03.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.208+0000 7f8c58ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:03.211 INFO:teuthology.orchestra.run.trial174.stdout:1 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 10 librados: watch_flush enter 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 10 librados: watch_flush exit 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 20 client.4124.objecter shutdown clearing up homeless session... 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 10 client.4124.objecter successfully canceled tick 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 10 monclient: shutdown 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 -- 10.20.193.174:0/81183912 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c5c11a520 msgr2=0x7f8c5c1abfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 --2- 10.20.193.174:0/81183912 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c5c11a520 0x7f8c5c1abfa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00c520 tx=0x7f8c4c00c9f0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 -- 10.20.193.174:0/81183912 shutdown_connections 2026-02-17T11:54:03.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 --2- 10.20.193.174:0/81183912 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c5c11b0a0 0x7f8c5c1b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.215 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 --2- 10.20.193.174:0/81183912 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c5c11a520 0x7f8c5c1abfa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.215 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 --2- 10.20.193.174:0/81183912 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c5c1156f0 0x7f8c5c1aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.215 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 -- 10.20.193.174:0/81183912 >> 10.20.193.174:0/81183912 conn(0x7f8c5c06e030 msgr2=0x7f8c5c1144e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:03.215 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 -- 10.20.193.174:0/81183912 shutdown_connections 2026-02-17T11:54:03.215 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 -- 10.20.193.174:0/81183912 wait complete. 2026-02-17T11:54:03.215 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.209+0000 7f8c623ba640 1 librados: shutdown 2026-02-17T11:54:03.219 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 0fce833d-0717-49d4-bb32-03b00db04b98 2 2026-02-17T11:54:03.276 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:03.274+0000 7f39f7433140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T11:54:03.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.283+0000 7fc655aa7640 10 monclient: get_monmap_and_config 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.283+0000 7fc655aa7640 10 monclient: build_initial_monmap 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.283+0000 7fc655aa7640 10 monclient: monmap: 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:03.285151+0000 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:03.285151+0000 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:03.286 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:03.287 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:03.287 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:03.287 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:03.287 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:03.287 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 1 Processor -- start 2026-02-17T11:54:03.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 1 -- start start 2026-02-17T11:54:03.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 10 monclient: init 2026-02-17T11:54:03.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:03.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 10 monclient: _add_conns ranks=[0,5,1,3,2,4] 2026-02-17T11:54:03.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc6501156f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:03.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc65011d5f0 0x7fc65011f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 10 monclient(hunting): picked mon.noname-c con 0x7fc65011d5f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:03.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc6501200a0 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc650123e60 con 0x7fc6501156f0 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc650125080 con 0x7fc6501200a0 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc650126280 con 0x7fc65011d5f0 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc655aa7640 10 monclient(hunting): authenticate will time out at 917.922449s 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc64effd640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc65011d5f0 0x7fc65011f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc64ffff640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fc6501200a0 0x7fc650122560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.174:43080/0 (socket says 10.20.193.174:43080) 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc64ffff640 1 -- 10.20.193.174:0/402977828 learned_addr learned my addr 10.20.193.174:0/402977828 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc64effd640 10 monclient(hunting): get_auth_request con 0x7fc65011d5f0 auth_method 0 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc64effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc64effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.284+0000 7fc64effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.285+0000 7fc64effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.285+0000 7fc64effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.285+0000 7fc64effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.285+0000 7fc64effd640 1 -- 10.20.193.174:0/402977828 >> v2:10.20.193.153:3300/0 conn(0x7fc65011d5f0 msgr2=0x7fc65011f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.285+0000 7fc64effd640 1 -- 10.20.193.174:0/402977828 >> v2:10.20.193.153:3300/0 conn(0x7fc65011d5f0 msgr2=0x7fc65011f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.285+0000 7fc64effd640 1 --2- 10.20.193.174:0/402977828 >> v2:10.20.193.153:3300/0 conn(0x7fc65011d5f0 0x7fc65011f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.285+0000 7fc64effd640 1 --2- 10.20.193.174:0/402977828 >> v2:10.20.193.153:3300/0 conn(0x7fc65011d5f0 0x7fc65011f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558157398 0 0) 0x7fc650125080 con 0x7fc6501200a0 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:54:03.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 10 monclient(hunting): my global_id is 4120 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc634003620 con 0x7fc6501200a0 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304901537 0 0) 0x7fc650123e60 con 0x7fc6501156f0 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 10 monclient(hunting): my global_id is 4122 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.286+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc650125080 con 0x7fc6501156f0 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3695218302 0 0) 0x7fc634003620 con 0x7fc6501200a0 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 >> v2:10.20.193.153:3300/0 conn(0x7fc65011d5f0 msgr2=0x7fc65011f9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 --2- 10.20.193.174:0/402977828 >> v2:10.20.193.153:3300/0 conn(0x7fc65011d5f0 0x7fc65011f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 >> v1:10.20.193.10:6789/0 conn(0x7fc6501156f0 legacy=0x7fc650115ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc650126400 con 0x7fc6501200a0 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fc644003280 con 0x7fc6501200a0 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:54:03.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient: dump: 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T11:54:03.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 >> v1:10.20.193.71:6789/0 conn(0x7fc6501200a0 legacy=0x7fc650122560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc634003dd0 0x7fc6340041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient(hunting): picked mon.b con 0x7fc634003dd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc634004900 0x7fc634004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient(hunting): picked mon.c con 0x7fc634004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc634005490 0x7fc63400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient(hunting): picked mon.a con 0x7fc634005490 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc650126280 con 0x7fc634005490 2026-02-17T11:54:03.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc63400c380 con 0x7fc634003dd0 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc63400c580 con 0x7fc634004900 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.287+0000 7fc64e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.288+0000 7fc64effd640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc634004900 0x7fc634004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.288+0000 7fc64effd640 10 monclient(hunting): get_auth_request con 0x7fc634004900 auth_method 0 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.288+0000 7fc64effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.288+0000 7fc64effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.288+0000 7fc64effd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.288+0000 7fc64effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.288+0000 7fc64effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.288+0000 7fc64effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64f7fe640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc634003dd0 0x7fc6340041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64f7fe640 10 monclient(hunting): get_auth_request con 0x7fc634003dd0 auth_method 0 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64ffff640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc634005490 0x7fc63400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 10 monclient(hunting): handle_auth_done global_id 4120 payload 293 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 1 -- 10.20.193.174:0/402977828 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc634003dd0 msgr2=0x7fc6340041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc634003dd0 0x7fc6340041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 1 -- 10.20.193.174:0/402977828 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc634005490 msgr2=0x7fc63400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:03.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc634005490 0x7fc63400bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 10 monclient: _finish_hunting 0 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 1 monclient: found mon.c 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64ffff640 1 -- 10.20.193.174:0/402977828 reap_dead start 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 1 -- 10.20.193.174:0/402977828 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc634003620 con 0x7fc634004900 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 10 monclient: _finish_auth 0 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc64effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc655aa7640 5 monclient: authenticate success, global_id 4120 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.289+0000 7fc655aa7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:03.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.290+0000 7fc64effd640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc634004900 0x7fc634004d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc640009b70 tx=0x7fc64002f460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff55b9022c779a45 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:03.303 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:03.296+0000 7f39f7433140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T11:54:03.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64003c070 con 0x7fc634004900 2026-02-17T11:54:03.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:03.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 10 monclient: dump: 2026-02-17T11:54:03.310 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.310 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.310 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.310 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc655aa7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64002fc80 con 0x7fc634004900 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 1 -- 10.20.193.174:0/402977828 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640009770 con 0x7fc634004900 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.311 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.291+0000 7fc64e7fc640 10 monclient: dump: 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.312 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:03.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 4 set_mon_vals no callback set 2026-02-17T11:54:03.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 10 monclient: shutdown 2026-02-17T11:54:03.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:03.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 -- 10.20.193.174:0/402977828 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc634004900 msgr2=0x7fc634004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc634004900 0x7fc634004d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc640009b70 tx=0x7fc64002f460 comp rx=0 tx=0).stop 2026-02-17T11:54:03.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 -- 10.20.193.174:0/402977828 shutdown_connections 2026-02-17T11:54:03.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 --2- 10.20.193.174:0/402977828 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc634004900 0x7fc634004d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 -- 10.20.193.174:0/402977828 >> 10.20.193.174:0/402977828 conn(0x7fc65006e030 msgr2=0x7fc65006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 -- 10.20.193.174:0/402977828 shutdown_connections 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 -- 10.20.193.174:0/402977828 wait complete. 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 10 monclient: build_initial_monmap 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 10 monclient: monmap: 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.314 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 librados: starting msgr at 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 librados: starting objecter 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 Processor -- start 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 -- start start 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 librados: setting wanted keys 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 1 librados: calling monclient init 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.292+0000 7fc655aa7640 10 monclient: init 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:03.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc634004900 0x7fc6501b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient(hunting): picked mon.noname-a con 0x7fc634004900 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc6501b1c30 0x7fc6501188b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient(hunting): picked mon.noname-b con 0x7fc6501b1c30 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc650118df0 0x7fc6501192a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient(hunting): picked mon.noname-c con 0x7fc650118df0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc650115f20 con 0x7fc634004900 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc650115da0 con 0x7fc6501b1c30 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.316 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc650124030 con 0x7fc650118df0 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc655aa7640 10 monclient(hunting): authenticate will time out at 917.931072s 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc650118df0 0x7fc6501192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64f7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc634004900 0x7fc6501b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64effd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc6501b1c30 0x7fc6501188b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc650118df0 0x7fc6501192a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.174:57562/0 (socket says 10.20.193.174:57562) 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 1 -- 10.20.193.174:0/112064371 learned_addr learned my addr 10.20.193.174:0/112064371 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 10 monclient(hunting): get_auth_request con 0x7fc650118df0 auth_method 0 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64effd640 10 monclient(hunting): get_auth_request con 0x7fc6501b1c30 auth_method 0 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64f7fe640 10 monclient(hunting): get_auth_request con 0x7fc634004900 auth_method 0 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.318 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.293+0000 7fc64f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.294+0000 7fc64effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.294+0000 7fc64effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.294+0000 7fc64effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 10 monclient(hunting): handle_auth_done global_id 4130 payload 824 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 1 -- 10.20.193.174:0/112064371 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc6501b1c30 msgr2=0x7fc6501188b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 1 --2- 10.20.193.174:0/112064371 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc6501b1c30 0x7fc6501188b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 1 -- 10.20.193.174:0/112064371 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc634004900 msgr2=0x7fc6501b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 1 --2- 10.20.193.174:0/112064371 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc634004900 0x7fc6501b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 1 monclient: found mon.noname-c 2026-02-17T11:54:03.319 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.295+0000 7fc64ffff640 1 -- 10.20.193.174:0/112064371 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6501b8510 con 0x7fc650118df0 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.296+0000 7fc64ffff640 1 --2- 10.20.193.174:0/112064371 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc650118df0 0x7fc6501192a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc65011ff80 tx=0x7fc64400df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.296+0000 7fc62bfff640 10 client.?.objecter ms_handle_connect 0x7fc650118df0 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.296+0000 7fc62bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 1 -- 10.20.193.174:0/112064371 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644019070 con 0x7fc650118df0 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 10 monclient: dump: 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.320 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 10 monclient: _finish_auth 0 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 5 monclient: authenticate success, global_id 4130 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 10 monclient: _renew_subs 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 1 -- 10.20.193.174:0/112064371 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6501b87a0 con 0x7fc650118df0 2026-02-17T11:54:03.321 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 10 client.4130.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 10 monclient: _renew_subs 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 1 -- 10.20.193.174:0/112064371 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6501b8ca0 con 0x7fc650118df0 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 1 librados: init done 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 1 -- 10.20.193.174:0/112064371 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64400bbb0 con 0x7fc650118df0 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 1 -- 10.20.193.174:0/112064371 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64401e440 con 0x7fc650118df0 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc62bfff640 10 monclient: dump: 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.322 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc64dffb640 4 set_mon_vals no callback set 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.323 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.297+0000 7fc655aa7640 1 -- 10.20.193.174:0/112064371 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc650124460 con 0x7fc650118df0 2026-02-17T11:54:03.323 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:03.302+0000 7f670d7d8140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T11:54:03.327 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:03.325+0000 7f670d7d8140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T11:54:03.340 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.339+0000 7fc62bfff640 1 -- 10.20.193.174:0/112064371 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc64401e5e0 con 0x7fc650118df0 2026-02-17T11:54:03.343 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.341+0000 7fc62bfff640 1 -- 10.20.193.174:0/112064371 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc6440074f0 con 0x7fc650118df0 2026-02-17T11:54:03.343 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.341+0000 7fc62bfff640 10 client.4130.objecter ms_dispatch2 0x7fc650000b90 osd_map(4..4 src has 1..4) 2026-02-17T11:54:03.343 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.341+0000 7fc62bfff640 3 client.4130.objecter handle_osd_map got epochs [4,4] > 0 2026-02-17T11:54:03.343 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.341+0000 7fc62bfff640 3 client.4130.objecter handle_osd_map decoding full epoch 4 2026-02-17T11:54:03.343 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.341+0000 7fc62bfff640 20 client.4130.objecter dump_active .. 0 homeless 2026-02-17T11:54:03.344 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.342+0000 7fc62bfff640 1 -- 10.20.193.174:0/112064371 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc644024020 con 0x7fc650118df0 2026-02-17T11:54:03.344 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.342+0000 7fc62bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.344 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.342+0000 7fc62bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:03.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.375+0000 7fc655aa7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0fce833d-0717-49d4-bb32-03b00db04b98", "id": 2}] 2026-02-17T11:54:03.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.375+0000 7fc655aa7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0fce833d-0717-49d4-bb32-03b00db04b98", "id": 2}] 2026-02-17T11:54:03.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.375+0000 7fc655aa7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.375+0000 7fc655aa7640 1 -- 10.20.193.174:0/112064371 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0fce833d-0717-49d4-bb32-03b00db04b98", "id": 2} v 0) -- 0x7fc650121710 con 0x7fc650118df0 2026-02-17T11:54:03.422 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.419+0000 7fc62bfff640 1 -- 10.20.193.174:0/112064371 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fce833d-0717-49d4-bb32-03b00db04b98", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc644013540 con 0x7fc650118df0 2026-02-17T11:54:03.422 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.419+0000 7fc62bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0fce833d-0717-49d4-bb32-03b00db04b98", "id": 2}] 2026-02-17T11:54:03.422 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.419+0000 7fc62bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:03.422 INFO:teuthology.orchestra.run.trial174.stdout:2 2026-02-17T11:54:03.424 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 10 librados: watch_flush enter 2026-02-17T11:54:03.424 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 10 librados: watch_flush exit 2026-02-17T11:54:03.424 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 20 client.4130.objecter shutdown clearing up homeless session... 2026-02-17T11:54:03.424 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 10 client.4130.objecter successfully canceled tick 2026-02-17T11:54:03.424 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 10 monclient: shutdown 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 -- 10.20.193.174:0/112064371 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc650118df0 msgr2=0x7fc6501192a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 --2- 10.20.193.174:0/112064371 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc650118df0 0x7fc6501192a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc65011ff80 tx=0x7fc64400df80 comp rx=0 tx=0).stop 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 -- 10.20.193.174:0/112064371 shutdown_connections 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 --2- 10.20.193.174:0/112064371 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc650118df0 0x7fc6501192a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 --2- 10.20.193.174:0/112064371 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc6501b1c30 0x7fc6501188b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 --2- 10.20.193.174:0/112064371 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc634004900 0x7fc6501b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 -- 10.20.193.174:0/112064371 >> 10.20.193.174:0/112064371 conn(0x7fc65006e030 msgr2=0x7fc65011bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 -- 10.20.193.174:0/112064371 shutdown_connections 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 -- 10.20.193.174:0/112064371 wait complete. 2026-02-17T11:54:03.425 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.420+0000 7fc655aa7640 1 librados: shutdown 2026-02-17T11:54:03.430 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308 3 2026-02-17T11:54:03.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.494+0000 7fa350bb7640 10 monclient: get_monmap_and_config 2026-02-17T11:54:03.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.494+0000 7fa350bb7640 10 monclient: build_initial_monmap 2026-02-17T11:54:03.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.494+0000 7fa350bb7640 10 monclient: monmap: 2026-02-17T11:54:03.500 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:03.496232+0000 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:03.496232+0000 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:03.501 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:03.502 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:03.502 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 1 Processor -- start 2026-02-17T11:54:03.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 1 -- start start 2026-02-17T11:54:03.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient: init 2026-02-17T11:54:03.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:03.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient: _add_conns ranks=[1,4,5,2,0,3] 2026-02-17T11:54:03.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa34c0737b0 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:03.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa34c11b460 0x7fa34c11d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient(hunting): picked mon.noname-b con 0x7fa34c11b460 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa34c11dd90 0x7fa34c120180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient(hunting): picked mon.noname-c con 0x7fa34c11dd90 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa34c120850 con 0x7fa34c0737b0 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa34c121a70 con 0x7fa34c11b460 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa34c121bf0 con 0x7fa34c11dd90 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa350bb7640 10 monclient(hunting): authenticate will time out at 918.133344s 2026-02-17T11:54:03.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa34b7fe640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fa34c0737b0 0x7fa34c073b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.174:43090/0 (socket says 10.20.193.174:43090) 2026-02-17T11:54:03.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa34b7fe640 1 -- 10.20.193.174:0/1852077182 learned_addr learned my addr 10.20.193.174:0/1852077182 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-17T11:54:03.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa34bfff640 1 --2- 10.20.193.174:0/1852077182 >> v2:10.20.193.153:3300/0 conn(0x7fa34c11dd90 0x7fa34c120180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa34bfff640 10 monclient(hunting): get_auth_request con 0x7fa34c11dd90 auth_method 0 2026-02-17T11:54:03.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa34bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa34bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.495+0000 7fa34bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34affd640 1 --2- 10.20.193.174:0/1852077182 >> v2:10.20.193.71:3300/0 conn(0x7fa34c11b460 0x7fa34c11d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34affd640 10 monclient(hunting): get_auth_request con 0x7fa34c11b460 auth_method 0 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.496+0000 7fa34affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.497+0000 7fa34bfff640 10 monclient(hunting): handle_auth_done global_id 4133 payload 274 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.497+0000 7fa34bfff640 1 -- 10.20.193.174:0/1852077182 >> v2:10.20.193.71:3300/0 conn(0x7fa34c11b460 msgr2=0x7fa34c11d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.497+0000 7fa34bfff640 1 --2- 10.20.193.174:0/1852077182 >> v2:10.20.193.71:3300/0 conn(0x7fa34c11b460 0x7fa34c11d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.497+0000 7fa34bfff640 1 -- 10.20.193.174:0/1852077182 >> v1:10.20.193.71:6789/0 conn(0x7fa34c0737b0 legacy=0x7fa34c073b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.497+0000 7fa34bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:03.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.497+0000 7fa34bfff640 1 monclient: found mon.noname-c 2026-02-17T11:54:03.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.497+0000 7fa34bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:03.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.497+0000 7fa34bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.497+0000 7fa34bfff640 1 -- 10.20.193.174:0/1852077182 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34c121da0 con 0x7fa34c11dd90 2026-02-17T11:54:03.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.498+0000 7fa34bfff640 1 --2- 10.20.193.174:0/1852077182 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11dd90 0x7fa34c120180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0743f0 tx=0x7fa34002f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5ab73ab5fc34bad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:03.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 1 -- 10.20.193.174:0/1852077182 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34003c070 con 0x7fa34c11dd90 2026-02-17T11:54:03.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:03.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 10 monclient: dump: 2026-02-17T11:54:03.515 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.515 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.515 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.515 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.515 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 1 -- 10.20.193.174:0/1852077182 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34002fe40 con 0x7fa34c11dd90 2026-02-17T11:54:03.516 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 1 -- 10.20.193.174:0/1852077182 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340037660 con 0x7fa34c11dd90 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa350bb7640 5 monclient: authenticate success, global_id 4133 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa350bb7640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa350bb7640 4 set_mon_vals no callback set 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa34a7fc640 10 monclient: dump: 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.517 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa350bb7640 10 monclient: shutdown 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa350bb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa350bb7640 1 -- 10.20.193.174:0/1852077182 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11dd90 msgr2=0x7fa34c120180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.499+0000 7fa350bb7640 1 --2- 10.20.193.174:0/1852077182 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11dd90 0x7fa34c120180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0743f0 tx=0x7fa34002f130 comp rx=0 tx=0).stop 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 -- 10.20.193.174:0/1852077182 shutdown_connections 2026-02-17T11:54:03.518 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 --2- 10.20.193.174:0/1852077182 >> v2:10.20.193.71:3300/0 conn(0x7fa34c11b460 0x7fa34c11d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 --2- 10.20.193.174:0/1852077182 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11dd90 0x7fa34c120180 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 -- 10.20.193.174:0/1852077182 >> 10.20.193.174:0/1852077182 conn(0x7fa34c06f5e0 msgr2=0x7fa34c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 -- 10.20.193.174:0/1852077182 shutdown_connections 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 -- 10.20.193.174:0/1852077182 wait complete. 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient: build_initial_monmap 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient: monmap: 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:03.519 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 librados: starting msgr at 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 librados: starting objecter 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 Processor -- start 2026-02-17T11:54:03.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 -- start start 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 librados: setting wanted keys 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 librados: calling monclient init 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient: init 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa34c0737b0 0x7fa34c112240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient(hunting): picked mon.noname-b con 0x7fa34c0737b0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11b460 0x7fa34c112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient(hunting): picked mon.noname-c con 0x7fa34c11b460 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:03.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa34c11dd90 0x7fa34c1b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient(hunting): picked mon.noname-a con 0x7fa34c11dd90 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c120ee0 con 0x7fa34c11dd90 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c120d60 con 0x7fa34c0737b0 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c121060 con 0x7fa34c11b460 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa350bb7640 10 monclient(hunting): authenticate will time out at 918.138655s 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.500+0000 7fa34affd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11b460 0x7fa34c112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa34c0737b0 0x7fa34c112240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34bfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa34c11dd90 0x7fa34c1b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa34c0737b0 0x7fa34c112240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37076/0 (socket says 10.20.193.174:37076) 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 1 -- 10.20.193.174:0/3223586340 learned_addr learned my addr 10.20.193.174:0/3223586340 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 10 monclient(hunting): get_auth_request con 0x7fa34c0737b0 auth_method 0 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34affd640 10 monclient(hunting): get_auth_request con 0x7fa34c11b460 auth_method 0 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34bfff640 10 monclient(hunting): get_auth_request con 0x7fa34c11dd90 auth_method 0 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.501+0000 7fa34bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 10 monclient(hunting): handle_auth_done global_id 4136 payload 824 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 1 -- 10.20.193.174:0/3223586340 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa34c0737b0 msgr2=0x7fa34c112240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 1 --2- 10.20.193.174:0/3223586340 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa34c0737b0 0x7fa34c112240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 1 -- 10.20.193.174:0/3223586340 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa34c11dd90 msgr2=0x7fa34c1b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 1 --2- 10.20.193.174:0/3223586340 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa34c11dd90 0x7fa34c1b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 10 monclient: _finish_hunting 0 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 1 monclient: found mon.noname-c 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.502+0000 7fa34affd640 1 -- 10.20.193.174:0/3223586340 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34c1b7af0 con 0x7fa34c11b460 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.503+0000 7fa34affd640 1 --2- 10.20.193.174:0/3223586340 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11b460 0x7fa34c112780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00e9b0 tx=0x7fa33c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.503+0000 7fa327fff640 10 client.?.objecter ms_handle_connect 0x7fa34c11b460 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.503+0000 7fa327fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 1 -- 10.20.193.174:0/3223586340 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c017070 con 0x7fa34c11b460 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 10 monclient: dump: 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.526 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 1 -- 10.20.193.174:0/3223586340 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c00ca00 con 0x7fa34c11b460 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 5 monclient: authenticate success, global_id 4136 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:03.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 1 -- 10.20.193.174:0/3223586340 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c00cdf0 con 0x7fa34c11b460 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa349ffb640 4 set_mon_vals no callback set 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa327fff640 10 monclient: dump: 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.528 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 10 monclient: _renew_subs 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 1 -- 10.20.193.174:0/3223586340 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa34c1b7cc0 con 0x7fa34c11b460 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 10 client.4136.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 10 monclient: _renew_subs 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 1 -- 10.20.193.174:0/3223586340 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa34c1b8130 con 0x7fa34c11b460 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 1 librados: init done 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.530 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.530 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.505+0000 7fa350bb7640 1 -- 10.20.193.174:0/3223586340 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa34c121470 con 0x7fa34c11b460 2026-02-17T11:54:03.530 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.506+0000 7fa327fff640 1 -- 10.20.193.174:0/3223586340 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa33c024060 con 0x7fa34c11b460 2026-02-17T11:54:03.530 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.506+0000 7fa327fff640 1 -- 10.20.193.174:0/3223586340 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa33c006790 con 0x7fa34c11b460 2026-02-17T11:54:03.530 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.506+0000 7fa327fff640 10 client.4136.objecter ms_dispatch2 0x7fa34c000b90 osd_map(5..5 src has 1..5) 2026-02-17T11:54:03.530 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.506+0000 7fa327fff640 3 client.4136.objecter handle_osd_map got epochs [5,5] > 0 2026-02-17T11:54:03.530 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.506+0000 7fa327fff640 3 client.4136.objecter handle_osd_map decoding full epoch 5 2026-02-17T11:54:03.530 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.506+0000 7fa327fff640 20 client.4136.objecter dump_active .. 0 homeless 2026-02-17T11:54:03.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.547+0000 7fa327fff640 1 -- 10.20.193.174:0/3223586340 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fa33c005a90 con 0x7fa34c11b460 2026-02-17T11:54:03.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.547+0000 7fa327fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.547+0000 7fa327fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:03.582 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.580+0000 7fa350bb7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308", "id": 3}] 2026-02-17T11:54:03.583 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.580+0000 7fa350bb7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308", "id": 3}] 2026-02-17T11:54:03.583 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.580+0000 7fa350bb7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:03.583 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.580+0000 7fa350bb7640 1 -- 10.20.193.174:0/3223586340 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308", "id": 3} v 0) -- 0x7fa34c115580 con 0x7fa34c11b460 2026-02-17T11:54:03.614 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.611+0000 7fa327fff640 1 -- 10.20.193.174:0/3223586340 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa34c115580 con 0x7fa34c11b460 2026-02-17T11:54:03.614 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.611+0000 7fa327fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308", "id": 3}] 2026-02-17T11:54:03.614 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.611+0000 7fa327fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:03.615 INFO:teuthology.orchestra.run.trial174.stdout:3 2026-02-17T11:54:03.616 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 10 librados: watch_flush enter 2026-02-17T11:54:03.616 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 10 librados: watch_flush exit 2026-02-17T11:54:03.616 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 20 client.4136.objecter shutdown clearing up homeless session... 2026-02-17T11:54:03.616 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 10 client.4136.objecter successfully canceled tick 2026-02-17T11:54:03.616 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 10 monclient: shutdown 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 -- 10.20.193.174:0/3223586340 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11b460 msgr2=0x7fa34c112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 --2- 10.20.193.174:0/3223586340 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11b460 0x7fa34c112780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00e9b0 tx=0x7fa33c00ee80 comp rx=0 tx=0).stop 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 -- 10.20.193.174:0/3223586340 shutdown_connections 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 --2- 10.20.193.174:0/3223586340 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa34c11dd90 0x7fa34c1b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 --2- 10.20.193.174:0/3223586340 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa34c11b460 0x7fa34c112780 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 --2- 10.20.193.174:0/3223586340 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa34c0737b0 0x7fa34c112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 -- 10.20.193.174:0/3223586340 >> 10.20.193.174:0/3223586340 conn(0x7fa34c06f5e0 msgr2=0x7fa34c11e490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 -- 10.20.193.174:0/3223586340 shutdown_connections 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 -- 10.20.193.174:0/3223586340 wait complete. 2026-02-17T11:54:03.617 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.612+0000 7fa350bb7640 1 librados: shutdown 2026-02-17T11:54:03.622 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df 4 2026-02-17T11:54:03.641 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:03.639+0000 7f39f7433140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T11:54:03.671 INFO:tasks.ceph.mgr.x.trial174.stderr:2026-02-17T11:54:03.669+0000 7f670d7d8140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T11:54:03.687 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient: get_monmap_and_config 2026-02-17T11:54:03.687 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient: build_initial_monmap 2026-02-17T11:54:03.687 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient: monmap: 2026-02-17T11:54:03.687 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:03.685656+0000 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:03.685656+0000 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:03.688 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 1 Processor -- start 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 1 -- start start 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient: init 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient: _add_conns ranks=[3,5,4,1,2,0] 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8c80118490 0x7f8c800739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient(hunting): picked mon.noname-a con 0x7f8c80118490 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f8c80073f10 0x7f8c800743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient(hunting): picked mon.noname-c con 0x7f8c80073f10 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8c801233c0 0x7f8c80125860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.689 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient(hunting): picked mon.noname-b con 0x7f8c801233c0 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:03.690 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.690 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f8c80125fb0 con 0x7f8c80118490 2026-02-17T11:54:03.690 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.690 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8c80126130 con 0x7f8c801233c0 2026-02-17T11:54:03.690 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.690 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8c801262e0 con 0x7f8c80073f10 2026-02-17T11:54:03.690 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:03.690 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.684+0000 7f8c872bf640 10 monclient(hunting): authenticate will time out at 918.322783s 2026-02-17T11:54:03.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8c80118490 0x7f8c800739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8c80118490 0x7f8c800739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.174:41812/0 (socket says 10.20.193.174:41812) 2026-02-17T11:54:03.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 1 -- 10.20.193.174:0/3757564956 learned_addr learned my addr 10.20.193.174:0/3757564956 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:03.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 10 monclient(hunting): get_auth_request con 0x7f8c80118490 auth_method 0 2026-02-17T11:54:03.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.686+0000 7f8c85034640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 10 monclient(hunting): handle_auth_done global_id 4131 payload 274 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 1 -- 10.20.193.174:0/3757564956 >> v2:10.20.193.153:3300/0 conn(0x7f8c80073f10 msgr2=0x7f8c800743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 1 --2- 10.20.193.174:0/3757564956 >> v2:10.20.193.153:3300/0 conn(0x7f8c80073f10 0x7f8c800743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 1 -- 10.20.193.174:0/3757564956 >> v2:10.20.193.71:3300/0 conn(0x7f8c801233c0 msgr2=0x7f8c80125860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 1 --2- 10.20.193.174:0/3757564956 >> v2:10.20.193.71:3300/0 conn(0x7f8c801233c0 0x7f8c80125860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 10 monclient: _finish_hunting 0 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 1 monclient: found mon.noname-a 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:03.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.687+0000 7f8c85034640 1 -- 10.20.193.174:0/3757564956 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c80126490 con 0x7f8c80118490 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.688+0000 7f8c85034640 1 --2- 10.20.193.174:0/3757564956 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c80118490 0x7f8c800739d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c80125ef0 tx=0x7f8c7002ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5f3f967d16278c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 1 -- 10.20.193.174:0/3757564956 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7003c070 con 0x7f8c80118490 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 10 monclient: dump: 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.699 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 10 monclient: _finish_auth 0 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 1 -- 10.20.193.174:0/3757564956 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7002fb50 con 0x7f8c80118490 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 5 monclient: authenticate success, global_id 4131 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 1 -- 10.20.193.174:0/3757564956 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70037440 con 0x7f8c80118490 2026-02-17T11:54:03.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c6ffff640 10 monclient: dump: 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.701 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 4 set_mon_vals no callback set 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 10 monclient: shutdown 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 1 -- 10.20.193.174:0/3757564956 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c80118490 msgr2=0x7f8c800739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 1 --2- 10.20.193.174:0/3757564956 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c80118490 0x7f8c800739d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c80125ef0 tx=0x7f8c7002ee90 comp rx=0 tx=0).stop 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 1 -- 10.20.193.174:0/3757564956 shutdown_connections 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 1 --2- 10.20.193.174:0/3757564956 >> v2:10.20.193.71:3300/0 conn(0x7f8c801233c0 0x7f8c80125860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 1 --2- 10.20.193.174:0/3757564956 >> v2:10.20.193.153:3300/0 conn(0x7f8c80073f10 0x7f8c800743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 1 --2- 10.20.193.174:0/3757564956 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c80118490 0x7f8c800739d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 1 -- 10.20.193.174:0/3757564956 >> 10.20.193.174:0/3757564956 conn(0x7f8c8006f950 msgr2=0x7f8c80071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:03.702 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 1 -- 10.20.193.174:0/3757564956 shutdown_connections 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.690+0000 7f8c872bf640 1 -- 10.20.193.174:0/3757564956 wait complete. 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient: build_initial_monmap 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient: monmap: 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:03.703 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 librados: starting msgr at 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 librados: starting objecter 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 Processor -- start 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 -- start start 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 librados: setting wanted keys 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 librados: calling monclient init 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient: init 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c80073f10 0x7f8c801b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient(hunting): picked mon.noname-c con 0x7f8c80073f10 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c80118490 0x7f8c801b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient(hunting): picked mon.noname-a con 0x7f8c80118490 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c801233c0 0x7f8c801afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient(hunting): picked mon.noname-b con 0x7f8c801233c0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80126bc0 con 0x7f8c80118490 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80126a40 con 0x7f8c801233c0 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80126d40 con 0x7f8c80073f10 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:03.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c872bf640 10 monclient(hunting): authenticate will time out at 918.329549s 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.691+0000 7f8c85835640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c801233c0 0x7f8c801afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c85835640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c801233c0 0x7f8c801afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37096/0 (socket says 10.20.193.174:37096) 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c85835640 1 -- 10.20.193.174:0/2533777285 learned_addr learned my addr 10.20.193.174:0/2533777285 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c85835640 10 monclient(hunting): get_auth_request con 0x7f8c801233c0 auth_method 0 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c85835640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c85835640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c85835640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c84833640 1 --2- 10.20.193.174:0/2533777285 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c80118490 0x7f8c801b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c84833640 10 monclient(hunting): get_auth_request con 0x7f8c80118490 auth_method 0 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c84833640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c84833640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:03.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c84833640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c85835640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c85835640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c85835640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c84833640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c84833640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.692+0000 7f8c84833640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85034640 1 --2- 10.20.193.174:0/2533777285 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c80073f10 0x7f8c801b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 10 monclient(hunting): handle_auth_done global_id 4135 payload 824 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 1 -- 10.20.193.174:0/2533777285 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c80073f10 msgr2=0x7f8c801b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 1 --2- 10.20.193.174:0/2533777285 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c80073f10 0x7f8c801b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 1 -- 10.20.193.174:0/2533777285 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c80118490 msgr2=0x7f8c801b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 1 --2- 10.20.193.174:0/2533777285 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c80118490 0x7f8c801b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 10 monclient: _finish_hunting 0 2026-02-17T11:54:03.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 1 monclient: found mon.noname-b 2026-02-17T11:54:03.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:03.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:03.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.693+0000 7f8c85835640 1 -- 10.20.193.174:0/2533777285 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c801b0440 con 0x7f8c801233c0 2026-02-17T11:54:03.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.694+0000 7f8c85835640 1 --2- 10.20.193.174:0/2533777285 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c801233c0 0x7f8c801afb80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00b9e0 tx=0x7f8c7c00beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:03.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.694+0000 7f8c6dffb640 10 client.?.objecter ms_handle_connect 0x7f8c801233c0 2026-02-17T11:54:03.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.694+0000 7f8c6dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:03.710 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c6dffb640 1 -- 10.20.193.174:0/2533777285 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00c6b0 con 0x7f8c801233c0 2026-02-17T11:54:03.710 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.710 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c6dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c6dffb640 10 monclient: dump: 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.711 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c6dffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c6dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c6dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 5 monclient: authenticate success, global_id 4135 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 10 monclient: _renew_subs 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 1 -- 10.20.193.174:0/2533777285 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c801b06d0 con 0x7f8c801233c0 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 10 client.4135.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 10 monclient: _renew_subs 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 1 -- 10.20.193.174:0/2533777285 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c801bca60 con 0x7f8c801233c0 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 1 librados: init done 2026-02-17T11:54:03.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.695+0000 7f8c872bf640 1 -- 10.20.193.174:0/2533777285 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c800743a0 con 0x7f8c801233c0 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.696+0000 7f8c6dffb640 1 -- 10.20.193.174:0/2533777285 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c010070 con 0x7f8c801233c0 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.696+0000 7f8c6dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.696+0000 7f8c6dffb640 1 -- 10.20.193.174:0/2533777285 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00ca50 con 0x7f8c801233c0 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.696+0000 7f8c6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.696+0000 7f8c6dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.696+0000 7f8c6effd640 4 set_mon_vals no callback set 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.696+0000 7f8c6dffb640 10 monclient: dump: 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:03.713 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:03.714 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.714 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:03.714 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:03.714 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:03.714 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:03.714 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:03.714 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:03.714 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:03.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.703+0000 7f8c6dffb640 1 -- 10.20.193.174:0/2533777285 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f8c7c01d030 con 0x7f8c801233c0 2026-02-17T11:54:03.783 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.781+0000 7f8c6dffb640 1 -- 10.20.193.174:0/2533777285 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8c7c00cbf0 con 0x7f8c801233c0 2026-02-17T11:54:03.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.781+0000 7f8c6dffb640 10 client.4135.objecter ms_dispatch2 0x7f8c80000b90 osd_map(6..6 src has 1..6) 2026-02-17T11:54:03.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.781+0000 7f8c6dffb640 3 client.4135.objecter handle_osd_map got epochs [6,6] > 0 2026-02-17T11:54:03.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.781+0000 7f8c6dffb640 3 client.4135.objecter handle_osd_map decoding full epoch 6 2026-02-17T11:54:03.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.781+0000 7f8c6dffb640 20 client.4135.objecter dump_active .. 0 homeless 2026-02-17T11:54:03.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.781+0000 7f8c6dffb640 1 -- 10.20.193.174:0/2533777285 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f8c7c004460 con 0x7f8c801233c0 2026-02-17T11:54:03.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.781+0000 7f8c6dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:03.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.781+0000 7f8c6dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:03.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.813+0000 7f8c872bf640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df", "id": 4}] 2026-02-17T11:54:03.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.813+0000 7f8c872bf640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df", "id": 4}] 2026-02-17T11:54:03.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.813+0000 7f8c872bf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:03.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.813+0000 7f8c872bf640 1 -- 10.20.193.174:0/2533777285 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df", "id": 4} v 0) -- 0x7f8c801bcc90 con 0x7f8c801233c0 2026-02-17T11:54:03.835 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.833+0000 7f8c6dffb640 1 -- 10.20.193.174:0/2533777285 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mgrmap(e 2) ==== 49971+0+0 (secure 0 0 0) 0x7f8c7c004730 con 0x7f8c801233c0 2026-02-17T11:54:03.937 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c6dffb640 1 -- 10.20.193.174:0/2533777285 <== mon.1 v2:10.20.193.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8c7c0159a0 con 0x7f8c801233c0 2026-02-17T11:54:03.938 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c6dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df", "id": 4}] 2026-02-17T11:54:03.938 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c6dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:03.938 INFO:teuthology.orchestra.run.trial174.stdout:4 2026-02-17T11:54:03.940 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 10 librados: watch_flush enter 2026-02-17T11:54:03.940 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 10 librados: watch_flush exit 2026-02-17T11:54:03.940 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 20 client.4135.objecter shutdown clearing up homeless session... 2026-02-17T11:54:03.940 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 10 client.4135.objecter successfully canceled tick 2026-02-17T11:54:03.940 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 10 monclient: shutdown 2026-02-17T11:54:03.941 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:03.941 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 -- 10.20.193.174:0/2533777285 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c801233c0 msgr2=0x7f8c801afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:03.941 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 --2- 10.20.193.174:0/2533777285 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c801233c0 0x7f8c801afb80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00b9e0 tx=0x7f8c7c00beb0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.941 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 -- 10.20.193.174:0/2533777285 shutdown_connections 2026-02-17T11:54:03.941 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 --2- 10.20.193.174:0/2533777285 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8c801233c0 0x7f8c801afb80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.941 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 --2- 10.20.193.174:0/2533777285 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8c80118490 0x7f8c801b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.941 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 --2- 10.20.193.174:0/2533777285 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8c80073f10 0x7f8c801b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:03.941 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 -- 10.20.193.174:0/2533777285 >> 10.20.193.174:0/2533777285 conn(0x7f8c8006f950 msgr2=0x7f8c80071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:03.941 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 -- 10.20.193.174:0/2533777285 shutdown_connections 2026-02-17T11:54:03.942 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 -- 10.20.193.174:0/2533777285 wait complete. 2026-02-17T11:54:03.942 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:03.935+0000 7f8c872bf640 1 librados: shutdown 2026-02-17T11:54:03.947 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new dcc94db0-1519-4aab-9197-6b1f5899aed1 5 2026-02-17T11:54:04.013 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.008+0000 7f19e2e1a640 10 monclient: get_monmap_and_config 2026-02-17T11:54:04.013 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.008+0000 7f19e2e1a640 10 monclient: build_initial_monmap 2026-02-17T11:54:04.013 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.008+0000 7f19e2e1a640 10 monclient: monmap: 2026-02-17T11:54:04.013 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:04.013 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.013 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:04.010139+0000 2026-02-17T11:54:04.013 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:04.010139+0000 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 1 Processor -- start 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 1 -- start start 2026-02-17T11:54:04.014 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 10 monclient: init 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 10 monclient: _add_conns ranks=[0,5,2,1,4,3] 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f19dc073a90 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f19dc11d950 0x7f19dc11fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 10 monclient(hunting): picked mon.noname-c con 0x7f19dc11d950 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f19dc120280 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19dc123e20 con 0x7f19dc073a90 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19dc125020 con 0x7f19dc120280 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f19dc126220 con 0x7f19dc11d950 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:04.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e2e1a640 10 monclient(hunting): authenticate will time out at 918.647303s 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e1390640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f19dc120280 0x7f19dc122670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.174:41764/0 (socket says 10.20.193.174:41764) 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19e1390640 1 -- 10.20.193.174:0/3745936770 learned_addr learned my addr 10.20.193.174:0/3745936770 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.009+0000 7f19d3fff640 1 --2- 10.20.193.174:0/3745936770 >> v2:10.20.193.153:3300/0 conn(0x7f19dc11d950 0x7f19dc11fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.010+0000 7f19d3fff640 10 monclient(hunting): get_auth_request con 0x7f19dc11d950 auth_method 0 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.010+0000 7f19d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.010+0000 7f19d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.010+0000 7f19d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.010+0000 7f19d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.010+0000 7f19d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.016 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.010+0000 7f19d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.018 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.011+0000 7f19d37fe640 1 -- 10.20.193.174:0/3745936770 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236404136 0 0) 0x7f19dc125020 con 0x7f19dc120280 2026-02-17T11:54:04.019 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.011+0000 7f19d37fe640 10 monclient(hunting): _negotiate 2026-02-17T11:54:04.019 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.011+0000 7f19d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.019 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.011+0000 7f19d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.019 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.011+0000 7f19d37fe640 10 monclient(hunting): my global_id is 4148 2026-02-17T11:54:04.019 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.011+0000 7f19d37fe640 1 -- 10.20.193.174:0/3745936770 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19c8003620 con 0x7f19dc120280 2026-02-17T11:54:04.019 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.012+0000 7f19d3fff640 10 monclient(hunting): handle_auth_done global_id 4145 payload 274 2026-02-17T11:54:04.019 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.012+0000 7f19d3fff640 1 -- 10.20.193.174:0/3745936770 >> v1:10.20.193.153:6789/0 conn(0x7f19dc120280 legacy=0x7f19dc122670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.020 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.012+0000 7f19d3fff640 1 -- 10.20.193.174:0/3745936770 >> v1:10.20.193.10:6789/0 conn(0x7f19dc073a90 legacy=0x7f19dc073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:04.020 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.012+0000 7f19d3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:04.020 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.012+0000 7f19d3fff640 1 monclient: found mon.noname-c 2026-02-17T11:54:04.020 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.012+0000 7f19d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:04.020 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.012+0000 7f19d3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:04.020 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.012+0000 7f19d3fff640 1 -- 10.20.193.174:0/3745936770 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19dc1263a0 con 0x7f19dc11d950 2026-02-17T11:54:04.020 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.015+0000 7f19d3fff640 1 --2- 10.20.193.174:0/3745936770 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 0x7f19dc11fd40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f19dc074760 tx=0x7f19c402ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c1908988ea43cb5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:04.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 1 -- 10.20.193.174:0/3745936770 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c403c070 con 0x7f19dc11d950 2026-02-17T11:54:04.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:04.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 10 monclient: dump: 2026-02-17T11:54:04.031 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.031 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.031 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.031 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.031 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.031 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.031 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.031 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.032 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.032 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 10 monclient: _finish_auth 0 2026-02-17T11:54:04.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:54:04.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:04.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19e2e1a640 5 monclient: authenticate success, global_id 4145 2026-02-17T11:54:04.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19e2e1a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:04.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 1 -- 10.20.193.174:0/3745936770 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c402fa30 con 0x7f19dc11d950 2026-02-17T11:54:04.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:04.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 1 -- 10.20.193.174:0/3745936770 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c402fde0 con 0x7f19dc11d950 2026-02-17T11:54:04.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19e2e1a640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:04.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19e2e1a640 4 set_mon_vals no callback set 2026-02-17T11:54:04.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:04.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.017+0000 7f19d37fe640 10 monclient: dump: 2026-02-17T11:54:04.033 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.034 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.034 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.034 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.034 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.034 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.034 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.034 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.034 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.034 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient: shutdown 2026-02-17T11:54:04.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:04.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 -- 10.20.193.174:0/3745936770 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 msgr2=0x7f19dc11fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 --2- 10.20.193.174:0/3745936770 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 0x7f19dc11fd40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f19dc074760 tx=0x7f19c402ed70 comp rx=0 tx=0).stop 2026-02-17T11:54:04.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 -- 10.20.193.174:0/3745936770 shutdown_connections 2026-02-17T11:54:04.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 --2- 10.20.193.174:0/3745936770 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 0x7f19dc11fd40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 -- 10.20.193.174:0/3745936770 >> 10.20.193.174:0/3745936770 conn(0x7f19dc06f950 msgr2=0x7f19dc071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:04.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 -- 10.20.193.174:0/3745936770 shutdown_connections 2026-02-17T11:54:04.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 -- 10.20.193.174:0/3745936770 wait complete. 2026-02-17T11:54:04.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient: build_initial_monmap 2026-02-17T11:54:04.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient: monmap: 2026-02-17T11:54:04.036 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:04.036 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:04.036 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:04.036 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:04.036 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:04.036 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.037 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:04.037 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:04.037 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:04.037 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 librados: starting msgr at 2026-02-17T11:54:04.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 librados: starting objecter 2026-02-17T11:54:04.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 Processor -- start 2026-02-17T11:54:04.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 -- start start 2026-02-17T11:54:04.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 librados: setting wanted keys 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 librados: calling monclient init 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient: init 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f19dc073a90 0x7f19dc11be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient(hunting): picked mon.noname-a con 0x7f19dc073a90 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 0x7f19dc11c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient(hunting): picked mon.noname-c con 0x7f19dc11d950 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19dc120280 0x7f19dc1b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient(hunting): picked mon.noname-b con 0x7f19dc120280 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:04.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1244b0 con 0x7f19dc073a90 2026-02-17T11:54:04.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc124330 con 0x7f19dc120280 2026-02-17T11:54:04.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc124630 con 0x7f19dc11d950 2026-02-17T11:54:04.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.018+0000 7f19e2e1a640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:04.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19e2e1a640 10 monclient(hunting): authenticate will time out at 918.657006s 2026-02-17T11:54:04.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 0x7f19dc11c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19e1390640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19dc120280 0x7f19dc1b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 0x7f19dc11c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.174:57618/0 (socket says 10.20.193.174:57618) 2026-02-17T11:54:04.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 1 -- 10.20.193.174:0/4186065253 learned_addr learned my addr 10.20.193.174:0/4186065253 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:04.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 10 monclient(hunting): get_auth_request con 0x7f19dc11d950 auth_method 0 2026-02-17T11:54:04.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19e1390640 10 monclient(hunting): get_auth_request con 0x7f19dc120280 auth_method 0 2026-02-17T11:54:04.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19e1390640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19e1390640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19e1390640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19e1390640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19e1390640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.019+0000 7f19e1390640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 10 monclient(hunting): handle_auth_done global_id 4151 payload 824 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 1 -- 10.20.193.174:0/4186065253 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19dc120280 msgr2=0x7f19dc1b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 1 --2- 10.20.193.174:0/4186065253 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19dc120280 0x7f19dc1b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 1 -- 10.20.193.174:0/4186065253 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f19dc073a90 msgr2=0x7f19dc11be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 1 --2- 10.20.193.174:0/4186065253 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f19dc073a90 0x7f19dc11be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 1 monclient: found mon.noname-c 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.021+0000 7f19d3fff640 1 -- 10.20.193.174:0/4186065253 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19dc1b7b10 con 0x7f19dc11d950 2026-02-17T11:54:04.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.022+0000 7f19d3fff640 1 --2- 10.20.193.174:0/4186065253 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 0x7f19dc11c4b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f19c402edb0 tx=0x7f19c40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.022+0000 7f19d17fa640 10 client.?.objecter ms_handle_connect 0x7f19dc11d950 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.022+0000 7f19d17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 1 -- 10.20.193.174:0/4186065253 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4046020 con 0x7f19dc11d950 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 10 monclient: dump: 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.043 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 10 monclient: _finish_auth 0 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 10 monclient: _check_auth_tickets 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 1 -- 10.20.193.174:0/4186065253 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c4003a10 con 0x7f19dc11d950 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 1 -- 10.20.193.174:0/4186065253 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c403c040 con 0x7f19dc11d950 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 5 monclient: authenticate success, global_id 4151 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 10 monclient: _renew_subs 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 1 -- 10.20.193.174:0/4186065253 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19dc1b7d40 con 0x7f19dc11d950 2026-02-17T11:54:04.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d2ffd640 4 set_mon_vals no callback set 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19d17fa640 10 monclient: dump: 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 10 client.4151.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 10 monclient: _renew_subs 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:04.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 1 -- 10.20.193.174:0/4186065253 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19dc1b81b0 con 0x7f19dc11d950 2026-02-17T11:54:04.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 1 librados: init done 2026-02-17T11:54:04.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:04.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.024+0000 7f19e2e1a640 1 -- 10.20.193.174:0/4186065253 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19dc124a90 con 0x7f19dc11d950 2026-02-17T11:54:04.071 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.069+0000 7f19d17fa640 1 -- 10.20.193.174:0/4186065253 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 2) ==== 49971+0+0 (secure 0 0 0) 0x7f19c403f030 con 0x7f19dc11d950 2026-02-17T11:54:04.074 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.072+0000 7f19d17fa640 1 -- 10.20.193.174:0/4186065253 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f19c404ae00 con 0x7f19dc11d950 2026-02-17T11:54:04.074 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.072+0000 7f19d17fa640 10 client.4151.objecter ms_dispatch2 0x7f19dc000b90 osd_map(7..7 src has 1..7) 2026-02-17T11:54:04.074 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.072+0000 7f19d17fa640 3 client.4151.objecter handle_osd_map got epochs [7,7] > 0 2026-02-17T11:54:04.074 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.072+0000 7f19d17fa640 3 client.4151.objecter handle_osd_map decoding full epoch 7 2026-02-17T11:54:04.075 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.072+0000 7f19d17fa640 20 client.4151.objecter dump_active .. 0 homeless 2026-02-17T11:54:04.075 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.072+0000 7f19d17fa640 1 -- 10.20.193.174:0/4186065253 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f19c4050030 con 0x7f19dc11d950 2026-02-17T11:54:04.075 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.072+0000 7f19d17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.075 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.072+0000 7f19d17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:04.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.105+0000 7f19e2e1a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "dcc94db0-1519-4aab-9197-6b1f5899aed1", "id": 5}] 2026-02-17T11:54:04.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.105+0000 7f19e2e1a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "dcc94db0-1519-4aab-9197-6b1f5899aed1", "id": 5}] 2026-02-17T11:54:04.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.105+0000 7f19e2e1a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:04.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.105+0000 7f19e2e1a640 1 -- 10.20.193.174:0/4186065253 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dcc94db0-1519-4aab-9197-6b1f5899aed1", "id": 5} v 0) -- 0x7f19dc06fee0 con 0x7f19dc11d950 2026-02-17T11:54:04.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19d17fa640 1 -- 10.20.193.174:0/4186065253 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dcc94db0-1519-4aab-9197-6b1f5899aed1", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f19c4037440 con 0x7f19dc11d950 2026-02-17T11:54:04.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19d17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "dcc94db0-1519-4aab-9197-6b1f5899aed1", "id": 5}] 2026-02-17T11:54:04.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19d17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:04.179 INFO:teuthology.orchestra.run.trial174.stdout:5 2026-02-17T11:54:04.181 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 10 librados: watch_flush enter 2026-02-17T11:54:04.181 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 10 librados: watch_flush exit 2026-02-17T11:54:04.181 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 20 client.4151.objecter shutdown clearing up homeless session... 2026-02-17T11:54:04.181 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 10 client.4151.objecter successfully canceled tick 2026-02-17T11:54:04.181 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 10 monclient: shutdown 2026-02-17T11:54:04.181 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:04.181 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 -- 10.20.193.174:0/4186065253 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 msgr2=0x7f19dc11c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.181 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 --2- 10.20.193.174:0/4186065253 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 0x7f19dc11c4b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f19c402edb0 tx=0x7f19c40047c0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.182 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 -- 10.20.193.174:0/4186065253 shutdown_connections 2026-02-17T11:54:04.182 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 --2- 10.20.193.174:0/4186065253 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19dc120280 0x7f19dc1b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.182 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 --2- 10.20.193.174:0/4186065253 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f19dc11d950 0x7f19dc11c4b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.182 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 --2- 10.20.193.174:0/4186065253 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f19dc073a90 0x7f19dc11be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.182 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 -- 10.20.193.174:0/4186065253 >> 10.20.193.174:0/4186065253 conn(0x7f19dc06f950 msgr2=0x7f19dc11e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:04.182 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 -- 10.20.193.174:0/4186065253 shutdown_connections 2026-02-17T11:54:04.182 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 -- 10.20.193.174:0/4186065253 wait complete. 2026-02-17T11:54:04.182 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.177+0000 7f19e2e1a640 1 librados: shutdown 2026-02-17T11:54:04.188 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 0a7bc116-9ef2-4d90-814d-a0696ce39061 6 2026-02-17T11:54:04.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient: get_monmap_and_config 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient: build_initial_monmap 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient: monmap: 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:04.252542+0000 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:04.252542+0000 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:04.256 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 1 Processor -- start 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 1 -- start start 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient: init 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient: _add_conns ranks=[4,1,3,0,2,5] 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6ce81156f0 0x7f6ce8115ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.257 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient(hunting): picked mon.noname-b con 0x7f6ce81156f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6ce811a520 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f6ce811b0a0 0x7f6ce8122620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient(hunting): picked mon.noname-a con 0x7f6ce811b0a0 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce8122c90 con 0x7f6ce811a520 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce8123e90 con 0x7f6ce811b0a0 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce8124010 con 0x7f6ce81156f0 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.251+0000 7f6cef691640 10 monclient(hunting): authenticate will time out at 918.889813s 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f6ce811b0a0 0x7f6ce8122620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.258 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f6ce811b0a0 0x7f6ce8122620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.174:41824/0 (socket says 10.20.193.174:41824) 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 1 -- 10.20.193.174:0/3103169810 learned_addr learned my addr 10.20.193.174:0/3103169810 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 10 monclient(hunting): get_auth_request con 0x7f6ce811b0a0 auth_method 0 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6cedc07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.252+0000 7f6ced406640 1 --2- 10.20.193.174:0/3103169810 >> v2:10.20.193.71:3300/0 conn(0x7f6ce81156f0 0x7f6ce8115ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6cedc07640 10 monclient(hunting): handle_auth_done global_id 4146 payload 274 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6cedc07640 1 -- 10.20.193.174:0/3103169810 >> v2:10.20.193.71:3300/0 conn(0x7f6ce81156f0 msgr2=0x7f6ce8115ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:04.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6cedc07640 1 --2- 10.20.193.174:0/3103169810 >> v2:10.20.193.71:3300/0 conn(0x7f6ce81156f0 0x7f6ce8115ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6cedc07640 1 -- 10.20.193.174:0/3103169810 >> v1:10.20.193.71:6789/0 conn(0x7f6ce811a520 legacy=0x7f6ce811a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:04.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6cedc07640 10 monclient: _finish_hunting 0 2026-02-17T11:54:04.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6cedc07640 1 monclient: found mon.noname-a 2026-02-17T11:54:04.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6cedc07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:04.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6cedc07640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:04.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6cedc07640 1 -- 10.20.193.174:0/3103169810 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce81241c0 con 0x7f6ce811b0a0 2026-02-17T11:54:04.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6ced406640 10 monclient: get_auth_request con 0x7f6ce81156f0 auth_method 0 2026-02-17T11:54:04.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.253+0000 7f6ced406640 1 --2- 10.20.193.174:0/3103169810 >> v2:10.20.193.71:3300/0 conn(0x7f6ce81156f0 0x7f6ce8115ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T11:54:04.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.254+0000 7f6cedc07640 1 --2- 10.20.193.174:0/3103169810 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6ce811b0a0 0x7f6ce8122620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ce81161c0 tx=0x7f6ce402f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6ecef801f20fa9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:04.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.255+0000 7f6cd7fff640 1 -- 10.20.193.174:0/3103169810 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce402fc20 con 0x7f6ce811b0a0 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.255+0000 7f6cd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.255+0000 7f6cd7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.255+0000 7f6cd7fff640 10 monclient: dump: 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.262 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.263 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.263 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.255+0000 7f6cd7fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:04.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.255+0000 7f6cd7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:04.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.255+0000 7f6cd7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:04.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.255+0000 7f6cef691640 5 monclient: authenticate success, global_id 4146 2026-02-17T11:54:04.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.255+0000 7f6cef691640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:04.279 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cd7fff640 1 -- 10.20.193.174:0/3103169810 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce402fdc0 con 0x7f6ce811b0a0 2026-02-17T11:54:04.279 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cd7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:04.279 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cd7fff640 1 -- 10.20.193.174:0/3103169810 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4037610 con 0x7f6ce811b0a0 2026-02-17T11:54:04.279 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.279 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cd7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:04.279 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cd7fff640 10 monclient: dump: 2026-02-17T11:54:04.279 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.279 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 4 set_mon_vals no callback set 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient: shutdown 2026-02-17T11:54:04.280 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 -- 10.20.193.174:0/3103169810 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6ce811b0a0 msgr2=0x7f6ce8122620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 --2- 10.20.193.174:0/3103169810 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6ce811b0a0 0x7f6ce8122620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ce81161c0 tx=0x7f6ce402f200 comp rx=0 tx=0).stop 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 -- 10.20.193.174:0/3103169810 shutdown_connections 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 --2- 10.20.193.174:0/3103169810 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6ce811b0a0 0x7f6ce8122620 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 --2- 10.20.193.174:0/3103169810 >> v2:10.20.193.71:3300/0 conn(0x7f6ce81156f0 0x7f6ce8115ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 -- 10.20.193.174:0/3103169810 >> 10.20.193.174:0/3103169810 conn(0x7f6ce806e030 msgr2=0x7f6ce806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 -- 10.20.193.174:0/3103169810 shutdown_connections 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 -- 10.20.193.174:0/3103169810 wait complete. 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient: build_initial_monmap 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient: monmap: 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:04.281 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:04.282 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:04.282 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:04.282 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:04.282 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.282 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:04.282 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:04.282 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:04.282 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.282 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 librados: starting msgr at 2026-02-17T11:54:04.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 librados: starting objecter 2026-02-17T11:54:04.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 Processor -- start 2026-02-17T11:54:04.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 -- start start 2026-02-17T11:54:04.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 librados: setting wanted keys 2026-02-17T11:54:04.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 librados: calling monclient init 2026-02-17T11:54:04.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient: init 2026-02-17T11:54:04.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:04.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:04.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6ce81156f0 0x7f6ce81ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient(hunting): picked mon.noname-b con 0x7f6ce81156f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:04.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6ce811a520 0x7f6ce81abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient(hunting): picked mon.noname-c con 0x7f6ce811a520 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:04.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6ce811b0a0 0x7f6ce81b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient(hunting): picked mon.noname-a con 0x7f6ce811b0a0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:04.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce81232c0 con 0x7f6ce811b0a0 2026-02-17T11:54:04.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.273+0000 7f6cef691640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce8123140 con 0x7f6ce81156f0 2026-02-17T11:54:04.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cef691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cef691640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce8123440 con 0x7f6ce811a520 2026-02-17T11:54:04.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cef691640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:04.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cef691640 10 monclient(hunting): authenticate will time out at 918.912015s 2026-02-17T11:54:04.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6ce81156f0 0x7f6ce81ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cecc05640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6ce811a520 0x7f6ce81abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6ce81156f0 0x7f6ce81ab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37118/0 (socket says 10.20.193.174:37118) 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 1 -- 10.20.193.174:0/3912098423 learned_addr learned my addr 10.20.193.174:0/3912098423 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 10 monclient(hunting): get_auth_request con 0x7f6ce81156f0 auth_method 0 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cecc05640 10 monclient(hunting): get_auth_request con 0x7f6ce811a520 auth_method 0 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cecc05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cecc05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cecc05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6ced406640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cecc05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cecc05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.274+0000 7f6cecc05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 10 monclient(hunting): handle_auth_done global_id 4156 payload 824 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 1 -- 10.20.193.174:0/3912098423 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6ce811a520 msgr2=0x7f6ce81abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 1 --2- 10.20.193.174:0/3912098423 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6ce811a520 0x7f6ce81abff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 1 -- 10.20.193.174:0/3912098423 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6ce811b0a0 msgr2=0x7f6ce81b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 1 --2- 10.20.193.174:0/3912098423 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6ce811b0a0 0x7f6ce81b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 10 monclient: _finish_hunting 0 2026-02-17T11:54:04.288 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 1 monclient: found mon.noname-b 2026-02-17T11:54:04.288 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:04.288 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.288 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.276+0000 7f6ced406640 1 -- 10.20.193.174:0/3912098423 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce81b0930 con 0x7f6ce81156f0 2026-02-17T11:54:04.289 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.277+0000 7f6ced406640 1 --2- 10.20.193.174:0/3912098423 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6ce81156f0 0x7f6ce81ab980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c7a0 tx=0x7f6cd800cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:04.289 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.277+0000 7f6cd5ffb640 10 client.?.objecter ms_handle_connect 0x7f6ce81156f0 2026-02-17T11:54:04.289 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.277+0000 7f6cd5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:04.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cd5ffb640 1 -- 10.20.193.174:0/3912098423 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8015070 con 0x7f6ce81156f0 2026-02-17T11:54:04.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cd5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:04.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cd5ffb640 10 monclient: dump: 2026-02-17T11:54:04.298 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.298 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.298 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.298 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cd5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cd5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 5 monclient: authenticate success, global_id 4156 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 10 monclient: _renew_subs 2026-02-17T11:54:04.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 1 -- 10.20.193.174:0/3912098423 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce81b0c20 con 0x7f6ce81156f0 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 10 client.4156.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 10 monclient: _renew_subs 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 1 -- 10.20.193.174:0/3912098423 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce81b83a0 con 0x7f6ce81156f0 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 1 librados: init done 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.295+0000 7f6cef691640 1 -- 10.20.193.174:0/3912098423 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce8115ad0 con 0x7f6ce81156f0 2026-02-17T11:54:04.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.296+0000 7f6cd5ffb640 1 -- 10.20.193.174:0/3912098423 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd800aac0 con 0x7f6ce81156f0 2026-02-17T11:54:04.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.296+0000 7f6cd5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:04.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.296+0000 7f6cd5ffb640 1 -- 10.20.193.174:0/3912098423 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd801f060 con 0x7f6ce81156f0 2026-02-17T11:54:04.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.296+0000 7f6cd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.296+0000 7f6cd5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.296+0000 7f6cd77fe640 4 set_mon_vals no callback set 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.296+0000 7f6cd5ffb640 10 monclient: dump: 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.302 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.341 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.339+0000 7f6cd5ffb640 1 -- 10.20.193.174:0/3912098423 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 2) ==== 49971+0+0 (secure 0 0 0) 0x7f6cd8024480 con 0x7f6ce81156f0 2026-02-17T11:54:04.342 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.340+0000 7f6cd5ffb640 1 -- 10.20.193.174:0/3912098423 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f6cd8024c10 con 0x7f6ce81156f0 2026-02-17T11:54:04.342 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.340+0000 7f6cd5ffb640 10 client.4156.objecter ms_dispatch2 0x7f6ce8000b90 osd_map(8..8 src has 1..8) 2026-02-17T11:54:04.342 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.340+0000 7f6cd5ffb640 3 client.4156.objecter handle_osd_map got epochs [8,8] > 0 2026-02-17T11:54:04.342 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.340+0000 7f6cd5ffb640 3 client.4156.objecter handle_osd_map decoding full epoch 8 2026-02-17T11:54:04.342 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.340+0000 7f6cd5ffb640 20 client.4156.objecter dump_active .. 0 homeless 2026-02-17T11:54:04.344 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.342+0000 7f6cd5ffb640 1 -- 10.20.193.174:0/3912098423 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f6cd8018c80 con 0x7f6ce81156f0 2026-02-17T11:54:04.344 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.342+0000 7f6cd5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.344 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.342+0000 7f6cd5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:04.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.374+0000 7f6cef691640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0a7bc116-9ef2-4d90-814d-a0696ce39061", "id": 6}] 2026-02-17T11:54:04.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.374+0000 7f6cef691640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0a7bc116-9ef2-4d90-814d-a0696ce39061", "id": 6}] 2026-02-17T11:54:04.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.374+0000 7f6cef691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.374+0000 7f6cef691640 1 -- 10.20.193.174:0/3912098423 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0a7bc116-9ef2-4d90-814d-a0696ce39061", "id": 6} v 0) -- 0x7f6ce811c740 con 0x7f6ce81156f0 2026-02-17T11:54:04.476 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cd5ffb640 1 -- 10.20.193.174:0/3912098423 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a7bc116-9ef2-4d90-814d-a0696ce39061", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f6cd8042200 con 0x7f6ce81156f0 2026-02-17T11:54:04.476 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cd5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0a7bc116-9ef2-4d90-814d-a0696ce39061", "id": 6}] 2026-02-17T11:54:04.477 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cd5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:04.477 INFO:teuthology.orchestra.run.trial174.stdout:6 2026-02-17T11:54:04.479 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 10 librados: watch_flush enter 2026-02-17T11:54:04.479 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 10 librados: watch_flush exit 2026-02-17T11:54:04.479 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 20 client.4156.objecter shutdown clearing up homeless session... 2026-02-17T11:54:04.479 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 10 client.4156.objecter successfully canceled tick 2026-02-17T11:54:04.479 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 10 monclient: shutdown 2026-02-17T11:54:04.479 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:04.479 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 1 -- 10.20.193.174:0/3912098423 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6ce81156f0 msgr2=0x7f6ce81ab980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.479 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 1 --2- 10.20.193.174:0/3912098423 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6ce81156f0 0x7f6ce81ab980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c7a0 tx=0x7f6cd800cc70 comp rx=0 tx=0).stop 2026-02-17T11:54:04.479 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 1 -- 10.20.193.174:0/3912098423 shutdown_connections 2026-02-17T11:54:04.480 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 1 --2- 10.20.193.174:0/3912098423 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6ce811b0a0 0x7f6ce81b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.480 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 1 --2- 10.20.193.174:0/3912098423 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6ce811a520 0x7f6ce81abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.480 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 1 --2- 10.20.193.174:0/3912098423 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6ce81156f0 0x7f6ce81ab980 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.480 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 1 -- 10.20.193.174:0/3912098423 >> 10.20.193.174:0/3912098423 conn(0x7f6ce806e030 msgr2=0x7f6ce8114350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:04.480 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.474+0000 7f6cef691640 1 -- 10.20.193.174:0/3912098423 shutdown_connections 2026-02-17T11:54:04.480 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.475+0000 7f6cef691640 1 -- 10.20.193.174:0/3912098423 wait complete. 2026-02-17T11:54:04.480 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.475+0000 7f6cef691640 1 librados: shutdown 2026-02-17T11:54:04.485 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 9e17de9b-371b-4026-bc9b-4e78fec69fcf 7 2026-02-17T11:54:04.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient: get_monmap_and_config 2026-02-17T11:54:04.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient: build_initial_monmap 2026-02-17T11:54:04.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient: monmap: 2026-02-17T11:54:04.550 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:04.549442+0000 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:04.549442+0000 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:04.551 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.562 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 1 Processor -- start 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 1 -- start start 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient: init 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient: _add_conns ranks=[5,4,3,2,0,1] 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f9c301156f0 0x7f9c30115ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient(hunting): picked mon.noname-c con 0x7f9c301156f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9c3011a520 0x7f9c3011a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient(hunting): picked mon.noname-b con 0x7f9c3011a520 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f9c3011aed0 0x7f9c30121610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.563 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient(hunting): picked mon.noname-a con 0x7f9c3011aed0 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f9c30121b50 con 0x7f9c3011aed0 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9c30121cd0 con 0x7f9c3011a520 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9c30121e50 con 0x7f9c301156f0 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.548+0000 7f9c38805640 10 monclient(hunting): authenticate will time out at 919.186754s 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c3657a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f9c301156f0 0x7f9c30115ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9c3011a520 0x7f9c3011a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9c3011a520 0x7f9c3011a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37132/0 (socket says 10.20.193.174:37132) 2026-02-17T11:54:04.564 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 1 -- 10.20.193.174:0/3650472262 learned_addr learned my addr 10.20.193.174:0/3650472262 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 10 monclient(hunting): get_auth_request con 0x7f9c3011a520 auth_method 0 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c3657a640 10 monclient(hunting): get_auth_request con 0x7f9c301156f0 auth_method 0 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c3657a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c3657a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c3657a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c3657a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c3657a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c3657a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.549+0000 7f9c35d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 10 monclient(hunting): handle_auth_done global_id 4159 payload 274 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 1 -- 10.20.193.174:0/3650472262 >> v2:10.20.193.153:3300/0 conn(0x7f9c301156f0 msgr2=0x7f9c30115ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 1 --2- 10.20.193.174:0/3650472262 >> v2:10.20.193.153:3300/0 conn(0x7f9c301156f0 0x7f9c30115ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 1 -- 10.20.193.174:0/3650472262 >> v2:10.20.193.10:3300/0 conn(0x7f9c3011aed0 msgr2=0x7f9c30121610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 1 --2- 10.20.193.174:0/3650472262 >> v2:10.20.193.10:3300/0 conn(0x7f9c3011aed0 0x7f9c30121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 10 monclient: _finish_hunting 0 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 1 monclient: found mon.noname-b 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.550+0000 7f9c35d79640 1 -- 10.20.193.174:0/3650472262 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c30121fd0 con 0x7f9c3011a520 2026-02-17T11:54:04.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.551+0000 7f9c35d79640 1 --2- 10.20.193.174:0/3650472262 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c3011a520 0x7f9c3011a990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c301160d0 tx=0x7f9c1c02edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da094657c5b0cd94 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 1 -- 10.20.193.174:0/3650472262 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c03c070 con 0x7f9c3011a520 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 10 monclient: dump: 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.567 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 10 monclient: _finish_auth 0 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 10 monclient: _check_auth_tickets 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 5 monclient: authenticate success, global_id 4159 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 1 -- 10.20.193.174:0/3650472262 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c02fab0 con 0x7f9c3011a520 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 4 set_mon_vals no callback set 2026-02-17T11:54:04.568 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 1 -- 10.20.193.174:0/3650472262 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c037440 con 0x7f9c3011a520 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c35578640 10 monclient: dump: 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.569 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 10 monclient: shutdown 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 1 -- 10.20.193.174:0/3650472262 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c3011a520 msgr2=0x7f9c3011a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 1 --2- 10.20.193.174:0/3650472262 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c3011a520 0x7f9c3011a990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c301160d0 tx=0x7f9c1c02edf0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 1 -- 10.20.193.174:0/3650472262 shutdown_connections 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 1 --2- 10.20.193.174:0/3650472262 >> v2:10.20.193.10:3300/0 conn(0x7f9c3011aed0 0x7f9c30121610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 1 --2- 10.20.193.174:0/3650472262 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c3011a520 0x7f9c3011a990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 1 --2- 10.20.193.174:0/3650472262 >> v2:10.20.193.153:3300/0 conn(0x7f9c301156f0 0x7f9c30115ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 1 -- 10.20.193.174:0/3650472262 >> 10.20.193.174:0/3650472262 conn(0x7f9c3006e030 msgr2=0x7f9c3006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 1 -- 10.20.193.174:0/3650472262 shutdown_connections 2026-02-17T11:54:04.570 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.553+0000 7f9c38805640 1 -- 10.20.193.174:0/3650472262 wait complete. 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient: build_initial_monmap 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient: monmap: 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.571 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 librados: starting msgr at 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 librados: starting objecter 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 Processor -- start 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 -- start start 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 librados: setting wanted keys 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 librados: calling monclient init 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient: init 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c301156f0 0x7f9c301b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient(hunting): picked mon.noname-b con 0x7f9c301156f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9c3011a520 0x7f9c301b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient(hunting): picked mon.noname-a con 0x7f9c3011a520 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9c3011aed0 0x7f9c301ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient(hunting): picked mon.noname-c con 0x7f9c3011aed0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301226e0 con 0x7f9c3011a520 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30122560 con 0x7f9c301156f0 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30122860 con 0x7f9c3011aed0 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c38805640 10 monclient(hunting): authenticate will time out at 919.192554s 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c3657a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c301156f0 0x7f9c301b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.573 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c35d79640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9c3011a520 0x7f9c301b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.554+0000 7f9c36d7b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9c3011aed0 0x7f9c301ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c3657a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c301156f0 0x7f9c301b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37144/0 (socket says 10.20.193.174:37144) 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c3657a640 1 -- 10.20.193.174:0/769791111 learned_addr learned my addr 10.20.193.174:0/769791111 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c3657a640 10 monclient(hunting): get_auth_request con 0x7f9c301156f0 auth_method 0 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c3657a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c3657a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c3657a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c35d79640 10 monclient(hunting): get_auth_request con 0x7f9c3011a520 auth_method 0 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c35d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c35d79640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c35d79640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c36d7b640 10 monclient(hunting): get_auth_request con 0x7f9c3011aed0 auth_method 0 2026-02-17T11:54:04.574 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c36d7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c36d7b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c36d7b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c3657a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c3657a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c3657a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c35d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c35d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c35d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c36d7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c36d7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.555+0000 7f9c36d7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 10 monclient(hunting): handle_auth_done global_id 4162 payload 824 2026-02-17T11:54:04.575 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 1 -- 10.20.193.174:0/769791111 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9c3011aed0 msgr2=0x7f9c301ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 1 --2- 10.20.193.174:0/769791111 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9c3011aed0 0x7f9c301ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 1 -- 10.20.193.174:0/769791111 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9c3011a520 msgr2=0x7f9c301b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 1 --2- 10.20.193.174:0/769791111 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9c3011a520 0x7f9c301b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 10 monclient: _finish_hunting 0 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 1 monclient: found mon.noname-b 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.556+0000 7f9c3657a640 1 -- 10.20.193.174:0/769791111 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c301abdb0 con 0x7f9c301156f0 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.557+0000 7f9c3657a640 1 --2- 10.20.193.174:0/769791111 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c301156f0 0x7f9c301b1440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800ebe0 tx=0x7f9c2800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.557+0000 7f9c1affd640 10 client.?.objecter ms_handle_connect 0x7f9c301156f0 2026-02-17T11:54:04.576 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.557+0000 7f9c1affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c1affd640 1 -- 10.20.193.174:0/769791111 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28017070 con 0x7f9c301156f0 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c1affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c1affd640 10 monclient: dump: 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.577 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c1affd640 10 monclient: _finish_auth 0 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c1affd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 5 monclient: authenticate success, global_id 4162 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 10 monclient: _renew_subs 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 1 -- 10.20.193.174:0/769791111 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c301ac040 con 0x7f9c301156f0 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 10 client.4162.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 10 monclient: _renew_subs 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 1 -- 10.20.193.174:0/769791111 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c301b83d0 con 0x7f9c301156f0 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 1 librados: init done 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.558+0000 7f9c38805640 1 -- 10.20.193.174:0/769791111 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c30115ad0 con 0x7f9c301156f0 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.559+0000 7f9c1affd640 1 -- 10.20.193.174:0/769791111 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2800cc40 con 0x7f9c301156f0 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.559+0000 7f9c1affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.559+0000 7f9c1affd640 1 -- 10.20.193.174:0/769791111 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28021060 con 0x7f9c301156f0 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.559+0000 7f9c1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.559+0000 7f9c1affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.559+0000 7f9c34d77640 4 set_mon_vals no callback set 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.559+0000 7f9c1affd640 10 monclient: dump: 2026-02-17T11:54:04.579 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.580 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.580 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.580 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.580 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.580 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.580 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.580 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.580 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.580 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.605 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.602+0000 7f9c1affd640 1 -- 10.20.193.174:0/769791111 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 2) ==== 49971+0+0 (secure 0 0 0) 0x7f9c28024060 con 0x7f9c301156f0 2026-02-17T11:54:04.605 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.603+0000 7f9c1affd640 1 -- 10.20.193.174:0/769791111 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f9c28013db0 con 0x7f9c301156f0 2026-02-17T11:54:04.605 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.603+0000 7f9c1affd640 10 client.4162.objecter ms_dispatch2 0x7f9c30000b90 osd_map(9..9 src has 1..9) 2026-02-17T11:54:04.605 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.603+0000 7f9c1affd640 3 client.4162.objecter handle_osd_map got epochs [9,9] > 0 2026-02-17T11:54:04.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.603+0000 7f9c1affd640 3 client.4162.objecter handle_osd_map decoding full epoch 9 2026-02-17T11:54:04.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.603+0000 7f9c1affd640 20 client.4162.objecter dump_active .. 0 homeless 2026-02-17T11:54:04.607 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.605+0000 7f9c1affd640 1 -- 10.20.193.174:0/769791111 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f9c28013650 con 0x7f9c301156f0 2026-02-17T11:54:04.607 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.605+0000 7f9c1affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.607 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.605+0000 7f9c1affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:04.639 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.637+0000 7f9c38805640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9e17de9b-371b-4026-bc9b-4e78fec69fcf", "id": 7}] 2026-02-17T11:54:04.640 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.637+0000 7f9c38805640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9e17de9b-371b-4026-bc9b-4e78fec69fcf", "id": 7}] 2026-02-17T11:54:04.640 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.637+0000 7f9c38805640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.640 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.637+0000 7f9c38805640 1 -- 10.20.193.174:0/769791111 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9e17de9b-371b-4026-bc9b-4e78fec69fcf", "id": 7} v 0) -- 0x7f9c3011c720 con 0x7f9c301156f0 2026-02-17T11:54:04.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c1affd640 1 -- 10.20.193.174:0/769791111 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e17de9b-371b-4026-bc9b-4e78fec69fcf", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f9c280253d0 con 0x7f9c301156f0 2026-02-17T11:54:04.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c1affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9e17de9b-371b-4026-bc9b-4e78fec69fcf", "id": 7}] 2026-02-17T11:54:04.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c1affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:04.698 INFO:teuthology.orchestra.run.trial174.stdout:7 2026-02-17T11:54:04.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 10 librados: watch_flush enter 2026-02-17T11:54:04.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 10 librados: watch_flush exit 2026-02-17T11:54:04.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 20 client.4162.objecter shutdown clearing up homeless session... 2026-02-17T11:54:04.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 10 client.4162.objecter successfully canceled tick 2026-02-17T11:54:04.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 10 monclient: shutdown 2026-02-17T11:54:04.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 -- 10.20.193.174:0/769791111 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c301156f0 msgr2=0x7f9c301b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 --2- 10.20.193.174:0/769791111 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c301156f0 0x7f9c301b1440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800ebe0 tx=0x7f9c2800c520 comp rx=0 tx=0).stop 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 -- 10.20.193.174:0/769791111 shutdown_connections 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 --2- 10.20.193.174:0/769791111 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9c3011aed0 0x7f9c301ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 --2- 10.20.193.174:0/769791111 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9c3011a520 0x7f9c301b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 --2- 10.20.193.174:0/769791111 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9c301156f0 0x7f9c301b1440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 -- 10.20.193.174:0/769791111 >> 10.20.193.174:0/769791111 conn(0x7f9c3006e030 msgr2=0x7f9c30119320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 -- 10.20.193.174:0/769791111 shutdown_connections 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 -- 10.20.193.174:0/769791111 wait complete. 2026-02-17T11:54:04.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.695+0000 7f9c38805640 1 librados: shutdown 2026-02-17T11:54:04.706 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 14df3312-ffe0-4f33-a7ba-99e0d5be5c4b 8 2026-02-17T11:54:04.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.767+0000 7fcc88d6a640 10 monclient: get_monmap_and_config 2026-02-17T11:54:04.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.767+0000 7fcc88d6a640 10 monclient: build_initial_monmap 2026-02-17T11:54:04.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.767+0000 7fcc88d6a640 10 monclient: monmap: 2026-02-17T11:54:04.771 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:04.769231+0000 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:04.769231+0000 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:04.772 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 1 Processor -- start 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 1 -- start start 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient: init 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient: _add_conns ranks=[5,0,3,4,2,1] 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcc84112930 0x7fcc84112d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient(hunting): picked mon.noname-c con 0x7fcc84112930 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcc84117200 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fcc84117d60 0x7fcc841203a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient(hunting): picked mon.noname-a con 0x7fcc84117d60 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:04.773 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc84120970 con 0x7fcc84117200 2026-02-17T11:54:04.774 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.774 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fcc84121b90 con 0x7fcc84117d60 2026-02-17T11:54:04.774 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.774 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcc84121d10 con 0x7fcc84112930 2026-02-17T11:54:04.774 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:04.774 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.768+0000 7fcc88d6a640 10 monclient(hunting): authenticate will time out at 919.406480s 2026-02-17T11:54:04.783 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.781+0000 7fcc82575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcc84112930 0x7fcc84112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.783 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.781+0000 7fcc82575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcc84112930 0x7fcc84112d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.174:57642/0 (socket says 10.20.193.174:57642) 2026-02-17T11:54:04.783 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.781+0000 7fcc82575640 1 -- 10.20.193.174:0/3324676474 learned_addr learned my addr 10.20.193.174:0/3324676474 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:04.783 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.781+0000 7fcc82575640 10 monclient(hunting): get_auth_request con 0x7fcc84112930 auth_method 0 2026-02-17T11:54:04.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.781+0000 7fcc82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.781+0000 7fcc82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.784 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.781+0000 7fcc82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.824 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.822+0000 7fcc82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.824 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.822+0000 7fcc82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.824 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.822+0000 7fcc82575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.840 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.839+0000 7fcc82d76640 1 --2- 10.20.193.174:0/3324676474 >> v2:10.20.193.10:3300/0 conn(0x7fcc84117d60 0x7fcc841203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.843 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.841+0000 7fcc82575640 10 monclient(hunting): handle_auth_done global_id 4163 payload 274 2026-02-17T11:54:04.843 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.841+0000 7fcc82575640 1 -- 10.20.193.174:0/3324676474 >> v2:10.20.193.10:3300/0 conn(0x7fcc84117d60 msgr2=0x7fcc841203a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:04.844 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.841+0000 7fcc82575640 1 --2- 10.20.193.174:0/3324676474 >> v2:10.20.193.10:3300/0 conn(0x7fcc84117d60 0x7fcc841203a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.844 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.841+0000 7fcc82575640 1 -- 10.20.193.174:0/3324676474 >> v1:10.20.193.10:6789/0 conn(0x7fcc84117200 legacy=0x7fcc84117650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:04.844 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.841+0000 7fcc82575640 10 monclient: _finish_hunting 0 2026-02-17T11:54:04.844 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.841+0000 7fcc82575640 1 monclient: found mon.noname-c 2026-02-17T11:54:04.844 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.841+0000 7fcc82575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:04.844 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.841+0000 7fcc82575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:04.844 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.841+0000 7fcc82575640 1 -- 10.20.193.174:0/3324676474 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc84121ec0 con 0x7fcc84112930 2026-02-17T11:54:04.845 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.842+0000 7fcc82575640 1 --2- 10.20.193.174:0/3324676474 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc84112930 0x7fcc84112d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcc84113530 tx=0x7fcc7802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e621bf8bcc1034 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:04.864 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 1 -- 10.20.193.174:0/3324676474 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7803c070 con 0x7fcc84112930 2026-02-17T11:54:04.864 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.864 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:04.864 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 10 monclient: dump: 2026-02-17T11:54:04.864 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.864 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.864 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.864 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 10 monclient: _finish_auth 0 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 10 monclient: _check_auth_tickets 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 1 -- 10.20.193.174:0/3324676474 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc7802fa90 con 0x7fcc84112930 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:04.865 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 1 -- 10.20.193.174:0/3324676474 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7802fe60 con 0x7fcc84112930 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc81573640 10 monclient: dump: 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.866 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 5 monclient: authenticate success, global_id 4163 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 4 set_mon_vals no callback set 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 10 monclient: shutdown 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 1 -- 10.20.193.174:0/3324676474 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc84112930 msgr2=0x7fcc84112d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 1 --2- 10.20.193.174:0/3324676474 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc84112930 0x7fcc84112d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcc84113530 tx=0x7fcc7802ee60 comp rx=0 tx=0).stop 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 1 -- 10.20.193.174:0/3324676474 shutdown_connections 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 1 --2- 10.20.193.174:0/3324676474 >> v2:10.20.193.10:3300/0 conn(0x7fcc84117d60 0x7fcc841203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 1 --2- 10.20.193.174:0/3324676474 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc84112930 0x7fcc84112d10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.867 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 1 -- 10.20.193.174:0/3324676474 >> 10.20.193.174:0/3324676474 conn(0x7fcc84071660 msgr2=0x7fcc84073a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.858+0000 7fcc88d6a640 1 -- 10.20.193.174:0/3324676474 shutdown_connections 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 -- 10.20.193.174:0/3324676474 wait complete. 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient: build_initial_monmap 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient: monmap: 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:04.868 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 librados: starting msgr at 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 librados: starting objecter 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 Processor -- start 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 -- start start 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 librados: setting wanted keys 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 librados: calling monclient init 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient: init 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:54:04.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc84112930 0x7fcc841af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient(hunting): picked mon.noname-c con 0x7fcc84112930 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcc84117200 0x7fcc841af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient(hunting): picked mon.noname-a con 0x7fcc84117200 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcc84117d60 0x7fcc841a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient(hunting): picked mon.noname-b con 0x7fcc84117d60 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84121000 con 0x7fcc84117200 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84120e80 con 0x7fcc84117d60 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84121180 con 0x7fcc84112930 2026-02-17T11:54:04.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.859+0000 7fcc88d6a640 10 monclient(hunting): authenticate will time out at 919.497836s 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.861+0000 7fcc82d76640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcc84117d60 0x7fcc841a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.861+0000 7fcc82d76640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcc84117d60 0x7fcc841a9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37160/0 (socket says 10.20.193.174:37160) 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.861+0000 7fcc82d76640 1 -- 10.20.193.174:0/2713889225 learned_addr learned my addr 10.20.193.174:0/2713889225 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.861+0000 7fcc82d76640 10 monclient(hunting): get_auth_request con 0x7fcc84117d60 auth_method 0 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.861+0000 7fcc82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.861+0000 7fcc82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.861+0000 7fcc82d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.862+0000 7fcc82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.862+0000 7fcc82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:04.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.862+0000 7fcc82d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:04.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 10 monclient(hunting): handle_auth_done global_id 4165 payload 824 2026-02-17T11:54:04.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 1 -- 10.20.193.174:0/2713889225 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc84112930 msgr2=0x7fcc841af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc84112930 0x7fcc841af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 1 -- 10.20.193.174:0/2713889225 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcc84117200 msgr2=0x7fcc841af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:04.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcc84117200 0x7fcc841af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:04.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 10 monclient: _finish_hunting 0 2026-02-17T11:54:04.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 1 monclient: found mon.noname-b 2026-02-17T11:54:04.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:04.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.874 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.867+0000 7fcc82d76640 1 -- 10.20.193.174:0/2713889225 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc841a9c30 con 0x7fcc84117d60 2026-02-17T11:54:04.886 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:04.884+0000 7f3914be7640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T11:54:04.887 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.885+0000 7fcc82d76640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcc84117d60 0x7fcc841a9370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400cd70 tx=0x7fcc7400a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:04.887 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.885+0000 7fcc6affd640 10 client.?.objecter ms_handle_connect 0x7fcc84117d60 2026-02-17T11:54:04.887 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.885+0000 7fcc6affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:04.889 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T11:54:04.887+0000 7f3914be7640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T11:54:04.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 1 -- 10.20.193.174:0/2713889225 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74003c90 con 0x7fcc84117d60 2026-02-17T11:54:04.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:04.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 10 monclient: dump: 2026-02-17T11:54:04.891 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.891 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 10 monclient: _finish_auth 0 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:04.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 1 -- 10.20.193.174:0/2713889225 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc74003e30 con 0x7fcc84117d60 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 5 monclient: authenticate success, global_id 4165 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 10 monclient: _renew_subs 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc841a9ec0 con 0x7fcc84117d60 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 1 -- 10.20.193.174:0/2713889225 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74004220 con 0x7fcc84117d60 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc6affd640 10 monclient: dump: 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:04.893 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc80d72640 4 set_mon_vals no callback set 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 10 client.4165.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 10 monclient: _renew_subs 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc841b6250 con 0x7fcc84117d60 2026-02-17T11:54:04.894 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 1 librados: init done 2026-02-17T11:54:04.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:04.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:04.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.888+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc84112d10 con 0x7fcc84117d60 2026-02-17T11:54:04.900 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.898+0000 7fcc6affd640 1 -- 10.20.193.174:0/2713889225 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 3) ==== 99739+0+0 (secure 0 0 0) 0x7fcc740043c0 con 0x7fcc84117d60 2026-02-17T11:54:04.901 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc6affd640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcc50078ca0 0x7fcc5007b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:04.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc82575640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcc50078ca0 0x7fcc5007b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:04.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc82575640 10 monclient: get_auth_request con 0x7fcc50078ca0 auth_method 0 2026-02-17T11:54:04.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc6affd640 1 -- 10.20.193.174:0/2713889225 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fcc7405e8c0 con 0x7fcc84117d60 2026-02-17T11:54:04.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc6affd640 10 client.4165.objecter ms_dispatch2 0x7fcc84000b90 osd_map(10..10 src has 1..10) 2026-02-17T11:54:04.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc6affd640 3 client.4165.objecter handle_osd_map got epochs [10,10] > 0 2026-02-17T11:54:04.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc6affd640 3 client.4165.objecter handle_osd_map decoding full epoch 10 2026-02-17T11:54:04.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc6affd640 20 client.4165.objecter dump_active .. 0 homeless 2026-02-17T11:54:04.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc6affd640 10 client.4165.objecter ms_handle_connect 0x7fcc50078ca0 2026-02-17T11:54:04.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.899+0000 7fcc82575640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcc50078ca0 0x7fcc5007b160 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcc841125f0 tx=0x7fcc78031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.000 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.998+0000 7fcc6affd640 1 -- 10.20.193.174:0/2713889225 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcc74062f80 con 0x7fcc84117d60 2026-02-17T11:54:05.000 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.998+0000 7fcc6affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.001 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:04.998+0000 7fcc6affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:05.088 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.085+0000 7fcc88d6a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "14df3312-ffe0-4f33-a7ba-99e0d5be5c4b", "id": 8}] 2026-02-17T11:54:05.089 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.085+0000 7fcc88d6a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "14df3312-ffe0-4f33-a7ba-99e0d5be5c4b", "id": 8}] 2026-02-17T11:54:05.089 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.085+0000 7fcc88d6a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:05.089 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.085+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "14df3312-ffe0-4f33-a7ba-99e0d5be5c4b", "id": 8} v 0) -- 0x7fcc8411aab0 con 0x7fcc84117d60 2026-02-17T11:54:05.135 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc6affd640 1 -- 10.20.193.174:0/2713889225 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14df3312-ffe0-4f33-a7ba-99e0d5be5c4b", "id": 8}]=0 v11) ==== 112+0+2 (secure 0 0 0) 0x7fcc8411aab0 con 0x7fcc84117d60 2026-02-17T11:54:05.136 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc6affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "14df3312-ffe0-4f33-a7ba-99e0d5be5c4b", "id": 8}] 2026-02-17T11:54:05.136 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc6affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:05.136 INFO:teuthology.orchestra.run.trial174.stdout:8 2026-02-17T11:54:05.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 10 librados: watch_flush enter 2026-02-17T11:54:05.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 10 librados: watch_flush exit 2026-02-17T11:54:05.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 20 client.4165.objecter shutdown clearing up homeless session... 2026-02-17T11:54:05.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 10 client.4165.objecter successfully canceled tick 2026-02-17T11:54:05.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcc50078ca0 msgr2=0x7fcc5007b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcc50078ca0 0x7fcc5007b160 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcc841125f0 tx=0x7fcc78031000 comp rx=0 tx=0).stop 2026-02-17T11:54:05.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 10 monclient: shutdown 2026-02-17T11:54:05.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:05.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcc84117d60 msgr2=0x7fcc841a9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcc84117d60 0x7fcc841a9370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400cd70 tx=0x7fcc7400a660 comp rx=0 tx=0).stop 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 shutdown_connections 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcc50078ca0 0x7fcc5007b160 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcc84117d60 0x7fcc841a9370 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcc84117200 0x7fcc841af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 --2- 10.20.193.174:0/2713889225 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc84112930 0x7fcc841af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 >> 10.20.193.174:0/2713889225 conn(0x7fcc84071660 msgr2=0x7fcc84118210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 shutdown_connections 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 -- 10.20.193.174:0/2713889225 wait complete. 2026-02-17T11:54:05.139 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.134+0000 7fcc88d6a640 1 librados: shutdown 2026-02-17T11:54:05.144 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 560b59a5-3dbd-4d78-9e91-9901e6279b0d 9 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.206+0000 7f882c35e640 10 monclient: get_monmap_and_config 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.206+0000 7f882c35e640 10 monclient: build_initial_monmap 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.206+0000 7f882c35e640 10 monclient: monmap: 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:05.207769+0000 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:05.207769+0000 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:05.208 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:05.209 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:05.209 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:05.209 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.206+0000 7f882c35e640 1 Processor -- start 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.206+0000 7f882c35e640 1 -- start start 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.206+0000 7f882c35e640 10 monclient: init 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 10 monclient: _add_conns ranks=[5,1,3,0,4,2] 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f88241156f0 0x7f8824115ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 10 monclient(hunting): picked mon.noname-c con 0x7f88241156f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f882411a520 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f882411b0a0 0x7f8824122620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 10 monclient(hunting): picked mon.noname-a con 0x7f882411b0a0 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8824122c90 con 0x7f882411a520 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f8824123e90 con 0x7f882411b0a0 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8824124010 con 0x7f88241156f0 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882c35e640 10 monclient(hunting): authenticate will time out at 919.845115s 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a0d3640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f88241156f0 0x7f8824115ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a8d4640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f882411b0a0 0x7f8824122620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f88298d2640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f882411a520 0x7f882411a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.174:43100/0 (socket says 10.20.193.174:43100) 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f88298d2640 1 -- 10.20.193.174:0/2409197329 learned_addr learned my addr 10.20.193.174:0/2409197329 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a8d4640 10 monclient(hunting): get_auth_request con 0x7f882411b0a0 auth_method 0 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a8d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a8d4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a8d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a0d3640 10 monclient(hunting): get_auth_request con 0x7f88241156f0 auth_method 0 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a0d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a0d3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.207+0000 7f882a0d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.208+0000 7f882a8d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.208+0000 7f882a8d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.208+0000 7f882a8d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.208+0000 7f882a0d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.208+0000 7f882a0d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.208+0000 7f882a0d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 10 monclient(hunting): handle_auth_done global_id 4152 payload 274 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 1 -- 10.20.193.174:0/2409197329 >> v2:10.20.193.153:3300/0 conn(0x7f88241156f0 msgr2=0x7f8824115ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 1 --2- 10.20.193.174:0/2409197329 >> v2:10.20.193.153:3300/0 conn(0x7f88241156f0 0x7f8824115ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 1 -- 10.20.193.174:0/2409197329 >> v1:10.20.193.71:6789/0 conn(0x7f882411a520 legacy=0x7f882411a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 10 monclient: _finish_hunting 0 2026-02-17T11:54:05.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 1 monclient: found mon.noname-a 2026-02-17T11:54:05.212 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:05.212 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.212 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 1 -- 10.20.193.174:0/2409197329 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88241241c0 con 0x7f882411b0a0 2026-02-17T11:54:05.212 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.209+0000 7f882a8d4640 1 --2- 10.20.193.174:0/2409197329 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f882411b0a0 0x7f8824122620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f882406bd60 tx=0x7f882002f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7df1a60b0ffbac7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.213 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 1 -- 10.20.193.174:0/2409197329 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882003c070 con 0x7f882411b0a0 2026-02-17T11:54:05.213 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 10 monclient: dump: 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 10 monclient: _finish_auth 0 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 10 monclient: _check_auth_tickets 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 1 -- 10.20.193.174:0/2409197329 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882002fe40 con 0x7f882411b0a0 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 1 -- 10.20.193.174:0/2409197329 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820037660 con 0x7f882411b0a0 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f88290d1640 10 monclient: dump: 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.215 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.215 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.215 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f882c35e640 5 monclient: authenticate success, global_id 4152 2026-02-17T11:54:05.215 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f882c35e640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:05.215 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.211+0000 7f882c35e640 4 set_mon_vals no callback set 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient: shutdown 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 -- 10.20.193.174:0/2409197329 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f882411b0a0 msgr2=0x7f8824122620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 --2- 10.20.193.174:0/2409197329 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f882411b0a0 0x7f8824122620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f882406bd60 tx=0x7f882002f130 comp rx=0 tx=0).stop 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 -- 10.20.193.174:0/2409197329 shutdown_connections 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 --2- 10.20.193.174:0/2409197329 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f882411b0a0 0x7f8824122620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 --2- 10.20.193.174:0/2409197329 >> v2:10.20.193.153:3300/0 conn(0x7f88241156f0 0x7f8824115ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 -- 10.20.193.174:0/2409197329 >> 10.20.193.174:0/2409197329 conn(0x7f882406e030 msgr2=0x7f882406e440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 -- 10.20.193.174:0/2409197329 shutdown_connections 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 -- 10.20.193.174:0/2409197329 wait complete. 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient: build_initial_monmap 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient: monmap: 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 librados: starting msgr at 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 librados: starting objecter 2026-02-17T11:54:05.217 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 Processor -- start 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 -- start start 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 librados: setting wanted keys 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 librados: calling monclient init 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient: init 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f88241156f0 0x7f88241aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient(hunting): picked mon.noname-a con 0x7f88241156f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f882411a520 0x7f88241abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient(hunting): picked mon.noname-b con 0x7f882411a520 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f882411b0a0 0x7f88241b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient(hunting): picked mon.noname-c con 0x7f882411b0a0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f8824123320 con 0x7f88241156f0 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f88241231a0 con 0x7f882411a520 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88241234a0 con 0x7f882411b0a0 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.212+0000 7f882c35e640 10 monclient(hunting): authenticate will time out at 919.850889s 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f88241156f0 0x7f88241aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f88298d2640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f882411a520 0x7f88241abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f88241156f0 0x7f88241aba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.174:41886/0 (socket says 10.20.193.174:41886) 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 1 -- 10.20.193.174:0/1596960114 learned_addr learned my addr 10.20.193.174:0/1596960114 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 10 monclient(hunting): get_auth_request con 0x7f88241156f0 auth_method 0 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a8d4640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f882411b0a0 0x7f88241b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f88298d2640 10 monclient(hunting): get_auth_request con 0x7f882411a520 auth_method 0 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f88298d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.218 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f88298d2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f88298d2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a8d4640 10 monclient(hunting): get_auth_request con 0x7f882411b0a0 auth_method 0 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a8d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a8d4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a8d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a0d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f88298d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f88298d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f88298d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a8d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a8d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.213+0000 7f882a8d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 10 monclient(hunting): handle_auth_done global_id 4155 payload 824 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 1 -- 10.20.193.174:0/1596960114 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f882411b0a0 msgr2=0x7f88241b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f882411b0a0 0x7f88241b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 1 -- 10.20.193.174:0/1596960114 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f882411a520 msgr2=0x7f88241abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f882411a520 0x7f88241abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 10 monclient: _finish_hunting 0 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 1 monclient: found mon.noname-a 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.219 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.214+0000 7f882a0d3640 1 -- 10.20.193.174:0/1596960114 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88241b0a00 con 0x7f88241156f0 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.216+0000 7f882a0d3640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f88241156f0 0x7f88241aba40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f881400ebe0 tx=0x7f881400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.216+0000 7f880affd640 10 client.?.objecter ms_handle_connect 0x7f88241156f0 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.216+0000 7f880affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 1 -- 10.20.193.174:0/1596960114 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814017070 con 0x7f88241156f0 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 10 monclient: dump: 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.220 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 10 monclient: _finish_auth 0 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 1 -- 10.20.193.174:0/1596960114 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881400cc40 con 0x7f88241156f0 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f882c35e640 5 monclient: authenticate success, global_id 4155 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f882c35e640 10 monclient: _renew_subs 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f882c35e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88241b0cf0 con 0x7f88241156f0 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 1 -- 10.20.193.174:0/1596960114 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814013470 con 0x7f88241156f0 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f880affd640 10 monclient: dump: 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f88288d0640 4 set_mon_vals no callback set 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f882c35e640 10 client.4155.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f882c35e640 10 monclient: _renew_subs 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f882c35e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88241b8580 con 0x7f88241156f0 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.217+0000 7f882c35e640 1 librados: init done 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.218+0000 7f882c35e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.218+0000 7f882c35e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.218+0000 7f882c35e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.221 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.218+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8824115ad0 con 0x7f88241156f0 2026-02-17T11:54:05.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.233+0000 7f880affd640 1 -- 10.20.193.174:0/1596960114 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 3) ==== 99739+0+0 (secure 0 0 0) 0x7f8814024060 con 0x7f88241156f0 2026-02-17T11:54:05.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.234+0000 7f880affd640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f87f4078ca0 0x7f87f407b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.234+0000 7f88298d2640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f87f4078ca0 0x7f87f407b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.234+0000 7f88298d2640 10 monclient: get_auth_request con 0x7f87f4078ca0 auth_method 0 2026-02-17T11:54:05.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.234+0000 7f880affd640 1 -- 10.20.193.174:0/1596960114 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1760+0+0 (secure 0 0 0) 0x7f881405e170 con 0x7f88241156f0 2026-02-17T11:54:05.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.234+0000 7f880affd640 10 client.4155.objecter ms_dispatch2 0x7f8824000b90 osd_map(11..11 src has 1..11) 2026-02-17T11:54:05.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.234+0000 7f880affd640 3 client.4155.objecter handle_osd_map got epochs [11,11] > 0 2026-02-17T11:54:05.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.234+0000 7f880affd640 3 client.4155.objecter handle_osd_map decoding full epoch 11 2026-02-17T11:54:05.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.234+0000 7f880affd640 20 client.4155.objecter dump_active .. 0 homeless 2026-02-17T11:54:05.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.235+0000 7f880affd640 10 client.4155.objecter ms_handle_connect 0x7f87f4078ca0 2026-02-17T11:54:05.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.235+0000 7f88298d2640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f87f4078ca0 0x7f87f407b160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88241ab7a0 tx=0x7f8818002930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.343 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.341+0000 7f880affd640 1 -- 10.20.193.174:0/1596960114 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8814062130 con 0x7f88241156f0 2026-02-17T11:54:05.343 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.341+0000 7f880affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.343 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.341+0000 7f880affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:05.433 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.430+0000 7f882c35e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "560b59a5-3dbd-4d78-9e91-9901e6279b0d", "id": 9}] 2026-02-17T11:54:05.433 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.430+0000 7f882c35e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "560b59a5-3dbd-4d78-9e91-9901e6279b0d", "id": 9}] 2026-02-17T11:54:05.433 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.430+0000 7f882c35e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.433 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.430+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd new", "uuid": "560b59a5-3dbd-4d78-9e91-9901e6279b0d", "id": 9} v 0) -- 0x7f882411c740 con 0x7f88241156f0 2026-02-17T11:54:05.464 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.462+0000 7f880affd640 1 -- 10.20.193.174:0/1596960114 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "560b59a5-3dbd-4d78-9e91-9901e6279b0d", "id": 9}]=0 v12) ==== 112+0+2 (secure 0 0 0) 0x7f8814066430 con 0x7f88241156f0 2026-02-17T11:54:05.464 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.462+0000 7f880affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "560b59a5-3dbd-4d78-9e91-9901e6279b0d", "id": 9}] 2026-02-17T11:54:05.464 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.462+0000 7f880affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:05.464 INFO:teuthology.orchestra.run.trial174.stdout:9 2026-02-17T11:54:05.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 10 librados: watch_flush enter 2026-02-17T11:54:05.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 10 librados: watch_flush exit 2026-02-17T11:54:05.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 20 client.4155.objecter shutdown clearing up homeless session... 2026-02-17T11:54:05.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 10 client.4155.objecter successfully canceled tick 2026-02-17T11:54:05.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f87f4078ca0 msgr2=0x7f87f407b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f87f4078ca0 0x7f87f407b160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88241ab7a0 tx=0x7f8818002930 comp rx=0 tx=0).stop 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 10 monclient: shutdown 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f88241156f0 msgr2=0x7f88241aba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f88241156f0 0x7f88241aba40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f881400ebe0 tx=0x7f881400c520 comp rx=0 tx=0).stop 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 shutdown_connections 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f87f4078ca0 0x7f87f407b160 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f882411b0a0 0x7f88241b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f882411a520 0x7f88241abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 --2- 10.20.193.174:0/1596960114 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f88241156f0 0x7f88241aba40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 >> 10.20.193.174:0/1596960114 conn(0x7f882406e030 msgr2=0x7f88241144a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:05.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 shutdown_connections 2026-02-17T11:54:05.468 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 -- 10.20.193.174:0/1596960114 wait complete. 2026-02-17T11:54:05.468 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.463+0000 7f882c35e640 1 librados: shutdown 2026-02-17T11:54:05.472 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new aee1b762-3d01-4115-bd92-a25c7afec8f7 10 2026-02-17T11:54:05.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.534+0000 7f9b37666640 10 monclient: get_monmap_and_config 2026-02-17T11:54:05.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.534+0000 7f9b37666640 10 monclient: build_initial_monmap 2026-02-17T11:54:05.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.534+0000 7f9b37666640 10 monclient: monmap: 2026-02-17T11:54:05.539 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:05.539 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.539 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:05.536099+0000 2026-02-17T11:54:05.539 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:05.536099+0000 2026-02-17T11:54:05.539 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 1 Processor -- start 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 1 -- start start 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 10 monclient: init 2026-02-17T11:54:05.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 10 monclient: _add_conns ranks=[4,1,2,3,0,5] 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9b301176a0 0x7f9b30117a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 10 monclient(hunting): picked mon.noname-b con 0x7f9b301176a0 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9b30112170 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9b30112d10 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b30120a90 con 0x7f9b30112170 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b30121c70 con 0x7f9b30112d10 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9b30122e50 con 0x7f9b301176a0 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b37666640 10 monclient(hunting): authenticate will time out at 920.173243s 2026-02-17T11:54:05.541 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b353db640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9b301176a0 0x7f9b30117a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.542 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b35bdc640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f9b30112d10 0x7f9b3011f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.174:41774/0 (socket says 10.20.193.174:41774) 2026-02-17T11:54:05.542 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b35bdc640 1 -- 10.20.193.174:0/2117484117 learned_addr learned my addr 10.20.193.174:0/2117484117 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-17T11:54:05.542 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b353db640 10 monclient(hunting): get_auth_request con 0x7f9b301176a0 auth_method 0 2026-02-17T11:54:05.542 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b353db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.542 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b353db640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.542 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.535+0000 7f9b353db640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.542 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.536+0000 7f9b353db640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.542 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.536+0000 7f9b353db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.542 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.536+0000 7f9b353db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.537+0000 7f9b353db640 10 monclient(hunting): handle_auth_done global_id 4174 payload 274 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.537+0000 7f9b353db640 1 -- 10.20.193.174:0/2117484117 >> v1:10.20.193.153:6789/0 conn(0x7f9b30112d10 legacy=0x7f9b3011f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.537+0000 7f9b353db640 1 -- 10.20.193.174:0/2117484117 >> v1:10.20.193.71:6789/0 conn(0x7f9b30112170 legacy=0x7f9b30112600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.537+0000 7f9b353db640 10 monclient: _finish_hunting 0 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.537+0000 7f9b353db640 1 monclient: found mon.noname-b 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.537+0000 7f9b353db640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.537+0000 7f9b353db640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.537+0000 7f9b353db640 1 -- 10.20.193.174:0/2117484117 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b30074160 con 0x7f9b301176a0 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.538+0000 7f9b353db640 1 --2- 10.20.193.174:0/2117484117 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b301176a0 0x7f9b30117a80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b200098a0 tx=0x7f9b2002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34276795bd666c28 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 1 -- 10.20.193.174:0/2117484117 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2003c070 con 0x7f9b301176a0 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 10 monclient: dump: 2026-02-17T11:54:05.546 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 10 monclient: _finish_auth 0 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 1 -- 10.20.193.174:0/2117484117 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2002fa40 con 0x7f9b301176a0 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 5 monclient: authenticate success, global_id 4174 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 1 -- 10.20.193.174:0/2117484117 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2002fe10 con 0x7f9b301176a0 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 4 set_mon_vals no callback set 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b1ffff640 10 monclient: dump: 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 10 monclient: shutdown 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 1 -- 10.20.193.174:0/2117484117 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b301176a0 msgr2=0x7f9b30117a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 1 --2- 10.20.193.174:0/2117484117 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b301176a0 0x7f9b30117a80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b200098a0 tx=0x7f9b2002ed80 comp rx=0 tx=0).stop 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 1 -- 10.20.193.174:0/2117484117 shutdown_connections 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 1 --2- 10.20.193.174:0/2117484117 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b301176a0 0x7f9b30117a80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 1 -- 10.20.193.174:0/2117484117 >> 10.20.193.174:0/2117484117 conn(0x7f9b3006f950 msgr2=0x7f9b30071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:05.547 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 1 -- 10.20.193.174:0/2117484117 shutdown_connections 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 1 -- 10.20.193.174:0/2117484117 wait complete. 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 10 monclient: build_initial_monmap 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 10 monclient: monmap: 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 1 librados: starting msgr at 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.540+0000 7f9b37666640 1 librados: starting objecter 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 Processor -- start 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 -- start start 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 librados: setting wanted keys 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 librados: calling monclient init 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient: init 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b30112170 0x7f9b3011ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient(hunting): picked mon.noname-c con 0x7f9b30112170 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b30112d10 0x7f9b3011e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient(hunting): picked mon.noname-b con 0x7f9b30112d10 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9b301176a0 0x7f9b3011e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient(hunting): picked mon.noname-a con 0x7f9b301176a0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30074880 con 0x7f9b301176a0 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30074700 con 0x7f9b30112d10 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30074a00 con 0x7f9b30112170 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b37666640 10 monclient(hunting): authenticate will time out at 920.179291s 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b30112d10 0x7f9b3011e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b353db640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b30112170 0x7f9b3011ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b30112d10 0x7f9b3011e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37172/0 (socket says 10.20.193.174:37172) 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 1 -- 10.20.193.174:0/2484621171 learned_addr learned my addr 10.20.193.174:0/2484621171 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 10 monclient(hunting): get_auth_request con 0x7f9b30112d10 auth_method 0 2026-02-17T11:54:05.548 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b353db640 10 monclient(hunting): get_auth_request con 0x7f9b30112170 auth_method 0 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b353db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b353db640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b353db640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.541+0000 7f9b34bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.542+0000 7f9b353db640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.542+0000 7f9b353db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.542+0000 7f9b353db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 10 monclient(hunting): handle_auth_done global_id 4177 payload 824 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 1 -- 10.20.193.174:0/2484621171 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b30112170 msgr2=0x7f9b3011ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b30112170 0x7f9b3011ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 1 -- 10.20.193.174:0/2484621171 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9b301176a0 msgr2=0x7f9b3011e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9b301176a0 0x7f9b3011e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 10 monclient: _finish_hunting 0 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 1 monclient: found mon.noname-b 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.543+0000 7f9b34bda640 1 -- 10.20.193.174:0/2484621171 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3011eb40 con 0x7f9b30112d10 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.544+0000 7f9b34bda640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b30112d10 0x7f9b3011e010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c5d0 tx=0x7f9b2400caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.544+0000 7f9b1dffb640 10 client.?.objecter ms_handle_connect 0x7f9b30112d10 2026-02-17T11:54:05.549 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.544+0000 7f9b1dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.545+0000 7f9b1dffb640 1 -- 10.20.193.174:0/2484621171 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24016020 con 0x7f9b30112d10 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.545+0000 7f9b1dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.545+0000 7f9b1dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.545+0000 7f9b1dffb640 10 monclient: dump: 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.545+0000 7f9b1dffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.545+0000 7f9b1dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.545+0000 7f9b1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.545+0000 7f9b1dffb640 1 -- 10.20.193.174:0/2484621171 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b24012850 con 0x7f9b30112d10 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.545+0000 7f9b1dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b1dffb640 1 -- 10.20.193.174:0/2484621171 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24012c40 con 0x7f9b30112d10 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b1dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b1dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b1dffb640 10 monclient: dump: 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b1f7fe640 4 set_mon_vals no callback set 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 5 monclient: authenticate success, global_id 4177 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 10 monclient: _renew_subs 2026-02-17T11:54:05.550 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3011edd0 con 0x7f9b30112d10 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 10 client.4177.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 10 monclient: _renew_subs 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b301b61c0 con 0x7f9b30112d10 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 1 librados: init done 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:05.551 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.546+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b30074e10 con 0x7f9b30112d10 2026-02-17T11:54:05.558 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.556+0000 7f9b1dffb640 1 -- 10.20.193.174:0/2484621171 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 3) ==== 99739+0+0 (secure 0 0 0) 0x7f9b240068d0 con 0x7f9b30112d10 2026-02-17T11:54:05.559 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.557+0000 7f9b1dffb640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b00078c50 0x7f9b0007b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.559 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.557+0000 7f9b353db640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b00078c50 0x7f9b0007b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.559 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.557+0000 7f9b353db640 10 monclient: get_auth_request con 0x7f9b00078c50 auth_method 0 2026-02-17T11:54:05.559 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.557+0000 7f9b1dffb640 1 -- 10.20.193.174:0/2484621171 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 1875+0+0 (secure 0 0 0) 0x7f9b24012de0 con 0x7f9b30112d10 2026-02-17T11:54:05.559 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.557+0000 7f9b1dffb640 10 client.4177.objecter ms_dispatch2 0x7f9b30000b90 osd_map(12..12 src has 1..12) 2026-02-17T11:54:05.559 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.557+0000 7f9b1dffb640 3 client.4177.objecter handle_osd_map got epochs [12,12] > 0 2026-02-17T11:54:05.559 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.557+0000 7f9b1dffb640 3 client.4177.objecter handle_osd_map decoding full epoch 12 2026-02-17T11:54:05.560 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.558+0000 7f9b1dffb640 20 client.4177.objecter dump_active .. 0 homeless 2026-02-17T11:54:05.560 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.558+0000 7f9b353db640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b00078c50 0x7f9b0007b110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b20039000 tx=0x7f9b20033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.560 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.558+0000 7f9b1dffb640 10 client.4177.objecter ms_handle_connect 0x7f9b00078c50 2026-02-17T11:54:05.658 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.656+0000 7f9b1dffb640 1 -- 10.20.193.174:0/2484621171 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9b24020030 con 0x7f9b30112d10 2026-02-17T11:54:05.658 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.656+0000 7f9b1dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.658 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.656+0000 7f9b1dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:05.745 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.743+0000 7f9b37666640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "aee1b762-3d01-4115-bd92-a25c7afec8f7", "id": 10}] 2026-02-17T11:54:05.745 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.743+0000 7f9b37666640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "aee1b762-3d01-4115-bd92-a25c7afec8f7", "id": 10}] 2026-02-17T11:54:05.745 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.743+0000 7f9b37666640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:05.745 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.743+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aee1b762-3d01-4115-bd92-a25c7afec8f7", "id": 10} v 0) -- 0x7f9b30118490 con 0x7f9b30112d10 2026-02-17T11:54:05.793 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b1dffb640 1 -- 10.20.193.174:0/2484621171 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aee1b762-3d01-4115-bd92-a25c7afec8f7", "id": 10}]=0 v13) ==== 113+0+3 (secure 0 0 0) 0x7f9b240623a0 con 0x7f9b30112d10 2026-02-17T11:54:05.793 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b1dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "aee1b762-3d01-4115-bd92-a25c7afec8f7", "id": 10}] 2026-02-17T11:54:05.793 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b1dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:05.793 INFO:teuthology.orchestra.run.trial174.stdout:10 2026-02-17T11:54:05.794 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 10 librados: watch_flush enter 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 10 librados: watch_flush exit 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 20 client.4177.objecter shutdown clearing up homeless session... 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 10 client.4177.objecter successfully canceled tick 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b00078c50 msgr2=0x7f9b0007b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b00078c50 0x7f9b0007b110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b20039000 tx=0x7f9b20033000 comp rx=0 tx=0).stop 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 10 monclient: shutdown 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b30112d10 msgr2=0x7f9b3011e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b30112d10 0x7f9b3011e010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c5d0 tx=0x7f9b2400caa0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 shutdown_connections 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b00078c50 0x7f9b0007b110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9b301176a0 0x7f9b3011e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b30112d10 0x7f9b3011e010 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 --2- 10.20.193.174:0/2484621171 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b30112170 0x7f9b3011ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 >> 10.20.193.174:0/2484621171 conn(0x7f9b3006f950 msgr2=0x7f9b30071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 shutdown_connections 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 -- 10.20.193.174:0/2484621171 wait complete. 2026-02-17T11:54:05.795 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.792+0000 7f9b37666640 1 librados: shutdown 2026-02-17T11:54:05.803 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 8b001f4d-596c-4631-b515-9aec2693c1ef 11 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient: get_monmap_and_config 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient: build_initial_monmap 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient: monmap: 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:05.867645+0000 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:05.867645+0000 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:05.868 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 1 Processor -- start 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 1 -- start start 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient: init 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient: _add_conns ranks=[4,0,3,5,2,1] 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fecf0118490 0x7fecf00739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient(hunting): picked mon.noname-b con 0x7fecf0118490 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fecf0073f10 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fecf0074520 0x7fecf0126a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient(hunting): picked mon.noname-a con 0x7fecf0074520 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf0127160 con 0x7fecf0073f10 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fecf0128380 con 0x7fecf0074520 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fecf0128500 con 0x7fecf0118490 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.866+0000 7fecf5e32640 10 monclient(hunting): authenticate will time out at 920.504814s 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fecf0118490 0x7fecf00739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7feceffff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fecf0074520 0x7fecf0126a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.869 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fecf0118490 0x7fecf00739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37180/0 (socket says 10.20.193.174:37180) 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 1 -- 10.20.193.174:0/3380052206 learned_addr learned my addr 10.20.193.174:0/3380052206 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 10 monclient(hunting): get_auth_request con 0x7fecf0118490 auth_method 0 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7feceffff640 10 monclient(hunting): get_auth_request con 0x7fecf0074520 auth_method 0 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7feceffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7feceffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7feceffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7fecef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7feceffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7feceffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.867+0000 7feceffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.868+0000 7fecef7fe640 10 monclient(hunting): handle_auth_done global_id 4180 payload 274 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.868+0000 7fecef7fe640 1 -- 10.20.193.174:0/3380052206 >> v2:10.20.193.10:3300/0 conn(0x7fecf0074520 msgr2=0x7fecf0126a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.868+0000 7fecef7fe640 1 --2- 10.20.193.174:0/3380052206 >> v2:10.20.193.10:3300/0 conn(0x7fecf0074520 0x7fecf0126a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.868+0000 7fecef7fe640 1 -- 10.20.193.174:0/3380052206 >> v1:10.20.193.10:6789/0 conn(0x7fecf0073f10 legacy=0x7fecf0123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.868+0000 7fecef7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.868+0000 7fecef7fe640 1 monclient: found mon.noname-b 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.868+0000 7fecef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.868+0000 7fecef7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:05.870 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.868+0000 7fecef7fe640 1 -- 10.20.193.174:0/3380052206 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf01286b0 con 0x7fecf0118490 2026-02-17T11:54:05.871 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.869+0000 7fecef7fe640 1 --2- 10.20.193.174:0/3380052206 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fecf0118490 0x7fecf00739d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fecf006a370 tx=0x7fecdc02eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=121d77345084a6e9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 1 -- 10.20.193.174:0/3380052206 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc03c070 con 0x7fecf0118490 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 10 monclient: dump: 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 10 monclient: _finish_auth 0 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 1 -- 10.20.193.174:0/3380052206 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecdc02fbe0 con 0x7fecf0118490 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 1 -- 10.20.193.174:0/3380052206 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc037440 con 0x7fecf0118490 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 5 monclient: authenticate success, global_id 4180 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecee7fc640 10 monclient: dump: 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:05.873 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 4 set_mon_vals no callback set 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 10 monclient: shutdown 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 -- 10.20.193.174:0/3380052206 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fecf0118490 msgr2=0x7fecf00739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 --2- 10.20.193.174:0/3380052206 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fecf0118490 0x7fecf00739d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fecf006a370 tx=0x7fecdc02eed0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 -- 10.20.193.174:0/3380052206 shutdown_connections 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 --2- 10.20.193.174:0/3380052206 >> v2:10.20.193.10:3300/0 conn(0x7fecf0074520 0x7fecf0126a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 --2- 10.20.193.174:0/3380052206 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fecf0118490 0x7fecf00739d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 -- 10.20.193.174:0/3380052206 >> 10.20.193.174:0/3380052206 conn(0x7fecf006f950 msgr2=0x7fecf0071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 -- 10.20.193.174:0/3380052206 shutdown_connections 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 -- 10.20.193.174:0/3380052206 wait complete. 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 10 monclient: build_initial_monmap 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 10 monclient: monmap: 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 librados: starting msgr at 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 librados: starting objecter 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 Processor -- start 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 -- start start 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 librados: setting wanted keys 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 1 librados: calling monclient init 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.871+0000 7fecf5e32640 10 monclient: init 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fecf0073f10 0x7fecf01b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient(hunting): picked mon.noname-c con 0x7fecf0073f10 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fecf0074520 0x7fecf01b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient(hunting): picked mon.noname-b con 0x7fecf0074520 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:05.875 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fecf0118490 0x7fecf01afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient(hunting): picked mon.noname-a con 0x7fecf0118490 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01277b0 con 0x7fecf0118490 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0127630 con 0x7fecf0074520 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0127930 con 0x7fecf0073f10 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecf5e32640 10 monclient(hunting): authenticate will time out at 920.510121s 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceeffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fecf0074520 0x7fecf01b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecef7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fecf0073f10 0x7fecf01b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fecf0118490 0x7fecf01afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fecf0118490 0x7fecf01afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.174:41914/0 (socket says 10.20.193.174:41914) 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 1 -- 10.20.193.174:0/3901082277 learned_addr learned my addr 10.20.193.174:0/3901082277 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 10 monclient(hunting): get_auth_request con 0x7fecf0118490 auth_method 0 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceeffd640 10 monclient(hunting): get_auth_request con 0x7fecf0074520 auth_method 0 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecef7fe640 10 monclient(hunting): get_auth_request con 0x7fecf0073f10 auth_method 0 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7fecef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.872+0000 7feceeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.873+0000 7fecef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.873+0000 7fecef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:05.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.873+0000 7fecef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 10 monclient(hunting): handle_auth_done global_id 4161 payload 824 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 1 -- 10.20.193.174:0/3901082277 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fecf0073f10 msgr2=0x7fecf01b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fecf0073f10 0x7fecf01b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 1 -- 10.20.193.174:0/3901082277 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fecf0074520 msgr2=0x7fecf01b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fecf0074520 0x7fecf01b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 1 monclient: found mon.noname-a 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.874+0000 7feceffff640 1 -- 10.20.193.174:0/3901082277 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf01b04c0 con 0x7fecf0118490 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.875+0000 7feceffff640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fecf0118490 0x7fecf01afc00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fece400efc0 tx=0x7fece400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.875+0000 7feccbfff640 10 client.?.objecter ms_handle_connect 0x7fecf0118490 2026-02-17T11:54:05.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.875+0000 7feccbfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:05.878 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 1 -- 10.20.193.174:0/3901082277 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4018020 con 0x7fecf0118490 2026-02-17T11:54:05.878 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.878 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:05.878 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 10 monclient: dump: 2026-02-17T11:54:05.878 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 10 monclient: _finish_auth 0 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 1 -- 10.20.193.174:0/3901082277 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece400cd50 con 0x7fecf0118490 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 1 -- 10.20.193.174:0/3901082277 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece40146c0 con 0x7fecf0118490 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecedffb640 4 set_mon_vals no callback set 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7feccbfff640 10 monclient: dump: 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecf5e32640 5 monclient: authenticate success, global_id 4161 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecf5e32640 10 monclient: _renew_subs 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecf5e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf01b0750 con 0x7fecf0118490 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecf5e32640 10 client.4161.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecf5e32640 10 monclient: _renew_subs 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecf5e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf01bcae0 con 0x7fecf0118490 2026-02-17T11:54:05.879 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.876+0000 7fecf5e32640 1 librados: init done 2026-02-17T11:54:05.880 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.877+0000 7fecf5e32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.880 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.877+0000 7fecf5e32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.880 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.877+0000 7fecf5e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:05.880 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.877+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf00739d0 con 0x7fecf0118490 2026-02-17T11:54:05.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.888+0000 7feccbfff640 1 -- 10.20.193.174:0/3901082277 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 3) ==== 99739+0+0 (secure 0 0 0) 0x7fece4014a70 con 0x7fecf0118490 2026-02-17T11:54:05.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.888+0000 7feccbfff640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fecc0078c50 0x7fecc007b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:05.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.888+0000 7fecef7fe640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fecc0078c50 0x7fecc007b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:05.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.888+0000 7fecef7fe640 10 monclient: get_auth_request con 0x7fecc0078c50 auth_method 0 2026-02-17T11:54:05.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.889+0000 7feccbfff640 1 -- 10.20.193.174:0/3901082277 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 1990+0+0 (secure 0 0 0) 0x7fece405f0a0 con 0x7fecf0118490 2026-02-17T11:54:05.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.889+0000 7feccbfff640 10 client.4161.objecter ms_dispatch2 0x7fecf0000b90 osd_map(13..13 src has 1..13) 2026-02-17T11:54:05.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.889+0000 7feccbfff640 3 client.4161.objecter handle_osd_map got epochs [13,13] > 0 2026-02-17T11:54:05.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.889+0000 7feccbfff640 3 client.4161.objecter handle_osd_map decoding full epoch 13 2026-02-17T11:54:05.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.889+0000 7feccbfff640 20 client.4161.objecter dump_active .. 0 homeless 2026-02-17T11:54:05.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.889+0000 7feccbfff640 10 client.4161.objecter ms_handle_connect 0x7fecc0078c50 2026-02-17T11:54:05.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.889+0000 7fecef7fe640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fecc0078c50 0x7fecc007b110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fecf0074400 tx=0x7fecdc039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:05.991 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.989+0000 7feccbfff640 1 -- 10.20.193.174:0/3901082277 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fece4022030 con 0x7fecf0118490 2026-02-17T11:54:05.991 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.989+0000 7feccbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:05.991 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:05.989+0000 7feccbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:06.078 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.076+0000 7fecf5e32640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8b001f4d-596c-4631-b515-9aec2693c1ef", "id": 11}] 2026-02-17T11:54:06.079 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.076+0000 7fecf5e32640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8b001f4d-596c-4631-b515-9aec2693c1ef", "id": 11}] 2026-02-17T11:54:06.079 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.076+0000 7fecf5e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:06.079 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.076+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8b001f4d-596c-4631-b515-9aec2693c1ef", "id": 11} v 0) -- 0x7fecf01bccb0 con 0x7fecf0118490 2026-02-17T11:54:06.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.094+0000 7feccbfff640 1 -- 10.20.193.174:0/3901082277 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b001f4d-596c-4631-b515-9aec2693c1ef", "id": 11}]=0 v14) ==== 113+0+3 (secure 0 0 0) 0x7fece4010040 con 0x7fecf0118490 2026-02-17T11:54:06.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.094+0000 7feccbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8b001f4d-596c-4631-b515-9aec2693c1ef", "id": 11}] 2026-02-17T11:54:06.097 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.094+0000 7feccbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:06.097 INFO:teuthology.orchestra.run.trial174.stdout:11 2026-02-17T11:54:06.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 10 librados: watch_flush enter 2026-02-17T11:54:06.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 10 librados: watch_flush exit 2026-02-17T11:54:06.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 20 client.4161.objecter shutdown clearing up homeless session... 2026-02-17T11:54:06.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 10 client.4161.objecter successfully canceled tick 2026-02-17T11:54:06.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fecc0078c50 msgr2=0x7fecc007b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fecc0078c50 0x7fecc007b110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fecf0074400 tx=0x7fecdc039040 comp rx=0 tx=0).stop 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 10 monclient: shutdown 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fecf0118490 msgr2=0x7fecf01afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fecf0118490 0x7fecf01afc00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fece400efc0 tx=0x7fece400c490 comp rx=0 tx=0).stop 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 shutdown_connections 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fecc0078c50 0x7fecc007b110 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fecf0118490 0x7fecf01afc00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fecf0074520 0x7fecf01b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 --2- 10.20.193.174:0/3901082277 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fecf0073f10 0x7fecf01b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 >> 10.20.193.174:0/3901082277 conn(0x7fecf006f950 msgr2=0x7fecf01242d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 shutdown_connections 2026-02-17T11:54:06.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 -- 10.20.193.174:0/3901082277 wait complete. 2026-02-17T11:54:06.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.095+0000 7fecf5e32640 1 librados: shutdown 2026-02-17T11:54:06.105 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new da87b3aa-2536-4e8c-8da7-c8f87f630ce4 12 2026-02-17T11:54:06.171 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient: get_monmap_and_config 2026-02-17T11:54:06.171 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient: build_initial_monmap 2026-02-17T11:54:06.171 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient: monmap: 2026-02-17T11:54:06.171 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:06.167694+0000 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:06.167694+0000 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:06.172 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 1 Processor -- start 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 1 -- start start 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient: init 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient: _add_conns ranks=[4,3,0,5,2,1] 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff3ec118490 0x7ff3ec0739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient(hunting): picked mon.noname-b con 0x7ff3ec118490 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff3ec073f10 0x7ff3ec0743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient(hunting): picked mon.noname-a con 0x7ff3ec073f10 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff3ec1233c0 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3ec127190 con 0x7ff3ec1233c0 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7ff3ec1283b0 con 0x7ff3ec073f10 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff3ec128530 con 0x7ff3ec118490 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.166+0000 7ff3f183b640 10 monclient(hunting): authenticate will time out at 920.804857s 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff3ec118490 0x7ff3ec0739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3ea7fc640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff3ec073f10 0x7ff3ec0743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff3ec118490 0x7ff3ec0739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37208/0 (socket says 10.20.193.174:37208) 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 1 -- 10.20.193.174:0/2480471289 learned_addr learned my addr 10.20.193.174:0/2480471289 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 10 monclient(hunting): get_auth_request con 0x7ff3ec118490 auth_method 0 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3ea7fc640 10 monclient(hunting): get_auth_request con 0x7ff3ec073f10 auth_method 0 2026-02-17T11:54:06.173 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3ea7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.167+0000 7ff3eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3ea7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3ea7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3ea7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3eaffd640 10 monclient(hunting): handle_auth_done global_id 4186 payload 274 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3eaffd640 1 -- 10.20.193.174:0/2480471289 >> v2:10.20.193.10:3300/0 conn(0x7ff3ec073f10 msgr2=0x7ff3ec0743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3eaffd640 1 --2- 10.20.193.174:0/2480471289 >> v2:10.20.193.10:3300/0 conn(0x7ff3ec073f10 0x7ff3ec0743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3eaffd640 1 -- 10.20.193.174:0/2480471289 >> v1:10.20.193.10:6789/0 conn(0x7ff3ec1233c0 legacy=0x7ff3ec125860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3eaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3eaffd640 1 monclient: found mon.noname-b 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3eaffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:06.174 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.168+0000 7ff3eaffd640 1 -- 10.20.193.174:0/2480471289 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ec1286e0 con 0x7ff3ec118490 2026-02-17T11:54:06.175 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.169+0000 7ff3eaffd640 1 --2- 10.20.193.174:0/2480471289 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3ec118490 0x7ff3ec0739d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec06a370 tx=0x7ff3e002eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=677eaa83bbe046ea server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.170+0000 7ff3e9ffb640 1 -- 10.20.193.174:0/2480471289 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e003c070 con 0x7ff3ec118490 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.170+0000 7ff3e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.170+0000 7ff3e9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.170+0000 7ff3e9ffb640 10 monclient: dump: 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.170+0000 7ff3e9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.170+0000 7ff3e9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.170+0000 7ff3e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.170+0000 7ff3f183b640 5 monclient: authenticate success, global_id 4186 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.170+0000 7ff3f183b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3e9ffb640 1 -- 10.20.193.174:0/2480471289 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e002fbe0 con 0x7ff3ec118490 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3e9ffb640 1 -- 10.20.193.174:0/2480471289 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0037440 con 0x7ff3ec118490 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3e9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3e9ffb640 10 monclient: dump: 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 4 set_mon_vals no callback set 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 10 monclient: shutdown 2026-02-17T11:54:06.176 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 -- 10.20.193.174:0/2480471289 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3ec118490 msgr2=0x7ff3ec0739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 --2- 10.20.193.174:0/2480471289 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3ec118490 0x7ff3ec0739d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec06a370 tx=0x7ff3e002eed0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 -- 10.20.193.174:0/2480471289 shutdown_connections 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 --2- 10.20.193.174:0/2480471289 >> v2:10.20.193.10:3300/0 conn(0x7ff3ec073f10 0x7ff3ec0743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 --2- 10.20.193.174:0/2480471289 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3ec118490 0x7ff3ec0739d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 -- 10.20.193.174:0/2480471289 >> 10.20.193.174:0/2480471289 conn(0x7ff3ec06f950 msgr2=0x7ff3ec071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 -- 10.20.193.174:0/2480471289 shutdown_connections 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 -- 10.20.193.174:0/2480471289 wait complete. 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 10 monclient: build_initial_monmap 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 10 monclient: monmap: 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 librados: starting msgr at 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.171+0000 7ff3f183b640 1 librados: starting objecter 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 Processor -- start 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 -- start start 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 librados: setting wanted keys 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 librados: calling monclient init 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient: init 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3ec073f10 0x7ff3ec1afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient(hunting): picked mon.noname-b con 0x7ff3ec073f10 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3ec118490 0x7ff3ec1b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient(hunting): picked mon.noname-c con 0x7ff3ec118490 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3ec1233c0 0x7ff3ec1b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient(hunting): picked mon.noname-a con 0x7ff3ec1233c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec1277e0 con 0x7ff3ec1233c0 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec127660 con 0x7ff3ec073f10 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec127960 con 0x7ff3ec118490 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3f183b640 10 monclient(hunting): authenticate will time out at 920.810384s 2026-02-17T11:54:06.177 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eb7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3ec1233c0 0x7ff3ec1b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eaffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3ec073f10 0x7ff3ec1afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eb7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3ec1233c0 0x7ff3ec1b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.174:41930/0 (socket says 10.20.193.174:41930) 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eb7fe640 1 -- 10.20.193.174:0/19678982 learned_addr learned my addr 10.20.193.174:0/19678982 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eb7fe640 10 monclient(hunting): get_auth_request con 0x7ff3ec1233c0 auth_method 0 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3ea7fc640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3ec118490 0x7ff3ec1b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eaffd640 10 monclient(hunting): get_auth_request con 0x7ff3ec073f10 auth_method 0 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.172+0000 7ff3eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3ea7fc640 10 monclient(hunting): get_auth_request con 0x7ff3ec118490 auth_method 0 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3ea7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3ea7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3ea7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.178 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.173+0000 7ff3ea7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 10 monclient(hunting): handle_auth_done global_id 4170 payload 824 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 1 -- 10.20.193.174:0/19678982 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3ec118490 msgr2=0x7ff3ec1b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3ec118490 0x7ff3ec1b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 1 -- 10.20.193.174:0/19678982 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3ec073f10 msgr2=0x7ff3ec1afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3ec073f10 0x7ff3ec1afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 1 monclient: found mon.noname-a 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.174+0000 7ff3eb7fe640 1 -- 10.20.193.174:0/19678982 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ec1b4e80 con 0x7ff3ec1233c0 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.175+0000 7ff3eb7fe640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3ec1233c0 0x7ff3ec1b45c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00cb90 tx=0x7ff3dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.175+0000 7ff3c3fff640 10 client.?.objecter ms_handle_connect 0x7ff3ec1233c0 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.175+0000 7ff3c3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 1 -- 10.20.193.174:0/19678982 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00ad50 con 0x7ff3ec1233c0 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 10 monclient: dump: 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 1 -- 10.20.193.174:0/19678982 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc003a70 con 0x7ff3ec1233c0 2026-02-17T11:54:06.179 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 1 -- 10.20.193.174:0/19678982 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc003e40 con 0x7ff3ec1233c0 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3e97fa640 4 set_mon_vals no callback set 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3c3fff640 10 monclient: dump: 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3f183b640 5 monclient: authenticate success, global_id 4170 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3f183b640 10 monclient: _renew_subs 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3f183b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.176+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3ec1b5170 con 0x7ff3ec1233c0 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.177+0000 7ff3f183b640 10 client.4170.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.177+0000 7ff3f183b640 10 monclient: _renew_subs 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.177+0000 7ff3f183b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.177+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ec1bca00 con 0x7ff3ec1233c0 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.177+0000 7ff3f183b640 1 librados: init done 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.177+0000 7ff3f183b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.177+0000 7ff3f183b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.177+0000 7ff3f183b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:06.180 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.177+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3ec0743a0 con 0x7ff3ec1233c0 2026-02-17T11:54:06.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.281+0000 7ff3c3fff640 1 -- 10.20.193.174:0/19678982 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 3) ==== 99739+0+0 (secure 0 0 0) 0x7ff3dc0050d0 con 0x7ff3ec1233c0 2026-02-17T11:54:06.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.282+0000 7ff3c3fff640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3bc078ca0 0x7ff3bc07b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.282+0000 7ff3eaffd640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3bc078ca0 0x7ff3bc07b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.282+0000 7ff3eaffd640 10 monclient: get_auth_request con 0x7ff3bc078ca0 auth_method 0 2026-02-17T11:54:06.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.283+0000 7ff3eaffd640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3bc078ca0 0x7ff3bc07b160 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec1270d0 tx=0x7ff3e0039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:06.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.283+0000 7ff3c3fff640 10 client.4170.objecter ms_handle_connect 0x7ff3bc078ca0 2026-02-17T11:54:06.291 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.289+0000 7ff3c3fff640 1 -- 10.20.193.174:0/19678982 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2105+0+0 (secure 0 0 0) 0x7ff3dc05e610 con 0x7ff3ec1233c0 2026-02-17T11:54:06.291 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.289+0000 7ff3c3fff640 10 client.4170.objecter ms_dispatch2 0x7ff3ec000b90 osd_map(14..14 src has 1..14) 2026-02-17T11:54:06.291 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.289+0000 7ff3c3fff640 3 client.4170.objecter handle_osd_map got epochs [14,14] > 0 2026-02-17T11:54:06.291 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.289+0000 7ff3c3fff640 3 client.4170.objecter handle_osd_map decoding full epoch 14 2026-02-17T11:54:06.291 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.289+0000 7ff3c3fff640 20 client.4170.objecter dump_active .. 0 homeless 2026-02-17T11:54:06.291 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.289+0000 7ff3c3fff640 1 -- 10.20.193.174:0/19678982 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff3dc0625d0 con 0x7ff3ec1233c0 2026-02-17T11:54:06.291 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.289+0000 7ff3c3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:06.291 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.289+0000 7ff3c3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:06.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.376+0000 7ff3f183b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "da87b3aa-2536-4e8c-8da7-c8f87f630ce4", "id": 12}] 2026-02-17T11:54:06.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.376+0000 7ff3f183b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "da87b3aa-2536-4e8c-8da7-c8f87f630ce4", "id": 12}] 2026-02-17T11:54:06.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.376+0000 7ff3f183b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:06.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.376+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd new", "uuid": "da87b3aa-2536-4e8c-8da7-c8f87f630ce4", "id": 12} v 0) -- 0x7ff3ec1bcbd0 con 0x7ff3ec1233c0 2026-02-17T11:54:06.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.395+0000 7ff3c3fff640 1 -- 10.20.193.174:0/19678982 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da87b3aa-2536-4e8c-8da7-c8f87f630ce4", "id": 12}]=0 v15) ==== 113+0+3 (secure 0 0 0) 0x7ff3dc0668d0 con 0x7ff3ec1233c0 2026-02-17T11:54:06.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.395+0000 7ff3c3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "da87b3aa-2536-4e8c-8da7-c8f87f630ce4", "id": 12}] 2026-02-17T11:54:06.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.395+0000 7ff3c3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:06.398 INFO:teuthology.orchestra.run.trial174.stdout:12 2026-02-17T11:54:06.399 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 10 librados: watch_flush enter 2026-02-17T11:54:06.399 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 10 librados: watch_flush exit 2026-02-17T11:54:06.399 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 20 client.4170.objecter shutdown clearing up homeless session... 2026-02-17T11:54:06.399 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 10 client.4170.objecter successfully canceled tick 2026-02-17T11:54:06.399 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3bc078ca0 msgr2=0x7ff3bc07b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3bc078ca0 0x7ff3bc07b160 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec1270d0 tx=0x7ff3e0039040 comp rx=0 tx=0).stop 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 10 monclient: shutdown 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3ec1233c0 msgr2=0x7ff3ec1b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3ec1233c0 0x7ff3ec1b45c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00cb90 tx=0x7ff3dc00a430 comp rx=0 tx=0).stop 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 shutdown_connections 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3bc078ca0 0x7ff3bc07b160 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3ec1233c0 0x7ff3ec1b45c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3ec118490 0x7ff3ec1b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 --2- 10.20.193.174:0/19678982 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3ec073f10 0x7ff3ec1afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 >> 10.20.193.174:0/19678982 conn(0x7ff3ec06f950 msgr2=0x7ff3ec1248b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:06.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 shutdown_connections 2026-02-17T11:54:06.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 -- 10.20.193.174:0/19678982 wait complete. 2026-02-17T11:54:06.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.396+0000 7ff3f183b640 1 librados: shutdown 2026-02-17T11:54:06.406 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 47edcc4b-fb7d-4437-8e7b-8a121bd5bd14 13 2026-02-17T11:54:06.471 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient: get_monmap_and_config 2026-02-17T11:54:06.471 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient: build_initial_monmap 2026-02-17T11:54:06.472 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient: monmap: 2026-02-17T11:54:06.472 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:06.472 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.472 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:06.468684+0000 2026-02-17T11:54:06.472 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:06.468684+0000 2026-02-17T11:54:06.472 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:06.472 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.472 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:06.472 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 1 Processor -- start 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 1 -- start start 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient: init 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:06.473 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient: _add_conns ranks=[1,0,4,5,2,3] 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1a64118490 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1a640740e0 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1a64125a60 0x7f1a64127e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient(hunting): picked mon.noname-b con 0x7f1a64125a60 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a64128390 con 0x7f1a640740e0 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a64129570 con 0x7f1a64118490 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6412a750 con 0x7f1a64125a60 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:06.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.467+0000 7f1a6c151640 10 monclient(hunting): authenticate will time out at 921.105802s 2026-02-17T11:54:06.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1a64125a60 0x7f1a64127e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1a64125a60 0x7f1a64127e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37212/0 (socket says 10.20.193.174:37212) 2026-02-17T11:54:06.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 1 -- 10.20.193.174:0/303013753 learned_addr learned my addr 10.20.193.174:0/303013753 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:06.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 10 monclient(hunting): get_auth_request con 0x7f1a64125a60 auth_method 0 2026-02-17T11:54:06.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.476 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.468+0000 7f1a6a6c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.481 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.469+0000 7f1a6a6c7640 10 monclient(hunting): handle_auth_done global_id 4192 payload 274 2026-02-17T11:54:06.481 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.469+0000 7f1a6a6c7640 1 -- 10.20.193.174:0/303013753 >> v1:10.20.193.71:6789/0 conn(0x7f1a64118490 legacy=0x7f1a640739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.481 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.469+0000 7f1a6a6c7640 1 -- 10.20.193.174:0/303013753 >> v1:10.20.193.10:6789/0 conn(0x7f1a640740e0 legacy=0x7f1a64124340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.469+0000 7f1a6a6c7640 10 monclient: _finish_hunting 0 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.469+0000 7f1a6a6c7640 1 monclient: found mon.noname-b 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.469+0000 7f1a6a6c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.469+0000 7f1a6a6c7640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.469+0000 7f1a6a6c7640 1 -- 10.20.193.174:0/303013753 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6412a8d0 con 0x7f1a64125a60 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.471+0000 7f1a6a6c7640 1 --2- 10.20.193.174:0/303013753 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 0x7f1a64127e50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009e50 tx=0x7f1a6002f2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29b198a06e70edf6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 1 -- 10.20.193.174:0/303013753 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6002fd50 con 0x7f1a64125a60 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 10 monclient: dump: 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 10 monclient: _finish_auth 0 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 10 monclient: _check_auth_tickets 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 1 -- 10.20.193.174:0/303013753 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a600373f0 con 0x7f1a64125a60 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 5 monclient: authenticate success, global_id 4192 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 1 -- 10.20.193.174:0/303013753 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a600377c0 con 0x7f1a64125a60 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 4 set_mon_vals no callback set 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a68ec4640 10 monclient: dump: 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.482 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 10 monclient: shutdown 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 1 -- 10.20.193.174:0/303013753 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 msgr2=0x7f1a64127e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 1 --2- 10.20.193.174:0/303013753 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 0x7f1a64127e50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009e50 tx=0x7f1a6002f2a0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 1 -- 10.20.193.174:0/303013753 shutdown_connections 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 1 --2- 10.20.193.174:0/303013753 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 0x7f1a64127e50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 1 -- 10.20.193.174:0/303013753 >> 10.20.193.174:0/303013753 conn(0x7f1a6406f950 msgr2=0x7f1a64071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 1 -- 10.20.193.174:0/303013753 shutdown_connections 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 1 -- 10.20.193.174:0/303013753 wait complete. 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 10 monclient: build_initial_monmap 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.473+0000 7f1a6c151640 10 monclient: monmap: 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 librados: starting msgr at 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 librados: starting objecter 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 Processor -- start 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 -- start start 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 librados: setting wanted keys 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 librados: calling monclient init 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient: init 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a640740e0 0x7f1a64116830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient(hunting): picked mon.noname-c con 0x7f1a640740e0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1a64118490 0x7f1a64116ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient(hunting): picked mon.noname-a con 0x7f1a64118490 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 0x7f1a641b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient(hunting): picked mon.noname-b con 0x7f1a64125a60 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:06.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64128980 con 0x7f1a64118490 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64128800 con 0x7f1a64125a60 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64128b00 con 0x7f1a640740e0 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6c151640 10 monclient(hunting): authenticate will time out at 921.112302s 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6a6c7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 0x7f1a641b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a69ec6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a640740e0 0x7f1a64116830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6a6c7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 0x7f1a641b5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37226/0 (socket says 10.20.193.174:37226) 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6a6c7640 1 -- 10.20.193.174:0/338721138 learned_addr learned my addr 10.20.193.174:0/338721138 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6a6c7640 10 monclient(hunting): get_auth_request con 0x7f1a64125a60 auth_method 0 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6a6c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6a6c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a6a6c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a69ec6640 10 monclient(hunting): get_auth_request con 0x7f1a640740e0 auth_method 0 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a69ec6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a69ec6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.474+0000 7f1a69ec6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.475+0000 7f1a6a6c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.475+0000 7f1a6a6c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.475+0000 7f1a6a6c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.475+0000 7f1a69ec6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.475+0000 7f1a69ec6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.475+0000 7f1a69ec6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 10 monclient(hunting): handle_auth_done global_id 4195 payload 824 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 1 -- 10.20.193.174:0/338721138 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a640740e0 msgr2=0x7f1a64116830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a640740e0 0x7f1a64116830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 1 -- 10.20.193.174:0/338721138 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1a64118490 msgr2=0x7f1a64116ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1a64118490 0x7f1a64116ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 10 monclient: _finish_hunting 0 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 1 monclient: found mon.noname-b 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.476+0000 7f1a6a6c7640 1 -- 10.20.193.174:0/338721138 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a641b6120 con 0x7f1a64125a60 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.477+0000 7f1a6a6c7640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 0x7f1a641b5860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a60039040 tx=0x7f1a60004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.477+0000 7f1a527fc640 10 client.?.objecter ms_handle_connect 0x7f1a64125a60 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.477+0000 7f1a527fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 1 -- 10.20.193.174:0/338721138 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60046020 con 0x7f1a64125a60 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.484 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 10 monclient: dump: 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 10 monclient: _finish_auth 0 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 10 monclient: _check_auth_tickets 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 5 monclient: authenticate success, global_id 4195 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 10 monclient: _renew_subs 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a641b6350 con 0x7f1a64125a60 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 10 client.4195.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 10 monclient: _renew_subs 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a641bcb30 con 0x7f1a64125a60 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 1 librados: init done 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 1 -- 10.20.193.174:0/338721138 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a600373f0 con 0x7f1a64125a60 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 1 -- 10.20.193.174:0/338721138 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60037e60 con 0x7f1a64125a60 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a53fff640 4 set_mon_vals no callback set 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a527fc640 10 monclient: dump: 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:06.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:06.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.478+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a64128f10 con 0x7f1a64125a60 2026-02-17T11:54:06.491 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.489+0000 7f1a527fc640 1 -- 10.20.193.174:0/338721138 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 3) ==== 99739+0+0 (secure 0 0 0) 0x7f1a60041710 con 0x7f1a64125a60 2026-02-17T11:54:06.491 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.489+0000 7f1a527fc640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1a34078c50 0x7f1a3407b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.491 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.489+0000 7f1a69ec6640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1a34078c50 0x7f1a3407b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.491 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.489+0000 7f1a69ec6640 10 monclient: get_auth_request con 0x7f1a34078c50 auth_method 0 2026-02-17T11:54:06.492 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.490+0000 7f1a69ec6640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1a34078c50 0x7f1a3407b110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a64117700 tx=0x7f1a54007f30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:06.492 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.490+0000 7f1a527fc640 10 client.4195.objecter ms_handle_connect 0x7f1a34078c50 2026-02-17T11:54:06.492 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.490+0000 7f1a527fc640 1 -- 10.20.193.174:0/338721138 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2220+0+0 (secure 0 0 0) 0x7f1a60083940 con 0x7f1a64125a60 2026-02-17T11:54:06.492 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.490+0000 7f1a527fc640 10 client.4195.objecter ms_dispatch2 0x7f1a64000b90 osd_map(15..15 src has 1..15) 2026-02-17T11:54:06.492 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.490+0000 7f1a527fc640 3 client.4195.objecter handle_osd_map got epochs [15,15] > 0 2026-02-17T11:54:06.492 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.490+0000 7f1a527fc640 3 client.4195.objecter handle_osd_map decoding full epoch 15 2026-02-17T11:54:06.492 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.490+0000 7f1a527fc640 20 client.4195.objecter dump_active .. 0 homeless 2026-02-17T11:54:06.591 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.589+0000 7f1a527fc640 1 -- 10.20.193.174:0/338721138 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1a60050030 con 0x7f1a64125a60 2026-02-17T11:54:06.591 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.589+0000 7f1a527fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:06.591 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.589+0000 7f1a527fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:06.677 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.675+0000 7f1a6c151640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "47edcc4b-fb7d-4437-8e7b-8a121bd5bd14", "id": 13}] 2026-02-17T11:54:06.677 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.675+0000 7f1a6c151640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "47edcc4b-fb7d-4437-8e7b-8a121bd5bd14", "id": 13}] 2026-02-17T11:54:06.677 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.675+0000 7f1a6c151640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:06.677 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.675+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47edcc4b-fb7d-4437-8e7b-8a121bd5bd14", "id": 13} v 0) -- 0x7f1a641234b0 con 0x7f1a64125a60 2026-02-17T11:54:06.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.768+0000 7f1a527fc640 1 -- 10.20.193.174:0/338721138 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f1a600871c0 con 0x7f1a64125a60 2026-02-17T11:54:06.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.814+0000 7f1a527fc640 1 -- 10.20.193.174:0/338721138 <== mon.1 v2:10.20.193.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47edcc4b-fb7d-4437-8e7b-8a121bd5bd14", "id": 13}]=0 v16) ==== 113+0+3 (secure 0 0 0) 0x7f1a60088000 con 0x7f1a64125a60 2026-02-17T11:54:06.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.814+0000 7f1a527fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "47edcc4b-fb7d-4437-8e7b-8a121bd5bd14", "id": 13}] 2026-02-17T11:54:06.816 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.814+0000 7f1a527fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:06.816 INFO:teuthology.orchestra.run.trial174.stdout:13 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 10 librados: watch_flush enter 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 10 librados: watch_flush exit 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 20 client.4195.objecter shutdown clearing up homeless session... 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 10 client.4195.objecter successfully canceled tick 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1a34078c50 msgr2=0x7f1a3407b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1a34078c50 0x7f1a3407b110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a64117700 tx=0x7f1a54007f30 comp rx=0 tx=0).stop 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 10 monclient: shutdown 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 msgr2=0x7f1a641b5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 0x7f1a641b5860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a60039040 tx=0x7f1a60004b40 comp rx=0 tx=0).stop 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 shutdown_connections 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1a34078c50 0x7f1a3407b110 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1a64125a60 0x7f1a641b5860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1a64118490 0x7f1a64116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 --2- 10.20.193.174:0/338721138 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a640740e0 0x7f1a64116830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 >> 10.20.193.174:0/338721138 conn(0x7f1a6406f950 msgr2=0x7f1a64072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 shutdown_connections 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 -- 10.20.193.174:0/338721138 wait complete. 2026-02-17T11:54:06.817 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.815+0000 7f1a6c151640 1 librados: shutdown 2026-02-17T11:54:06.826 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new ac2266e7-8a26-458a-b92f-ce0ffe2653eb 14 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.887+0000 7f5c51a7d640 10 monclient: get_monmap_and_config 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.887+0000 7f5c51a7d640 10 monclient: build_initial_monmap 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.887+0000 7f5c51a7d640 10 monclient: monmap: 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:06.889188+0000 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:06.889188+0000 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 1 Processor -- start 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 1 -- start start 2026-02-17T11:54:06.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 10 monclient: init 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 10 monclient: _add_conns ranks=[0,2,4,3,1,5] 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5c4c116560 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5c4c11a200 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5c4c11de30 0x7f5c4c1202f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 10 monclient(hunting): picked mon.noname-b con 0x7f5c4c11de30 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c120a10 con 0x7f5c4c116560 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c121c30 con 0x7f5c4c11a200 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4c122e30 con 0x7f5c4c11de30 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c51a7d640 10 monclient(hunting): authenticate will time out at 921.526418s 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c4a7fc640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f5c4c11a200 0x7f5c4c11c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.174:41786/0 (socket says 10.20.193.174:41786) 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c4a7fc640 1 -- 10.20.193.174:0/3097196718 learned_addr learned my addr 10.20.193.174:0/3097196718 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.888+0000 7f5c4b7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5c4c11de30 0x7f5c4c1202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.889+0000 7f5c4b7fe640 10 monclient(hunting): get_auth_request con 0x7f5c4c11de30 auth_method 0 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.889+0000 7f5c4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.889+0000 7f5c4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.889+0000 7f5c4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.889+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.889+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.891 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.889+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 1 -- 10.20.193.174:0/3097196718 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2918944117 0 0) 0x7f5c4c121c30 con 0x7f5c4c11a200 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 10 monclient(hunting): my global_id is 4187 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 1 -- 10.20.193.174:0/3097196718 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c380058b0 con 0x7f5c4c11a200 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 1 -- 10.20.193.174:0/3097196718 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701777302 0 0) 0x7f5c4c120a10 con 0x7f5c4c116560 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 10 monclient(hunting): my global_id is 4173 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c49ffb640 1 -- 10.20.193.174:0/3097196718 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c4c121c30 con 0x7f5c4c116560 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_done global_id 4198 payload 274 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c4b7fe640 1 -- 10.20.193.174:0/3097196718 >> v1:10.20.193.153:6789/0 conn(0x7f5c4c11a200 legacy=0x7f5c4c11c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c4b7fe640 1 -- 10.20.193.174:0/3097196718 >> v1:10.20.193.10:6789/0 conn(0x7f5c4c116560 legacy=0x7f5c4c116940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c4b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c4b7fe640 1 monclient: found mon.noname-b 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c4b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:06.892 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c4b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:06.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.890+0000 7f5c4b7fe640 1 -- 10.20.193.174:0/3097196718 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c122fb0 con 0x7f5c4c11de30 2026-02-17T11:54:06.893 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.891+0000 7f5c4b7fe640 1 --2- 10.20.193.174:0/3097196718 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c4c11de30 0x7f5c4c1202f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009d90 tx=0x7f5c3c02f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a161a9271fcc8d00 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 1 -- 10.20.193.174:0/3097196718 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c03c070 con 0x7f5c4c11de30 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 10 monclient: dump: 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 1 -- 10.20.193.174:0/3097196718 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c037440 con 0x7f5c4c11de30 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 5 monclient: authenticate success, global_id 4198 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 1 -- 10.20.193.174:0/3097196718 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c037810 con 0x7f5c4c11de30 2026-02-17T11:54:06.895 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 4 set_mon_vals no callback set 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c49ffb640 10 monclient: dump: 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.896 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 10 monclient: shutdown 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 1 -- 10.20.193.174:0/3097196718 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c4c11de30 msgr2=0x7f5c4c1202f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 1 --2- 10.20.193.174:0/3097196718 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c4c11de30 0x7f5c4c1202f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009d90 tx=0x7f5c3c02f1e0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 1 -- 10.20.193.174:0/3097196718 shutdown_connections 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 1 --2- 10.20.193.174:0/3097196718 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c4c11de30 0x7f5c4c1202f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 1 -- 10.20.193.174:0/3097196718 >> 10.20.193.174:0/3097196718 conn(0x7f5c4c06f950 msgr2=0x7f5c4c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 1 -- 10.20.193.174:0/3097196718 shutdown_connections 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 1 -- 10.20.193.174:0/3097196718 wait complete. 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 10 monclient: build_initial_monmap 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.893+0000 7f5c51a7d640 10 monclient: monmap: 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:06.897 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 librados: starting msgr at 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 librados: starting objecter 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 Processor -- start 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 -- start start 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 librados: setting wanted keys 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 librados: calling monclient init 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient: init 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c4c116560 0x7f5c4c070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient(hunting): picked mon.noname-b con 0x7f5c4c116560 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c4c11a200 0x7f5c4c070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient(hunting): picked mon.noname-c con 0x7f5c4c11a200 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c4c11de30 0x7f5c4c1acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient(hunting): picked mon.noname-a con 0x7f5c4c11de30 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1210a0 con 0x7f5c4c11de30 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c120f20 con 0x7f5c4c116560 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c121220 con 0x7f5c4c11a200 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c51a7d640 10 monclient(hunting): authenticate will time out at 921.532327s 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4b7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c4c11de30 0x7f5c4c1acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4a7fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c4c11a200 0x7f5c4c070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4affd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c4c116560 0x7f5c4c070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4b7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c4c11de30 0x7f5c4c1acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.174:41944/0 (socket says 10.20.193.174:41944) 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4b7fe640 1 -- 10.20.193.174:0/917651887 learned_addr learned my addr 10.20.193.174:0/917651887 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4b7fe640 10 monclient(hunting): get_auth_request con 0x7f5c4c11de30 auth_method 0 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4affd640 10 monclient(hunting): get_auth_request con 0x7f5c4c116560 auth_method 0 2026-02-17T11:54:06.898 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4a7fc640 10 monclient(hunting): get_auth_request con 0x7f5c4c11a200 auth_method 0 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.894+0000 7f5c4a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.895+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.895+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.895+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.895+0000 7f5c4a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.895+0000 7f5c4a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.895+0000 7f5c4a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.895+0000 7f5c4affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.895+0000 7f5c4affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.895+0000 7f5c4affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 10 monclient(hunting): handle_auth_done global_id 4190 payload 824 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 1 -- 10.20.193.174:0/917651887 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c4c116560 msgr2=0x7f5c4c070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c4c116560 0x7f5c4c070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 1 -- 10.20.193.174:0/917651887 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c4c11de30 msgr2=0x7f5c4c1acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c4c11de30 0x7f5c4c1acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 1 monclient: found mon.noname-c 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.896+0000 7f5c4a7fc640 1 -- 10.20.193.174:0/917651887 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c1ad5c0 con 0x7f5c4c11a200 2026-02-17T11:54:06.899 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.897+0000 7f5c4a7fc640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c4c11a200 0x7f5c4c070db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c4d0 tx=0x7f5c3400c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:06.900 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.897+0000 7f5c23fff640 10 client.?.objecter ms_handle_connect 0x7f5c4c11a200 2026-02-17T11:54:06.900 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.897+0000 7f5c23fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 1 -- 10.20.193.174:0/917651887 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34017070 con 0x7f5c4c11a200 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 10 monclient: dump: 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 1 -- 10.20.193.174:0/917651887 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c34005de0 con 0x7f5c4c11a200 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 1 -- 10.20.193.174:0/917651887 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34007270 con 0x7f5c4c11a200 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 5 monclient: authenticate success, global_id 4190 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 10 monclient: _renew_subs 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c1ad850 con 0x7f5c4c11a200 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c497fa640 4 set_mon_vals no callback set 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c23fff640 10 monclient: dump: 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:06.902 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 10 client.4190.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 10 monclient: _renew_subs 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c1adda0 con 0x7f5c4c11a200 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 1 librados: init done 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:06.903 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.899+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4c121680 con 0x7f5c4c11a200 2026-02-17T11:54:06.912 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.910+0000 7f5c23fff640 1 -- 10.20.193.174:0/917651887 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f5c34007410 con 0x7f5c4c11a200 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c23fff640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c1c078dc0 0x7f5c1c07b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c4affd640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c1c078dc0 0x7f5c1c07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c4affd640 10 monclient: get_auth_request con 0x7f5c1c078dc0 auth_method 0 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c23fff640 1 -- 10.20.193.174:0/917651887 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2335+0+0 (secure 0 0 0) 0x7f5c34007730 con 0x7f5c4c11a200 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c23fff640 10 client.4190.objecter ms_dispatch2 0x7f5c4c000b90 osd_map(16..16 src has 1..16) 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c23fff640 3 client.4190.objecter handle_osd_map got epochs [16,16] > 0 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c23fff640 3 client.4190.objecter handle_osd_map decoding full epoch 16 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c23fff640 20 client.4190.objecter dump_active .. 0 homeless 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c23fff640 10 client.4190.objecter ms_handle_connect 0x7f5c1c078dc0 2026-02-17T11:54:06.913 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:06.911+0000 7f5c4affd640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c1c078dc0 0x7f5c1c07b280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5c40007fd0 tx=0x7f5c40003d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:07.018 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.015+0000 7f5c23fff640 1 -- 10.20.193.174:0/917651887 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5c34022080 con 0x7f5c4c11a200 2026-02-17T11:54:07.018 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.015+0000 7f5c23fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:07.018 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.015+0000 7f5c23fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:07.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.102+0000 7f5c51a7d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ac2266e7-8a26-458a-b92f-ce0ffe2653eb", "id": 14}] 2026-02-17T11:54:07.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.103+0000 7f5c51a7d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ac2266e7-8a26-458a-b92f-ce0ffe2653eb", "id": 14}] 2026-02-17T11:54:07.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.103+0000 7f5c51a7d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:07.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.103+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ac2266e7-8a26-458a-b92f-ce0ffe2653eb", "id": 14} v 0) -- 0x7f5c4c1ae060 con 0x7f5c4c11a200 2026-02-17T11:54:07.151 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c23fff640 1 -- 10.20.193.174:0/917651887 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac2266e7-8a26-458a-b92f-ce0ffe2653eb", "id": 14}]=0 v17) ==== 113+0+3 (secure 0 0 0) 0x7f5c4c1ae060 con 0x7f5c4c11a200 2026-02-17T11:54:07.151 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c23fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ac2266e7-8a26-458a-b92f-ce0ffe2653eb", "id": 14}] 2026-02-17T11:54:07.151 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c23fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:07.151 INFO:teuthology.orchestra.run.trial174.stdout:14 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 10 librados: watch_flush enter 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 10 librados: watch_flush exit 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 20 client.4190.objecter shutdown clearing up homeless session... 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 10 client.4190.objecter successfully canceled tick 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c1c078dc0 msgr2=0x7f5c1c07b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c1c078dc0 0x7f5c1c07b280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5c40007fd0 tx=0x7f5c40003d90 comp rx=0 tx=0).stop 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 10 monclient: shutdown 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c4c11a200 msgr2=0x7f5c4c070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c4c11a200 0x7f5c4c070db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c4d0 tx=0x7f5c3400c9a0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 shutdown_connections 2026-02-17T11:54:07.153 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c1c078dc0 0x7f5c1c07b280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.154 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c4c11de30 0x7f5c4c1acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.154 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c4c11a200 0x7f5c4c070db0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.154 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 --2- 10.20.193.174:0/917651887 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c4c116560 0x7f5c4c070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.154 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 >> 10.20.193.174:0/917651887 conn(0x7f5c4c06f950 msgr2=0x7f5c4c115290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:07.154 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 shutdown_connections 2026-02-17T11:54:07.154 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 -- 10.20.193.174:0/917651887 wait complete. 2026-02-17T11:54:07.154 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.150+0000 7f5c51a7d640 1 librados: shutdown 2026-02-17T11:54:07.159 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 8c03b537-2fae-4904-8422-b083b92f2dfb 15 2026-02-17T11:54:07.224 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.222+0000 7f8b2b5e7640 10 monclient: get_monmap_and_config 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.222+0000 7f8b2b5e7640 10 monclient: build_initial_monmap 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.222+0000 7f8b2b5e7640 10 monclient: monmap: 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:54:07.224216+0000 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:54:07.224216+0000 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:07.225 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:07.226 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 1 Processor -- start 2026-02-17T11:54:07.226 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 1 -- start start 2026-02-17T11:54:07.226 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient: init 2026-02-17T11:54:07.226 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient: _add_conns ranks=[4,0,3,5,2,1] 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8b24073b20 0x7f8b24073f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient(hunting): picked mon.noname-b con 0x7f8b24073b20 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8b241184b0 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8b24119070 0x7f8b24120590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient(hunting): picked mon.noname-a con 0x7f8b24119070 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b24120ad0 con 0x7f8b241184b0 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f8b24121cb0 con 0x7f8b24119070 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8b24121e30 con 0x7f8b24073b20 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2b5e7640 10 monclient(hunting): authenticate will time out at 921.861472s 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b29b5d640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8b24119070 0x7f8b24120590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.223+0000 7f8b2935c640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8b24073b20 0x7f8b24073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b2935c640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8b24073b20 0x7f8b24073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37250/0 (socket says 10.20.193.174:37250) 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b2935c640 1 -- 10.20.193.174:0/4119969789 learned_addr learned my addr 10.20.193.174:0/4119969789 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b2935c640 10 monclient(hunting): get_auth_request con 0x7f8b24073b20 auth_method 0 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b2935c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b2935c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b2935c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b29b5d640 10 monclient(hunting): get_auth_request con 0x7f8b24119070 auth_method 0 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b29b5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b29b5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b29b5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b2935c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b2935c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b2935c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b29b5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:07.227 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b29b5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.224+0000 7f8b29b5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.225+0000 7f8b2935c640 10 monclient(hunting): handle_auth_done global_id 4204 payload 274 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.225+0000 7f8b2935c640 1 -- 10.20.193.174:0/4119969789 >> v2:10.20.193.10:3300/0 conn(0x7f8b24119070 msgr2=0x7f8b24120590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.225+0000 7f8b2935c640 1 --2- 10.20.193.174:0/4119969789 >> v2:10.20.193.10:3300/0 conn(0x7f8b24119070 0x7f8b24120590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.225+0000 7f8b2935c640 1 -- 10.20.193.174:0/4119969789 >> v1:10.20.193.10:6789/0 conn(0x7f8b241184b0 legacy=0x7f8b24118960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.225+0000 7f8b2935c640 10 monclient: _finish_hunting 0 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.225+0000 7f8b2935c640 1 monclient: found mon.noname-b 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.225+0000 7f8b2935c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.225+0000 7f8b2935c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.225+0000 7f8b2935c640 1 -- 10.20.193.174:0/4119969789 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b24121fb0 con 0x7f8b24073b20 2026-02-17T11:54:07.228 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.226+0000 7f8b2935c640 1 --2- 10.20.193.174:0/4119969789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b24073b20 0x7f8b24073f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8b2406b700 tx=0x7f8b1402ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828d84d3a7e2f118 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.227+0000 7f8b13fff640 1 -- 10.20.193.174:0/4119969789 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1403c070 con 0x7f8b24073b20 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.227+0000 7f8b13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.227+0000 7f8b13fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 10 monclient: dump: 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:07.230 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 5 monclient: authenticate success, global_id 4204 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 1 -- 10.20.193.174:0/4119969789 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1402fb30 con 0x7f8b24073b20 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 1 -- 10.20.193.174:0/4119969789 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14037440 con 0x7f8b24073b20 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 4 set_mon_vals no callback set 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b13fff640 10 monclient: dump: 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 10 monclient: shutdown 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/4119969789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b24073b20 msgr2=0x7f8b24073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 --2- 10.20.193.174:0/4119969789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b24073b20 0x7f8b24073f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8b2406b700 tx=0x7f8b1402ee60 comp rx=0 tx=0).stop 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/4119969789 shutdown_connections 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 --2- 10.20.193.174:0/4119969789 >> v2:10.20.193.10:3300/0 conn(0x7f8b24119070 0x7f8b24120590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 --2- 10.20.193.174:0/4119969789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b24073b20 0x7f8b24073f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/4119969789 >> 10.20.193.174:0/4119969789 conn(0x7f8b2406f950 msgr2=0x7f8b24071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:07.231 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/4119969789 shutdown_connections 2026-02-17T11:54:07.232 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/4119969789 wait complete. 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 10 monclient: build_initial_monmap 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 10 monclient: monmap: 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:07.233 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 librados: starting msgr at 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 librados: starting objecter 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 Processor -- start 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 -- start start 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 librados: setting wanted keys 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 librados: calling monclient init 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 10 monclient: init 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8b24073b20 0x7f8b24119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 10 monclient(hunting): picked mon.noname-a con 0x7f8b24073b20 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b241184b0 0x7f8b24119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 10 monclient(hunting): picked mon.noname-b con 0x7f8b241184b0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.228+0000 7f8b2b5e7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8b24119070 0x7f8b2411a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2b5e7640 10 monclient(hunting): picked mon.noname-c con 0x7f8b24119070 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2b5e7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2b5e7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24121160 con 0x7f8b24073b20 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2b5e7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2b5e7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24120fe0 con 0x7f8b241184b0 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2b5e7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2b5e7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241212e0 con 0x7f8b24119070 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2b5e7640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2b5e7640 10 monclient(hunting): authenticate will time out at 921.867020s 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2935c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8b24073b20 0x7f8b24119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b241184b0 0x7f8b24119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b29b5d640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8b24119070 0x7f8b2411a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b241184b0 0x7f8b24119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.174:37258/0 (socket says 10.20.193.174:37258) 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 1 -- 10.20.193.174:0/3782712798 learned_addr learned my addr 10.20.193.174:0/3782712798 (peer_addr_for_me v2:10.20.193.174:0/0) 2026-02-17T11:54:07.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 10 monclient(hunting): get_auth_request con 0x7f8b241184b0 auth_method 0 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2935c640 10 monclient(hunting): get_auth_request con 0x7f8b24073b20 auth_method 0 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2935c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2935c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2935c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b29b5d640 10 monclient(hunting): get_auth_request con 0x7f8b24119070 auth_method 0 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b29b5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b29b5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b29b5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b28b5b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2935c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2935c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.229+0000 7f8b2935c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.230+0000 7f8b29b5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.230+0000 7f8b29b5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.230+0000 7f8b29b5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 10 monclient(hunting): handle_auth_done global_id 4207 payload 824 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 1 -- 10.20.193.174:0/3782712798 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8b24119070 msgr2=0x7f8b2411a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8b24119070 0x7f8b2411a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 1 -- 10.20.193.174:0/3782712798 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8b24073b20 msgr2=0x7f8b24119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8b24073b20 0x7f8b24119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 10 monclient: _finish_hunting 0 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 1 monclient: found mon.noname-b 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:07.235 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.231+0000 7f8b28b5b640 1 -- 10.20.193.174:0/3782712798 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b241bc190 con 0x7f8b241184b0 2026-02-17T11:54:07.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.232+0000 7f8b28b5b640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b241184b0 0x7f8b24119ad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c580 tx=0x7f8b1800ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:07.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.232+0000 7f8b11ffb640 10 client.?.objecter ms_handle_connect 0x7f8b241184b0 2026-02-17T11:54:07.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.232+0000 7f8b11ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 1 -- 10.20.193.174:0/3782712798 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18017070 con 0x7f8b241184b0 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 10 monclient: dump: 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b2b5e7640 5 monclient: authenticate success, global_id 4207 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b2b5e7640 10 monclient: _renew_subs 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b2b5e7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b241bc420 con 0x7f8b241184b0 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b2b5e7640 10 client.4207.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b2b5e7640 10 monclient: _renew_subs 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b2b5e7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b241bc9c0 con 0x7f8b241184b0 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b2b5e7640 1 librados: init done 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 1 -- 10.20.193.174:0/3782712798 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b180052d0 con 0x7f8b241184b0 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 1 -- 10.20.193.174:0/3782712798 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b180036b0 con 0x7f8b241184b0 2026-02-17T11:54:07.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b11ffb640 10 monclient: dump: 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.233+0000 7f8b137fe640 4 set_mon_vals no callback set 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.234+0000 7f8b2b5e7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.234+0000 7f8b2b5e7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.234+0000 7f8b2b5e7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:07.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.234+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b24073f00 con 0x7f8b241184b0 2026-02-17T11:54:07.246 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.244+0000 7f8b11ffb640 1 -- 10.20.193.174:0/3782712798 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f8b18003850 con 0x7f8b241184b0 2026-02-17T11:54:07.247 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b11ffb640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8af4078da0 0x7f8af407b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.247 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b2935c640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8af4078da0 0x7f8af407b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.247 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b2935c640 10 monclient: get_auth_request con 0x7f8af4078da0 auth_method 0 2026-02-17T11:54:07.247 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b2935c640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8af4078da0 0x7f8af407b260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8b14039000 tx=0x7f8b14033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:07.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b11ffb640 10 client.4207.objecter ms_handle_connect 0x7f8af4078da0 2026-02-17T11:54:07.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b11ffb640 1 -- 10.20.193.174:0/3782712798 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2450+0+0 (secure 0 0 0) 0x7f8b1805d3b0 con 0x7f8b241184b0 2026-02-17T11:54:07.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b11ffb640 10 client.4207.objecter ms_dispatch2 0x7f8b24000b90 osd_map(17..17 src has 1..17) 2026-02-17T11:54:07.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b11ffb640 3 client.4207.objecter handle_osd_map got epochs [17,17] > 0 2026-02-17T11:54:07.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b11ffb640 3 client.4207.objecter handle_osd_map decoding full epoch 17 2026-02-17T11:54:07.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.245+0000 7f8b11ffb640 20 client.4207.objecter dump_active .. 0 homeless 2026-02-17T11:54:07.345 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.343+0000 7f8b11ffb640 1 -- 10.20.193.174:0/3782712798 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8b18022020 con 0x7f8b241184b0 2026-02-17T11:54:07.345 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.343+0000 7f8b11ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:07.345 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.343+0000 7f8b11ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:07.433 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.431+0000 7f8b2b5e7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8c03b537-2fae-4904-8422-b083b92f2dfb", "id": 15}] 2026-02-17T11:54:07.434 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.431+0000 7f8b2b5e7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8c03b537-2fae-4904-8422-b083b92f2dfb", "id": 15}] 2026-02-17T11:54:07.434 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.431+0000 7f8b2b5e7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:07.434 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.431+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c03b537-2fae-4904-8422-b083b92f2dfb", "id": 15} v 0) -- 0x7f8b2411fb60 con 0x7f8b241184b0 2026-02-17T11:54:07.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.481+0000 7f8b11ffb640 1 -- 10.20.193.174:0/3782712798 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c03b537-2fae-4904-8422-b083b92f2dfb", "id": 15}]=0 v18) ==== 113+0+3 (secure 0 0 0) 0x7f8b18061370 con 0x7f8b241184b0 2026-02-17T11:54:07.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.481+0000 7f8b11ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8c03b537-2fae-4904-8422-b083b92f2dfb", "id": 15}] 2026-02-17T11:54:07.483 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.481+0000 7f8b11ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:07.483 INFO:teuthology.orchestra.run.trial174.stdout:15 2026-02-17T11:54:07.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.481+0000 7f8b2b5e7640 10 librados: watch_flush enter 2026-02-17T11:54:07.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.481+0000 7f8b2b5e7640 10 librados: watch_flush exit 2026-02-17T11:54:07.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.481+0000 7f8b2b5e7640 20 client.4207.objecter shutdown clearing up homeless session... 2026-02-17T11:54:07.485 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.481+0000 7f8b2b5e7640 10 client.4207.objecter successfully canceled tick 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8af4078da0 msgr2=0x7f8af407b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8af4078da0 0x7f8af407b260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8b14039000 tx=0x7f8b14033000 comp rx=0 tx=0).stop 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 10 monclient: shutdown 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b241184b0 msgr2=0x7f8b24119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b241184b0 0x7f8b24119ad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c580 tx=0x7f8b1800ca50 comp rx=0 tx=0).stop 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 shutdown_connections 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8af4078da0 0x7f8af407b260 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8b24119070 0x7f8b2411a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8b241184b0 0x7f8b24119ad0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.486 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 --2- 10.20.193.174:0/3782712798 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8b24073b20 0x7f8b24119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.487 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 >> 10.20.193.174:0/3782712798 conn(0x7f8b2406f950 msgr2=0x7f8b24072750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:07.487 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 shutdown_connections 2026-02-17T11:54:07.487 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 -- 10.20.193.174:0/3782712798 wait complete. 2026-02-17T11:54:07.487 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-17T11:54:07.482+0000 7f8b2b5e7640 1 librados: shutdown 2026-02-17T11:54:07.493 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.493 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T11:54:07.494 DEBUG:teuthology.orchestra.run.trial010:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-17T11:54:07.496 INFO:tasks.ceph.osd.0:Started 2026-02-17T11:54:07.496 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.497 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-17T11:54:07.497 DEBUG:teuthology.orchestra.run.trial010:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-17T11:54:07.499 INFO:tasks.ceph.osd.4:Started 2026-02-17T11:54:07.499 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.499 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-17T11:54:07.500 DEBUG:teuthology.orchestra.run.trial010:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-17T11:54:07.502 INFO:tasks.ceph.osd.8:Started 2026-02-17T11:54:07.502 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.502 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-17T11:54:07.502 DEBUG:teuthology.orchestra.run.trial010:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-17T11:54:07.505 INFO:tasks.ceph.osd.12:Started 2026-02-17T11:54:07.505 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.505 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T11:54:07.506 DEBUG:teuthology.orchestra.run.trial071:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-17T11:54:07.508 INFO:tasks.ceph.osd.1:Started 2026-02-17T11:54:07.508 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.508 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-17T11:54:07.509 DEBUG:teuthology.orchestra.run.trial071:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-17T11:54:07.511 INFO:tasks.ceph.osd.5:Started 2026-02-17T11:54:07.511 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.511 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-17T11:54:07.511 DEBUG:teuthology.orchestra.run.trial071:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-17T11:54:07.513 INFO:tasks.ceph.osd.9:Started 2026-02-17T11:54:07.514 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.514 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-17T11:54:07.514 DEBUG:teuthology.orchestra.run.trial071:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-17T11:54:07.583 INFO:tasks.ceph.osd.13:Started 2026-02-17T11:54:07.583 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.583 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T11:54:07.583 DEBUG:teuthology.orchestra.run.trial153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-17T11:54:07.585 INFO:tasks.ceph.osd.2:Started 2026-02-17T11:54:07.585 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.585 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-17T11:54:07.585 DEBUG:teuthology.orchestra.run.trial153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-17T11:54:07.587 INFO:tasks.ceph.osd.6:Started 2026-02-17T11:54:07.587 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.587 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-17T11:54:07.587 DEBUG:teuthology.orchestra.run.trial153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-17T11:54:07.588 INFO:tasks.ceph.osd.10:Started 2026-02-17T11:54:07.588 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.588 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-17T11:54:07.588 DEBUG:teuthology.orchestra.run.trial153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-17T11:54:07.589 INFO:tasks.ceph.osd.14:Started 2026-02-17T11:54:07.589 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.590 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T11:54:07.590 DEBUG:teuthology.orchestra.run.trial174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-17T11:54:07.591 INFO:tasks.ceph.osd.3:Started 2026-02-17T11:54:07.591 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.591 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-17T11:54:07.591 DEBUG:teuthology.orchestra.run.trial174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-17T11:54:07.592 INFO:tasks.ceph.osd.7:Started 2026-02-17T11:54:07.592 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.593 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-17T11:54:07.593 DEBUG:teuthology.orchestra.run.trial174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-17T11:54:07.594 INFO:tasks.ceph.osd.11:Started 2026-02-17T11:54:07.594 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:54:07.594 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-17T11:54:07.594 DEBUG:teuthology.orchestra.run.trial174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-17T11:54:07.595 INFO:tasks.ceph.osd.15:Started 2026-02-17T11:54:07.595 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:07.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.664+0000 7fbb24254640 10 monclient: get_monmap_and_config 2026-02-17T11:54:07.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.664+0000 7fbb24254640 10 monclient: build_initial_monmap 2026-02-17T11:54:07.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.664+0000 7fbb24254640 10 monclient: monmap: 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:54:07.665008+0000 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:54:07.665008+0000 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 1 Processor -- start 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 1 -- start start 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 10 monclient: init 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 10 monclient: _add_conns ranks=[2,0,4,1,3,5] 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbb1c155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:07.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbb1c074cd0 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fbb1c156260 0x7fbb1c166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 10 monclient(hunting): picked mon.noname-b con 0x7fbb1c156260 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c073520 con 0x7fbb1c074cd0 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c073800 con 0x7fbb1c155e80 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c0cd840 con 0x7fbb1c156260 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.665+0000 7fbb24254640 10 monclient(hunting): authenticate will time out at 917.386928s 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.666+0000 7fbb217c8640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fbb1c074cd0 0x7fbb1c0ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:59362/0 (socket says 10.20.193.10:59362) 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.666+0000 7fbb217c8640 1 -- 10.20.193.10:0/1493409330 learned_addr learned my addr 10.20.193.10:0/1493409330 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.666+0000 7fbb227ca640 1 --2- 10.20.193.10:0/1493409330 >> v2:10.20.193.71:3300/0 conn(0x7fbb1c156260 0x7fbb1c166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.666+0000 7fbb227ca640 10 monclient(hunting): get_auth_request con 0x7fbb1c156260 auth_method 0 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.666+0000 7fbb227ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.666+0000 7fbb227ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.666+0000 7fbb227ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.667+0000 7fbb227ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:07.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.667+0000 7fbb227ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:07.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.667+0000 7fbb227ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:07.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.667+0000 7fbb20fc7640 1 -- 10.20.193.10:0/1493409330 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953706003 0 0) 0x7fbb1c073520 con 0x7fbb1c074cd0 2026-02-17T11:54:07.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.667+0000 7fbb20fc7640 10 monclient(hunting): _negotiate 2026-02-17T11:54:07.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.667+0000 7fbb20fc7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.667+0000 7fbb20fc7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.667+0000 7fbb20fc7640 10 monclient(hunting): my global_id is 4185 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.667+0000 7fbb20fc7640 1 -- 10.20.193.10:0/1493409330 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb04003620 con 0x7fbb1c074cd0 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb20fc7640 1 -- 10.20.193.10:0/1493409330 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31433373 0 0) 0x7fbb1c073800 con 0x7fbb1c155e80 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb20fc7640 10 monclient(hunting): _negotiate 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb20fc7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb20fc7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb20fc7640 10 monclient(hunting): my global_id is 4196 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb20fc7640 1 -- 10.20.193.10:0/1493409330 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb1c073520 con 0x7fbb1c155e80 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb227ca640 10 monclient(hunting): handle_auth_done global_id 4210 payload 274 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb227ca640 1 -- 10.20.193.10:0/1493409330 >> v1:10.20.193.153:6789/0 conn(0x7fbb1c155e80 legacy=0x7fbb1c0745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb227ca640 1 -- 10.20.193.10:0/1493409330 >> v1:10.20.193.10:6789/0 conn(0x7fbb1c074cd0 legacy=0x7fbb1c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb227ca640 10 monclient: _finish_hunting 0 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb227ca640 1 monclient: found mon.noname-b 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb227ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb227ca640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.668+0000 7fbb227ca640 1 -- 10.20.193.10:0/1493409330 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c073ae0 con 0x7fbb1c156260 2026-02-17T11:54:07.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.669+0000 7fbb227ca640 1 --2- 10.20.193.10:0/1493409330 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 0x7fbb1c166710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009d90 tx=0x7fbb1802f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=862fe5a4cc5de43c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:07.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.670+0000 7fbb20fc7640 1 -- 10.20.193.10:0/1493409330 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1803c070 con 0x7fbb1c156260 2026-02-17T11:54:07.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.670+0000 7fbb20fc7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:07.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.670+0000 7fbb20fc7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:07.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.670+0000 7fbb20fc7640 10 monclient: dump: 2026-02-17T11:54:07.671 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:54:07.671 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.671 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.671 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.671 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.670+0000 7fbb20fc7640 10 monclient: _finish_auth 0 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.670+0000 7fbb20fc7640 10 monclient: _check_auth_tickets 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.670+0000 7fbb20fc7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 5 monclient: authenticate success, global_id 4210 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb20fc7640 1 -- 10.20.193.10:0/1493409330 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb18037440 con 0x7fbb1c156260 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb20fc7640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:07.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb20fc7640 1 -- 10.20.193.10:0/1493409330 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb180377f0 con 0x7fbb1c156260 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb20fc7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb20fc7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb20fc7640 10 monclient: dump: 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 4 set_mon_vals no callback set 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 10 monclient: shutdown 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 1 -- 10.20.193.10:0/1493409330 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 msgr2=0x7fbb1c166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 1 --2- 10.20.193.10:0/1493409330 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 0x7fbb1c166710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009d90 tx=0x7fbb1802f230 comp rx=0 tx=0).stop 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 1 -- 10.20.193.10:0/1493409330 shutdown_connections 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 1 --2- 10.20.193.10:0/1493409330 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 0x7fbb1c166710 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 1 -- 10.20.193.10:0/1493409330 >> 10.20.193.10:0/1493409330 conn(0x7fbb1c0ce2b0 msgr2=0x7fbb1c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 1 -- 10.20.193.10:0/1493409330 shutdown_connections 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.671+0000 7fbb24254640 1 -- 10.20.193.10:0/1493409330 wait complete. 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 10 monclient: build_initial_monmap 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 10 monclient: monmap: 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:07.673 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 1 librados: starting msgr at 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 1 librados: starting objecter 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 1 Processor -- start 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 1 -- start start 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 1 librados: setting wanted keys 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 1 librados: calling monclient init 2026-02-17T11:54:07.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 10 monclient: init 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbb1c074cd0 0x7fbb1c147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.672+0000 7fbb24254640 10 monclient(hunting): picked mon.noname-c con 0x7fbb1c074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbb1c155e80 0x7fbb1c156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 10 monclient(hunting): picked mon.noname-a con 0x7fbb1c155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 0x7fbb1c1f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 10 monclient(hunting): picked mon.noname-b con 0x7fbb1c156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c0c4870 con 0x7fbb1c155e80 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c0740a0 con 0x7fbb1c156260 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c0c49f0 con 0x7fbb1c074cd0 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb24254640 10 monclient(hunting): authenticate will time out at 917.394029s 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb21fc9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbb1c074cd0 0x7fbb1c147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 0x7fbb1c1f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 0x7fbb1c1f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:54940/0 (socket says 10.20.193.10:54940) 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 1 -- 10.20.193.10:0/1448437877 learned_addr learned my addr 10.20.193.10:0/1448437877 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:07.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 10 monclient(hunting): get_auth_request con 0x7fbb1c156260 auth_method 0 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb21fc9640 10 monclient(hunting): get_auth_request con 0x7fbb1c074cd0 auth_method 0 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb21fc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb21fc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb21fc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb227ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb21fc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb21fc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.673+0000 7fbb21fc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 10 monclient(hunting): handle_auth_done global_id 4199 payload 824 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 1 -- 10.20.193.10:0/1448437877 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 msgr2=0x7fbb1c1f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 0x7fbb1c1f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 1 -- 10.20.193.10:0/1448437877 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbb1c155e80 msgr2=0x7fbb1c156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbb1c155e80 0x7fbb1c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 10 monclient: _finish_hunting 0 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 1 monclient: found mon.noname-c 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:07.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.675+0000 7fbb21fc9640 1 -- 10.20.193.10:0/1448437877 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c1e81c0 con 0x7fbb1c074cd0 2026-02-17T11:54:07.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.676+0000 7fbb21fc9640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbb1c074cd0 0x7fbb1c147220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c4d0 tx=0x7fbb0c00c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:07.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.676+0000 7fbb0a7fc640 10 client.?.objecter ms_handle_connect 0x7fbb1c074cd0 2026-02-17T11:54:07.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.676+0000 7fbb0a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 1 -- 10.20.193.10:0/1448437877 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0052d0 con 0x7fbb1c074cd0 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 10 monclient: dump: 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 1 -- 10.20.193.10:0/1448437877 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0c005470 con 0x7fbb1c074cd0 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 1 -- 10.20.193.10:0/1448437877 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c003930 con 0x7fbb1c074cd0 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 5 monclient: authenticate success, global_id 4199 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 10 monclient: _renew_subs 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0bfff640 4 set_mon_vals no callback set 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c1e84a0 con 0x7fbb1c074cd0 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:07.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb0a7fc640 10 monclient: dump: 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 10 client.4199.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 10 monclient: _renew_subs 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c1e8a60 con 0x7fbb1c074cd0 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 1 librados: init done 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:07.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.678+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c0745c0 con 0x7fbb1c074cd0 2026-02-17T11:54:07.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.690+0000 7fbb0a7fc640 1 -- 10.20.193.10:0/1448437877 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7fbb0c003ad0 con 0x7fbb1c074cd0 2026-02-17T11:54:07.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.691+0000 7fbb0a7fc640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbaf8078dc0 0x7fbaf807b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:07.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.691+0000 7fbb217c8640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbaf8078dc0 0x7fbaf807b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:07.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.691+0000 7fbb217c8640 10 monclient: get_auth_request con 0x7fbaf8078dc0 auth_method 0 2026-02-17T11:54:07.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.691+0000 7fbb217c8640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbaf8078dc0 0x7fbaf807b280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbb10005980 tx=0x7fbb100079f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:07.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.691+0000 7fbb0a7fc640 10 client.4199.objecter ms_handle_connect 0x7fbaf8078dc0 2026-02-17T11:54:07.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.796+0000 7fbb0a7fc640 1 -- 10.20.193.10:0/1448437877 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fbb0c05e070 con 0x7fbb1c074cd0 2026-02-17T11:54:07.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.796+0000 7fbb0a7fc640 10 client.4199.objecter ms_dispatch2 0x7fbb1c000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:54:07.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.796+0000 7fbb0a7fc640 3 client.4199.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:54:07.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.796+0000 7fbb0a7fc640 3 client.4199.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:54:07.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.796+0000 7fbb0a7fc640 20 client.4199.objecter dump_active .. 0 homeless 2026-02-17T11:54:07.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.796+0000 7fbb0a7fc640 1 -- 10.20.193.10:0/1448437877 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbb0c062730 con 0x7fbb1c074cd0 2026-02-17T11:54:07.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.796+0000 7fbb0a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:07.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.796+0000 7fbb0a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:07.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.879+0000 7fbb24254640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:07.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.879+0000 7fbb24254640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:07.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.879+0000 7fbb24254640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:07.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.879+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb1c1597b0 con 0x7fbb1c074cd0 2026-02-17T11:54:07.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.904+0000 7fbb0a7fc640 1 -- 10.20.193.10:0/1448437877 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fbb0c062030 con 0x7fbb1c074cd0 2026-02-17T11:54:07.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.904+0000 7fbb0a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:07.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.904+0000 7fbb0a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:07.906 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:54:07.906 INFO:teuthology.orchestra.run.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 10 librados: watch_flush enter 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 10 librados: watch_flush exit 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 20 client.4199.objecter shutdown clearing up homeless session... 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 10 client.4199.objecter successfully canceled tick 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbaf8078dc0 msgr2=0x7fbaf807b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbaf8078dc0 0x7fbaf807b280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbb10005980 tx=0x7fbb100079f0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 10 monclient: shutdown 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbb1c074cd0 msgr2=0x7fbb1c147220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbb1c074cd0 0x7fbb1c147220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c4d0 tx=0x7fbb0c00c9a0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 shutdown_connections 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbaf8078dc0 0x7fbaf807b280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbb1c156260 0x7fbb1c1f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbb1c155e80 0x7fbb1c156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 --2- 10.20.193.10:0/1448437877 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbb1c074cd0 0x7fbb1c147220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 >> 10.20.193.10:0/1448437877 conn(0x7fbb1c0ce2b0 msgr2=0x7fbb1c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 shutdown_connections 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 -- 10.20.193.10:0/1448437877 wait complete. 2026-02-17T11:54:07.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:54:07.907+0000 7fbb24254640 1 librados: shutdown 2026-02-17T11:54:07.919 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T11:54:07.919 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T11:54:09.530 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:09.593 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.592+0000 7efda36d1640 10 monclient: get_monmap_and_config 2026-02-17T11:54:09.593 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.592+0000 7efda36d1640 10 monclient: build_initial_monmap 2026-02-17T11:54:09.593 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.592+0000 7efda36d1640 10 monclient: monmap: 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:54:09.592408+0000 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:54:09.592408+0000 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:09.594 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:09.595 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:09.595 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.592+0000 7efda36d1640 1 Processor -- start 2026-02-17T11:54:09.595 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.592+0000 7efda36d1640 1 -- start start 2026-02-17T11:54:09.595 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.592+0000 7efda36d1640 10 monclient: init 2026-02-17T11:54:09.597 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:09.597 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 10 monclient: _add_conns ranks=[0,1,3,4,2,5] 2026-02-17T11:54:09.597 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efd9c1502e0 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:09.597 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7efd9c15c110 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7efd9c1506c0 0x7efd9c159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 10 monclient(hunting): picked mon.noname-a con 0x7efd9c1506c0 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c15a290 con 0x7efd9c1502e0 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c15a570 con 0x7efd9c15c110 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7efd9c15a070 con 0x7efd9c1506c0 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda36d1640 10 monclient(hunting): authenticate will time out at 919.314077s 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda1c47640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7efd9c1506c0 0x7efd9c159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda0c45640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7efd9c15c110 0x7efd9c06fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:54956/0 (socket says 10.20.193.10:54956) 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.593+0000 7efda0c45640 1 -- 10.20.193.10:0/462210365 learned_addr learned my addr 10.20.193.10:0/462210365 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:54:09.598 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.594+0000 7efda1c47640 10 monclient(hunting): get_auth_request con 0x7efd9c1506c0 auth_method 0 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.594+0000 7efda1c47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.594+0000 7efda1c47640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.594+0000 7efda1c47640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.594+0000 7efda1c47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.594+0000 7efda1c47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.594+0000 7efda1c47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.595+0000 7efd8bfff640 1 -- 10.20.193.10:0/462210365 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052545978 0 0) 0x7efd9c15a570 con 0x7efd9c15c110 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.595+0000 7efd8bfff640 10 monclient(hunting): _negotiate 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.595+0000 7efd8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.595+0000 7efd8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.595+0000 7efd8bfff640 10 monclient(hunting): my global_id is 4216 2026-02-17T11:54:09.599 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.595+0000 7efd8bfff640 1 -- 10.20.193.10:0/462210365 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd84003620 con 0x7efd9c15c110 2026-02-17T11:54:09.600 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.596+0000 7efda1c47640 10 monclient(hunting): handle_auth_done global_id 4188 payload 274 2026-02-17T11:54:09.600 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.596+0000 7efda1c47640 1 -- 10.20.193.10:0/462210365 >> v1:10.20.193.71:6789/0 conn(0x7efd9c15c110 legacy=0x7efd9c06fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:09.600 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.596+0000 7efda1c47640 1 -- 10.20.193.10:0/462210365 >> v1:10.20.193.10:6789/0 conn(0x7efd9c1502e0 legacy=0x7efd9c15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:09.600 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.596+0000 7efda1c47640 10 monclient: _finish_hunting 0 2026-02-17T11:54:09.600 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.596+0000 7efda1c47640 1 monclient: found mon.noname-a 2026-02-17T11:54:09.600 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.596+0000 7efda1c47640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:09.600 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.596+0000 7efda1c47640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:09.600 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.596+0000 7efda1c47640 1 -- 10.20.193.10:0/462210365 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c15a850 con 0x7efd9c1506c0 2026-02-17T11:54:09.601 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.598+0000 7efda1c47640 1 --2- 10.20.193.10:0/462210365 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 0x7efd9c159b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efd98009d90 tx=0x7efd9802f2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6650019e83f64482 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:09.605 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 1 -- 10.20.193.10:0/462210365 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9803c070 con 0x7efd9c1506c0 2026-02-17T11:54:09.605 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 10 monclient: dump: 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:09.606 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 10 monclient: _finish_auth 0 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 1 -- 10.20.193.10:0/462210365 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98037440 con 0x7efd9c1506c0 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efda36d1640 5 monclient: authenticate success, global_id 4188 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efda36d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efda36d1640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 1 -- 10.20.193.10:0/462210365 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98037810 con 0x7efd9c1506c0 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:09.607 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efda36d1640 4 set_mon_vals no callback set 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.600+0000 7efd8bfff640 10 monclient: dump: 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:09.608 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 10 monclient: shutdown 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 -- 10.20.193.10:0/462210365 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 msgr2=0x7efd9c159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 --2- 10.20.193.10:0/462210365 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 0x7efd9c159b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efd98009d90 tx=0x7efd9802f2c0 comp rx=0 tx=0).stop 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 -- 10.20.193.10:0/462210365 shutdown_connections 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 --2- 10.20.193.10:0/462210365 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 0x7efd9c159b30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 -- 10.20.193.10:0/462210365 >> 10.20.193.10:0/462210365 conn(0x7efd9c0cd5d0 msgr2=0x7efd9c0cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 -- 10.20.193.10:0/462210365 shutdown_connections 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 -- 10.20.193.10:0/462210365 wait complete. 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 10 monclient: build_initial_monmap 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 10 monclient: monmap: 2026-02-17T11:54:09.609 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 librados: starting msgr at 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 librados: starting objecter 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 Processor -- start 2026-02-17T11:54:09.610 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 -- start start 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 librados: setting wanted keys 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 1 librados: calling monclient init 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.601+0000 7efda36d1640 10 monclient: init 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efd9c1502e0 0x7efd9c0c0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient(hunting): picked mon.noname-b con 0x7efd9c1502e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 0x7efd9c0be590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient(hunting): picked mon.noname-a con 0x7efd9c1506c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efd9c15c110 0x7efd9c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient(hunting): picked mon.noname-c con 0x7efd9c15c110 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:09.611 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c15b4e0 con 0x7efd9c1506c0 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c15afb0 con 0x7efd9c1502e0 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c070280 con 0x7efd9c15c110 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda36d1640 10 monclient(hunting): authenticate will time out at 919.323398s 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda0c45640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 0x7efd9c0be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda1446640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efd9c1502e0 0x7efd9c0c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda0c45640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 0x7efd9c0be590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:54254/0 (socket says 10.20.193.10:54254) 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda0c45640 1 -- 10.20.193.10:0/2553861425 learned_addr learned my addr 10.20.193.10:0/2553861425 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:09.612 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda0c45640 10 monclient(hunting): get_auth_request con 0x7efd9c1506c0 auth_method 0 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda0c45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda0c45640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.602+0000 7efda0c45640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1c47640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efd9c15c110 0x7efd9c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1446640 10 monclient(hunting): get_auth_request con 0x7efd9c1502e0 auth_method 0 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1446640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1446640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1446640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda0c45640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda0c45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda0c45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:09.613 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1c47640 10 monclient(hunting): get_auth_request con 0x7efd9c15c110 auth_method 0 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1c47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1c47640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1c47640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1446640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1446640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1446640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1c47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1c47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.603+0000 7efda1c47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 10 monclient(hunting): handle_auth_done global_id 4219 payload 824 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 1 -- 10.20.193.10:0/2553861425 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efd9c15c110 msgr2=0x7efd9c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efd9c15c110 0x7efd9c156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 1 -- 10.20.193.10:0/2553861425 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 msgr2=0x7efd9c0be590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:09.614 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 0x7efd9c0be590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:09.615 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 10 monclient: _finish_hunting 0 2026-02-17T11:54:09.615 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 1 monclient: found mon.noname-b 2026-02-17T11:54:09.615 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:09.615 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:09.615 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.604+0000 7efda1446640 1 -- 10.20.193.10:0/2553861425 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c1554a0 con 0x7efd9c1502e0 2026-02-17T11:54:09.617 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.606+0000 7efda1446640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efd9c1502e0 0x7efd9c0c0750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00c4e0 tx=0x7efd8c00c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:09.617 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.606+0000 7efd89ffb640 10 client.?.objecter ms_handle_connect 0x7efd9c1502e0 2026-02-17T11:54:09.617 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.606+0000 7efd89ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:09.617 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 1 -- 10.20.193.10:0/2553861425 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0052d0 con 0x7efd9c1502e0 2026-02-17T11:54:09.617 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 10 monclient: dump: 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:09.618 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 5 monclient: authenticate success, global_id 4219 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 10 monclient: _renew_subs 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c0bee60 con 0x7efd9c1502e0 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 10 client.4219.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 10 monclient: _renew_subs 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:09.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c155a20 con 0x7efd9c1502e0 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 1 librados: init done 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 1 -- 10.20.193.10:0/2553861425 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd8c005470 con 0x7efd9c1502e0 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 1 -- 10.20.193.10:0/2553861425 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0038f0 con 0x7efd9c1502e0 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd89ffb640 10 monclient: dump: 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:09.620 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:09.621 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:09.621 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:09.621 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:09.621 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:09.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efd8b7fe640 4 set_mon_vals no callback set 2026-02-17T11:54:09.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.607+0000 7efda36d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:09.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.608+0000 7efda36d1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:09.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.608+0000 7efda36d1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:09.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.608+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c159b30 con 0x7efd9c1502e0 2026-02-17T11:54:09.715 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.714+0000 7efd89ffb640 1 -- 10.20.193.10:0/2553861425 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7efd8c003a90 con 0x7efd9c1502e0 2026-02-17T11:54:09.715 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.715+0000 7efd89ffb640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efd6c078da0 0x7efd6c07b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:09.716 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.715+0000 7efda0c45640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efd6c078da0 0x7efd6c07b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:09.716 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.715+0000 7efda0c45640 10 monclient: get_auth_request con 0x7efd6c078da0 auth_method 0 2026-02-17T11:54:09.716 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.715+0000 7efd89ffb640 10 client.4219.objecter ms_handle_connect 0x7efd6c078da0 2026-02-17T11:54:09.716 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.715+0000 7efda0c45640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efd6c078da0 0x7efd6c07b260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efd9c14d340 tx=0x7efd90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:09.724 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.723+0000 7efd89ffb640 1 -- 10.20.193.10:0/2553861425 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7efd8c097840 con 0x7efd9c1502e0 2026-02-17T11:54:09.724 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.723+0000 7efd89ffb640 10 client.4219.objecter ms_dispatch2 0x7efd9c000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:54:09.724 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.723+0000 7efd89ffb640 3 client.4219.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:54:09.724 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.723+0000 7efd89ffb640 3 client.4219.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:54:09.724 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.723+0000 7efd89ffb640 20 client.4219.objecter dump_active .. 0 homeless 2026-02-17T11:54:09.724 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.723+0000 7efd89ffb640 1 -- 10.20.193.10:0/2553861425 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efd8c061f60 con 0x7efd9c1502e0 2026-02-17T11:54:09.724 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.723+0000 7efd89ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:09.724 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.723+0000 7efd89ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:09.809 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.808+0000 7efda36d1640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:09.809 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.808+0000 7efda36d1640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:09.809 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.808+0000 7efda36d1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:54:09.809 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.808+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd9c14ed60 con 0x7efd9c1502e0 2026-02-17T11:54:09.836 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.836+0000 7efd89ffb640 1 -- 10.20.193.10:0/2553861425 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7efd8c066260 con 0x7efd9c1502e0 2026-02-17T11:54:09.836 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.836+0000 7efd89ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:09.836 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.836+0000 7efd89ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:09.837 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:54:09.837 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 10 librados: watch_flush enter 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 10 librados: watch_flush exit 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 20 client.4219.objecter shutdown clearing up homeless session... 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 10 client.4219.objecter successfully canceled tick 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efd6c078da0 msgr2=0x7efd6c07b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efd6c078da0 0x7efd6c07b260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efd9c14d340 tx=0x7efd90009040 comp rx=0 tx=0).stop 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 10 monclient: shutdown 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efd9c1502e0 msgr2=0x7efd9c0c0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efd9c1502e0 0x7efd9c0c0750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00c4e0 tx=0x7efd8c00c9b0 comp rx=0 tx=0).stop 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 shutdown_connections 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efd6c078da0 0x7efd6c07b260 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efd9c15c110 0x7efd9c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efd9c1506c0 0x7efd9c0be590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 --2- 10.20.193.10:0/2553861425 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efd9c1502e0 0x7efd9c0c0750 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 >> 10.20.193.10:0/2553861425 conn(0x7efd9c0cd5d0 msgr2=0x7efd9c15c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 shutdown_connections 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 -- 10.20.193.10:0/2553861425 wait complete. 2026-02-17T11:54:09.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:09.839+0000 7efda36d1640 1 librados: shutdown 2026-02-17T11:54:09.851 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:54:17.401 INFO:tasks.ceph.osd.8.trial010.stderr:--00:00:00:09.855 45104-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.456 INFO:tasks.ceph.osd.9.trial071.stderr:--00:00:00:09.897 44584-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.456 INFO:tasks.ceph.osd.1.trial071.stderr:--00:00:00:09.902 44582-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.461 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:17.514 INFO:tasks.ceph.osd.12.trial010.stderr:--00:00:00:09.963 45105-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.516 INFO:tasks.ceph.osd.4.trial010.stderr:--00:00:00:09.973 45103-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.523 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.521+0000 7fe8bf322640 10 monclient: get_monmap_and_config 2026-02-17T11:54:17.523 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.521+0000 7fe8bf322640 10 monclient: build_initial_monmap 2026-02-17T11:54:17.523 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.521+0000 7fe8bf322640 10 monclient: monmap: 2026-02-17T11:54:17.523 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:17.523 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:17.524 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:54:17.522283+0000 2026-02-17T11:54:17.524 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:54:17.522283+0000 2026-02-17T11:54:17.524 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:17.524 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:17.524 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:17.524 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:17.524 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:17.524 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:17.524 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:17.525 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:17.525 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:17.528 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.521+0000 7fe8bf322640 1 Processor -- start 2026-02-17T11:54:17.528 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.521+0000 7fe8bf322640 1 -- start start 2026-02-17T11:54:17.528 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.521+0000 7fe8bf322640 10 monclient: init 2026-02-17T11:54:17.528 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:17.528 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 10 monclient: _add_conns ranks=[4,1,5,0,3,2] 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fe8b8155de0 0x7fe8b80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 10 monclient(hunting): picked mon.noname-b con 0x7fe8b8155de0 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe8b81561c0 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fe8b80c97a0 0x7fe8b80c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 10 monclient(hunting): picked mon.noname-c con 0x7fe8b80c97a0 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8b80ca110 con 0x7fe8b81561c0 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe8b806c8b0 con 0x7fe8b8155de0 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe8b806cb00 con 0x7fe8b80c97a0 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:17.529 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bf322640 10 monclient(hunting): authenticate will time out at 927.244431s 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.522+0000 7fe8bd898640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fe8b80c97a0 0x7fe8b80c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd097640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fe8b8155de0 0x7fe8b80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd898640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fe8b80c97a0 0x7fe8b80c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35734/0 (socket says 10.20.193.10:35734) 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd898640 1 -- 10.20.193.10:0/2349869397 learned_addr learned my addr 10.20.193.10:0/2349869397 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd898640 10 monclient(hunting): get_auth_request con 0x7fe8b80c97a0 auth_method 0 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd898640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd898640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd898640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.530 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd097640 10 monclient(hunting): get_auth_request con 0x7fe8b8155de0 auth_method 0 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd097640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.523+0000 7fe8bd097640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd097640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd898640 10 monclient(hunting): handle_auth_done global_id 4205 payload 274 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd898640 1 -- 10.20.193.10:0/2349869397 >> v2:10.20.193.71:3300/0 conn(0x7fe8b8155de0 msgr2=0x7fe8b80cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd898640 1 --2- 10.20.193.10:0/2349869397 >> v2:10.20.193.71:3300/0 conn(0x7fe8b8155de0 0x7fe8b80cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd898640 1 -- 10.20.193.10:0/2349869397 >> v1:10.20.193.71:6789/0 conn(0x7fe8b81561c0 legacy=0x7fe8b806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd898640 10 monclient: _finish_hunting 0 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd898640 1 monclient: found mon.noname-c 2026-02-17T11:54:17.531 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd898640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:17.532 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd898640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:17.532 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.524+0000 7fe8bd898640 1 -- 10.20.193.10:0/2349869397 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b806cde0 con 0x7fe8b80c97a0 2026-02-17T11:54:17.532 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.526+0000 7fe8bd898640 1 --2- 10.20.193.10:0/2349869397 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b80c97a0 0x7fe8b80c9bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe8b806ca30 tx=0x7fe8b402f2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f794747b08886ca5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.526+0000 7fe8a7fff640 1 -- 10.20.193.10:0/2349869397 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b402fd60 con 0x7fe8b80c97a0 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.526+0000 7fe8a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 10 monclient: dump: 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:17.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8bf322640 5 monclient: authenticate success, global_id 4205 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8bf322640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 1 -- 10.20.193.10:0/2349869397 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b40373f0 con 0x7fe8b80c97a0 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 1 -- 10.20.193.10:0/2349869397 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40377c0 con 0x7fe8b80c97a0 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8a7fff640 10 monclient: dump: 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8bf322640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.527+0000 7fe8bf322640 4 set_mon_vals no callback set 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 10 monclient: shutdown 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 -- 10.20.193.10:0/2349869397 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b80c97a0 msgr2=0x7fe8b80c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 --2- 10.20.193.10:0/2349869397 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b80c97a0 0x7fe8b80c9bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe8b806ca30 tx=0x7fe8b402f2a0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 -- 10.20.193.10:0/2349869397 shutdown_connections 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 --2- 10.20.193.10:0/2349869397 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b80c97a0 0x7fe8b80c9bd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 --2- 10.20.193.10:0/2349869397 >> v2:10.20.193.71:3300/0 conn(0x7fe8b8155de0 0x7fe8b80cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 -- 10.20.193.10:0/2349869397 >> 10.20.193.10:0/2349869397 conn(0x7fe8b80d1990 msgr2=0x7fe8b80d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 -- 10.20.193.10:0/2349869397 shutdown_connections 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 -- 10.20.193.10:0/2349869397 wait complete. 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 10 monclient: build_initial_monmap 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 10 monclient: monmap: 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 librados: starting msgr at 2026-02-17T11:54:17.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 librados: starting objecter 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.528+0000 7fe8bf322640 1 Processor -- start 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 1 -- start start 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 1 librados: setting wanted keys 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 1 librados: calling monclient init 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient: init 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe8b80c97a0 0x7fe8b8141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient(hunting): picked mon.noname-a con 0x7fe8b80c97a0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b8155de0 0x7fe8b81f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient(hunting): picked mon.noname-c con 0x7fe8b8155de0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe8b81561c0 0x7fe8b81f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient(hunting): picked mon.noname-b con 0x7fe8b81561c0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b806d680 con 0x7fe8b80c97a0 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b806d3a0 con 0x7fe8b81561c0 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b80d26d0 con 0x7fe8b8155de0 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.529+0000 7fe8bf322640 10 monclient(hunting): authenticate will time out at 927.251585s 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b8155de0 0x7fe8b81f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd898640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe8b81561c0 0x7fe8b81f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd097640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe8b80c97a0 0x7fe8b8141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b8155de0 0x7fe8b81f66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35750/0 (socket says 10.20.193.10:35750) 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 1 -- 10.20.193.10:0/688887448 learned_addr learned my addr 10.20.193.10:0/688887448 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 10 monclient(hunting): get_auth_request con 0x7fe8b8155de0 auth_method 0 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd898640 10 monclient(hunting): get_auth_request con 0x7fe8b81561c0 auth_method 0 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd898640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd898640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd097640 10 monclient(hunting): get_auth_request con 0x7fe8b80c97a0 auth_method 0 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd097640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd097640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bc896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd898640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.539 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd097640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.530+0000 7fe8bd097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 10 monclient(hunting): handle_auth_done global_id 4208 payload 824 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 1 -- 10.20.193.10:0/688887448 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe8b81561c0 msgr2=0x7fe8b81f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe8b81561c0 0x7fe8b81f6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 1 -- 10.20.193.10:0/688887448 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe8b80c97a0 msgr2=0x7fe8b8141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe8b80c97a0 0x7fe8b8141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 10 monclient: _finish_hunting 0 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 1 monclient: found mon.noname-c 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:17.540 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.531+0000 7fe8bc896640 1 -- 10.20.193.10:0/688887448 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b81f5330 con 0x7fe8b8155de0 2026-02-17T11:54:17.540 INFO:tasks.ceph.osd.0.trial010.stderr:--00:00:00:09.990 45102-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.532+0000 7fe8bc896640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b8155de0 0x7fe8b81f66b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c520 tx=0x7fe8ac00c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.533+0000 7fe8a5ffb640 10 client.?.objecter ms_handle_connect 0x7fe8b8155de0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.533+0000 7fe8a5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 1 -- 10.20.193.10:0/688887448 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0052d0 con 0x7fe8b8155de0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 10 monclient: dump: 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 5 monclient: authenticate success, global_id 4208 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 10 monclient: _renew_subs 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b81f5610 con 0x7fe8b8155de0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 10 client.4208.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 10 monclient: _renew_subs 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b81f5bd0 con 0x7fe8b8155de0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 1 librados: init done 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 1 -- 10.20.193.10:0/688887448 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ac005470 con 0x7fe8b8155de0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 1 -- 10.20.193.10:0/688887448 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0038f0 con 0x7fe8b8155de0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a77fe640 4 set_mon_vals no callback set 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8a5ffb640 10 monclient: dump: 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:17.541 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.534+0000 7fe8bf322640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.535+0000 7fe8bf322640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.535+0000 7fe8bf322640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:17.542 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.535+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8b80c9bd0 con 0x7fe8b8155de0 2026-02-17T11:54:17.552 INFO:tasks.ceph.osd.11.trial174.stderr:--00:00:00:09.910 45096-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.568 INFO:tasks.ceph.osd.2.trial153.stderr:--00:00:00:09.936 44856-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.568 INFO:tasks.ceph.osd.14.trial153.stderr:--00:00:00:09.935 44857-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.569 INFO:tasks.ceph.osd.10.trial153.stderr:--00:00:00:09.934 44858-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.572 INFO:tasks.ceph.osd.6.trial153.stderr:--00:00:00:09.940 44855-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.619 INFO:tasks.ceph.osd.5.trial071.stderr:--00:00:00:10.063 44583-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.622 INFO:tasks.ceph.osd.13.trial071.stderr:--00:00:00:09.994 44611-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.654+0000 7fe8a5ffb640 1 -- 10.20.193.10:0/688887448 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7fe8ac003a90 con 0x7fe8b8155de0 2026-02-17T11:54:17.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.655+0000 7fe8a5ffb640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe888078d70 0x7fe88807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:17.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.655+0000 7fe8bd097640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe888078d70 0x7fe88807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:17.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.655+0000 7fe8bd097640 10 monclient: get_auth_request con 0x7fe888078d70 auth_method 0 2026-02-17T11:54:17.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.655+0000 7fe8bd097640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe888078d70 0x7fe88807b230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe8b81f1950 tx=0x7fe8a8009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:17.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.655+0000 7fe8a5ffb640 10 client.4208.objecter ms_handle_connect 0x7fe888078d70 2026-02-17T11:54:17.664 INFO:tasks.ceph.osd.3.trial174.stderr:--00:00:00:10.021 45094-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.665 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.662+0000 7fe8a5ffb640 1 -- 10.20.193.10:0/688887448 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fe8ac05e010 con 0x7fe8b8155de0 2026-02-17T11:54:17.665 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.662+0000 7fe8a5ffb640 10 client.4208.objecter ms_dispatch2 0x7fe8b8000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:54:17.665 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.662+0000 7fe8a5ffb640 3 client.4208.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:54:17.665 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.662+0000 7fe8a5ffb640 3 client.4208.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:54:17.665 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.662+0000 7fe8a5ffb640 20 client.4208.objecter dump_active .. 0 homeless 2026-02-17T11:54:17.665 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.662+0000 7fe8a5ffb640 1 -- 10.20.193.10:0/688887448 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe8ac061fd0 con 0x7fe8b8155de0 2026-02-17T11:54:17.665 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.662+0000 7fe8a5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:17.666 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.662+0000 7fe8a5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:17.666 INFO:tasks.ceph.osd.7.trial174.stderr:--00:00:00:10.023 45095-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.666 INFO:tasks.ceph.osd.15.trial174.stderr:--00:00:00:10.023 45097-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/82/ba3405bb5c990a0e0725db4eee14da2d7b2095.debug 2026-02-17T11:54:17.752 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.750+0000 7fe8bf322640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:17.752 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.750+0000 7fe8bf322640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:17.752 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.750+0000 7fe8bf322640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:17.752 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.750+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8b80d24b0 con 0x7fe8b8155de0 2026-02-17T11:54:17.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.761+0000 7fe8a5ffb640 1 -- 10.20.193.10:0/688887448 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fe8ac0662d0 con 0x7fe8b8155de0 2026-02-17T11:54:17.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.761+0000 7fe8a5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:17.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.761+0000 7fe8a5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:17.763 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:54:17.764 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:17.767 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 10 librados: watch_flush enter 2026-02-17T11:54:17.767 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 10 librados: watch_flush exit 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 20 client.4208.objecter shutdown clearing up homeless session... 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 10 client.4208.objecter successfully canceled tick 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe888078d70 msgr2=0x7fe88807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe888078d70 0x7fe88807b230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe8b81f1950 tx=0x7fe8a8009290 comp rx=0 tx=0).stop 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 10 monclient: shutdown 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b8155de0 msgr2=0x7fe8b81f66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b8155de0 0x7fe8b81f66b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c520 tx=0x7fe8ac00c9f0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 shutdown_connections 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe888078d70 0x7fe88807b230 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.768 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe8b81561c0 0x7fe8b81f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe8b8155de0 0x7fe8b81f66b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 --2- 10.20.193.10:0/688887448 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe8b80c97a0 0x7fe8b8141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:17.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 >> 10.20.193.10:0/688887448 conn(0x7fe8b80d1990 msgr2=0x7fe8b80d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:17.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 shutdown_connections 2026-02-17T11:54:17.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 -- 10.20.193.10:0/688887448 wait complete. 2026-02-17T11:54:17.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:17.764+0000 7fe8bf322640 1 librados: shutdown 2026-02-17T11:54:17.775 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:54:21.917 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:14.372 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:21.940 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:14.382 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:21.986 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:14.436 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:21.999 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:14.455 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.034 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:14.479 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.081 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:14.446 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.092 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:14.548 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.118 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:14.561 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.119 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:14.490 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.130 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:14.498 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.137 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:14.495 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.151 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:14.515 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.174 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:14.543 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.200 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:14.655 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.225 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:14.680 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.231 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:14.672 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.260 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:14.701 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.273 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:14.722 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.274 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:14.631 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.278 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:14.635 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.282 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:14.724 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.289 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:14.746 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.298 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:14.748 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.300 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:14.656 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.314 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:14.771 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.317 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:14.762 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.322 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:14.772 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.338 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:14.783 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.353 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:14.798 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.367 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:14.733 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.378 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:14.834 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.391 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:14.757 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.399 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:14.855 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.404 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:14.848 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.408 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:14.779 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.417 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:14.784 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.422 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:14.779 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.427 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:14.871 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.427 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:14.883 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.431 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:14.802 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.440 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:14.805 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.446 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:14.804 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.461 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:14.905 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.468 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:14.826 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.470 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:14.835 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.473 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:14.841 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.491 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:14.946 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.496 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:14.861 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.500 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:14.869 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.549 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:14.991 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.562 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:14.919 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.566 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:14.923 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.584 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:14.942 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.585 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:15.042 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.589 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:15.038 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.590 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:14.947 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.612 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:14.969 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.620 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:15.065 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.662 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:15.028 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.685 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:15.053 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.691 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:15.147 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.701 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:15.073 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.707 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:15.075 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.727 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:15.171 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.732 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:15.090 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.754 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:15.209 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.763 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:15.128 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.768 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:15.137 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.815 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:15.256 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.829 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:15.187 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.830 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:15.272 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.851 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:15.209 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.852 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:15.309 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.858 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:15.308 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.859 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:15.217 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.873 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:15.322 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.884 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:15.241 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.886 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:15.331 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.901 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:15.346 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.926 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:15.292 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.956 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:15.412 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.965 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:15.336 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.971 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:15.339 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.971 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:15.428 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:22.995 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:15.439 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.000 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:15.357 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.009 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:15.453 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.015 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:15.372 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.022 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:15.477 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.032 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:15.397 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.037 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:15.492 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.039 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:15.408 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.047 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:15.412 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.116 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:15.473 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.118 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:15.575 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.132 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:15.490 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.135 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:15.592 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.159 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:15.516 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.161 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:15.518 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.175 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:15.532 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.192 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:15.558 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.207 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:15.573 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.235 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:15.606 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.250 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:15.618 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.250 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:15.622 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.265 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:15.633 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.312 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:15.680 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.328 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:15.696 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.355 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:54:23.350+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.381 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:15.738 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.396 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:15.753 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.401 INFO:tasks.ceph.osd.12.trial010.stderr:2026-02-17T11:54:23.396+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.427 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:54:23.422+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.434 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:15.791 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.449 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:15.806 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:23.499 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:54:23.494+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.542 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-17T11:54:23.536+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.545 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:54:23.539+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.571 INFO:tasks.ceph.osd.8.trial010.stderr:2026-02-17T11:54:23.566+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.580 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:54:23.576+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.667 INFO:tasks.ceph.osd.0.trial010.stderr:2026-02-17T11:54:23.662+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.702 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-17T11:54:23.696+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.733 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:54:23.729+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.777 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:54:23.771+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.805 INFO:tasks.ceph.osd.2.trial153.stderr:2026-02-17T11:54:23.801+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.868 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:54:23.863+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.925 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:54:23.920+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:23.999 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-17T11:54:23.994+0000 77b7940 -1 Falling back to public interface 2026-02-17T11:54:25.382 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:25.447 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient: get_monmap_and_config 2026-02-17T11:54:25.447 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient: build_initial_monmap 2026-02-17T11:54:25.447 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient: monmap: 2026-02-17T11:54:25.447 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:54:25.446290+0000 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:54:25.446290+0000 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:25.448 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:25.449 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:25.449 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 1 Processor -- start 2026-02-17T11:54:25.449 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 1 -- start start 2026-02-17T11:54:25.449 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient: init 2026-02-17T11:54:25.451 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:25.451 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient: _add_conns ranks=[4,2,5,1,0,3] 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa4241502e0 0x7fa424159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient(hunting): picked mon.noname-b con 0x7fa4241502e0 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa4241506c0 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa42415c110 0x7fa42406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient(hunting): picked mon.noname-c con 0x7fa42415c110 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa42415a290 con 0x7fa4241506c0 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa42415a070 con 0x7fa4241502e0 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa42415afb0 con 0x7fa42415c110 2026-02-17T11:54:25.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.445+0000 7fa42b4b0640 10 monclient(hunting): authenticate will time out at 935.167983s 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429225640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa4241502e0 0x7fa424159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429a26640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa42415c110 0x7fa42406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429a26640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa42415c110 0x7fa42406fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:48902/0 (socket says 10.20.193.10:48902) 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429a26640 1 -- 10.20.193.10:0/2220773458 learned_addr learned my addr 10.20.193.10:0/2220773458 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429a26640 10 monclient(hunting): get_auth_request con 0x7fa42415c110 auth_method 0 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429a26640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429a26640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429225640 10 monclient(hunting): get_auth_request con 0x7fa4241502e0 auth_method 0 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429225640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:25.453 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429225640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.446+0000 7fa429225640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.447+0000 7fa429225640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.447+0000 7fa429225640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.447+0000 7fa429225640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.447+0000 7fa429a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.447+0000 7fa429a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.447+0000 7fa429a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.448+0000 7fa429225640 10 monclient(hunting): handle_auth_done global_id 4279 payload 274 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.448+0000 7fa429225640 1 -- 10.20.193.10:0/2220773458 >> v2:10.20.193.153:3300/0 conn(0x7fa42415c110 msgr2=0x7fa42406fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.448+0000 7fa429225640 1 --2- 10.20.193.10:0/2220773458 >> v2:10.20.193.153:3300/0 conn(0x7fa42415c110 0x7fa42406fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.448+0000 7fa429225640 1 -- 10.20.193.10:0/2220773458 >> v1:10.20.193.153:6789/0 conn(0x7fa4241506c0 legacy=0x7fa42415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.448+0000 7fa429225640 10 monclient: _finish_hunting 0 2026-02-17T11:54:25.454 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.448+0000 7fa429225640 1 monclient: found mon.noname-b 2026-02-17T11:54:25.455 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.448+0000 7fa429225640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:25.455 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.448+0000 7fa429225640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:25.455 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.448+0000 7fa429225640 1 -- 10.20.193.10:0/2220773458 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42415a570 con 0x7fa4241502e0 2026-02-17T11:54:25.455 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.450+0000 7fa429225640 1 --2- 10.20.193.10:0/2220773458 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa4241502e0 0x7fa424159b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4240c4440 tx=0x7fa41402eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8af87d2b54106a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:25.459 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 1 -- 10.20.193.10:0/2220773458 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41403c070 con 0x7fa4241502e0 2026-02-17T11:54:25.459 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 10 monclient: dump: 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:25.460 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 5 monclient: authenticate success, global_id 4279 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 1 -- 10.20.193.10:0/2220773458 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41402fae0 con 0x7fa4241502e0 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 1 -- 10.20.193.10:0/2220773458 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414037440 con 0x7fa4241502e0 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 4 set_mon_vals no callback set 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:25.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa413fff640 10 monclient: dump: 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 10 monclient: shutdown 2026-02-17T11:54:25.462 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 1 -- 10.20.193.10:0/2220773458 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa4241502e0 msgr2=0x7fa424159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 1 --2- 10.20.193.10:0/2220773458 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa4241502e0 0x7fa424159b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4240c4440 tx=0x7fa41402eeb0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 1 -- 10.20.193.10:0/2220773458 shutdown_connections 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 1 --2- 10.20.193.10:0/2220773458 >> v2:10.20.193.153:3300/0 conn(0x7fa42415c110 0x7fa42406fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 1 --2- 10.20.193.10:0/2220773458 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa4241502e0 0x7fa424159b30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 1 -- 10.20.193.10:0/2220773458 >> 10.20.193.10:0/2220773458 conn(0x7fa4240cd5d0 msgr2=0x7fa4240cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 1 -- 10.20.193.10:0/2220773458 shutdown_connections 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 1 -- 10.20.193.10:0/2220773458 wait complete. 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 10 monclient: build_initial_monmap 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.454+0000 7fa42b4b0640 10 monclient: monmap: 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:25.463 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 librados: starting msgr at 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 librados: starting objecter 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 Processor -- start 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 -- start start 2026-02-17T11:54:25.464 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 librados: setting wanted keys 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 librados: calling monclient init 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient: init 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa4241502e0 0x7fa4241f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient(hunting): picked mon.noname-a con 0x7fa4241502e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa4241506c0 0x7fa424156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient(hunting): picked mon.noname-b con 0x7fa4241506c0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa42415c110 0x7fa4240cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient(hunting): picked mon.noname-c con 0x7fa42415c110 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:25.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa42415b4e0 con 0x7fa4241502e0 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa42415b200 con 0x7fa4241506c0 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4240700b0 con 0x7fa42415c110 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa42b4b0640 10 monclient(hunting): authenticate will time out at 935.177530s 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.455+0000 7fa429225640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa4241502e0 0x7fa4241f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429a26640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa42415c110 0x7fa4240cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429225640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa4241502e0 0x7fa4241f7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:51598/0 (socket says 10.20.193.10:51598) 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429225640 1 -- 10.20.193.10:0/153320752 learned_addr learned my addr 10.20.193.10:0/153320752 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:25.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429225640 10 monclient(hunting): get_auth_request con 0x7fa4241502e0 auth_method 0 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429225640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429225640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429225640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429a26640 10 monclient(hunting): get_auth_request con 0x7fa42415c110 auth_method 0 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429a26640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429a26640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429225640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429225640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429225640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa428a24640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa4241506c0 0x7fa424156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:25.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:25.468 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa429a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:25.468 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa428a24640 10 monclient(hunting): get_auth_request con 0x7fa4241506c0 auth_method 0 2026-02-17T11:54:25.468 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa428a24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:25.468 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa428a24640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:25.468 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.456+0000 7fa428a24640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:25.468 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.457+0000 7fa428a24640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:25.468 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.457+0000 7fa428a24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:25.468 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.457+0000 7fa428a24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 10 monclient(hunting): handle_auth_done global_id 4251 payload 824 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 1 -- 10.20.193.10:0/153320752 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa42415c110 msgr2=0x7fa4240cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa42415c110 0x7fa4240cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 1 -- 10.20.193.10:0/153320752 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa4241506c0 msgr2=0x7fa424156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa4241506c0 0x7fa424156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 10 monclient: _finish_hunting 0 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 1 monclient: found mon.noname-a 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.458+0000 7fa429225640 1 -- 10.20.193.10:0/153320752 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa424154600 con 0x7fa4241502e0 2026-02-17T11:54:25.471 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.459+0000 7fa429225640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa4241502e0 0x7fa4241f7260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa414009130 tx=0x7fa4140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.459+0000 7fa411ffb640 10 client.?.objecter ms_handle_connect 0x7fa4241502e0 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.459+0000 7fa411ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa411ffb640 1 -- 10.20.193.10:0/153320752 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41403c040 con 0x7fa4241502e0 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa411ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa411ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa411ffb640 10 monclient: dump: 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:25.472 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa411ffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa411ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa411ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa42b4b0640 5 monclient: authenticate success, global_id 4251 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa42b4b0640 10 monclient: _renew_subs 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa42b4b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4241548e0 con 0x7fa4241502e0 2026-02-17T11:54:25.473 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa42b4b0640 10 client.4251.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa42b4b0640 10 monclient: _renew_subs 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa42b4b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa424154ea0 con 0x7fa4241502e0 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.460+0000 7fa42b4b0640 1 librados: init done 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa42b4b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa42b4b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa42b4b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa424070490 con 0x7fa4241502e0 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa411ffb640 1 -- 10.20.193.10:0/153320752 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa414047070 con 0x7fa4241502e0 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa411ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa411ffb640 1 -- 10.20.193.10:0/153320752 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414042650 con 0x7fa4241502e0 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa411ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:25.474 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa411ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa4137fe640 4 set_mon_vals no callback set 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.461+0000 7fa411ffb640 10 monclient: dump: 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:25.475 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:25.575 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.573+0000 7fa411ffb640 1 -- 10.20.193.10:0/153320752 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7fa4140427f0 con 0x7fa4241502e0 2026-02-17T11:54:25.576 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.574+0000 7fa411ffb640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa3f4078da0 0x7fa3f407b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:25.576 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.574+0000 7fa428a24640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa3f4078da0 0x7fa3f407b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:25.576 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.574+0000 7fa428a24640 10 monclient: get_auth_request con 0x7fa3f4078da0 auth_method 0 2026-02-17T11:54:25.577 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.574+0000 7fa428a24640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa3f4078da0 0x7fa3f407b260 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa424074670 tx=0x7fa4180091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:25.577 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.574+0000 7fa411ffb640 10 client.4251.objecter ms_handle_connect 0x7fa3f4078da0 2026-02-17T11:54:25.584 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.582+0000 7fa411ffb640 1 -- 10.20.193.10:0/153320752 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fa4140bd170 con 0x7fa4241502e0 2026-02-17T11:54:25.585 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.582+0000 7fa411ffb640 10 client.4251.objecter ms_dispatch2 0x7fa424000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:54:25.585 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.582+0000 7fa411ffb640 3 client.4251.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:54:25.585 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.582+0000 7fa411ffb640 3 client.4251.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:54:25.585 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.582+0000 7fa411ffb640 20 client.4251.objecter dump_active .. 0 homeless 2026-02-17T11:54:25.585 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.582+0000 7fa411ffb640 1 -- 10.20.193.10:0/153320752 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa414087990 con 0x7fa4241502e0 2026-02-17T11:54:25.585 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.582+0000 7fa411ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:25.585 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.582+0000 7fa411ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:25.671 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.669+0000 7fa42b4b0640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:25.671 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.669+0000 7fa42b4b0640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:25.671 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.669+0000 7fa42b4b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:25.671 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.669+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa424154330 con 0x7fa4241502e0 2026-02-17T11:54:25.697 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.695+0000 7fa411ffb640 1 -- 10.20.193.10:0/153320752 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fa41408ce20 con 0x7fa4241502e0 2026-02-17T11:54:25.697 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.695+0000 7fa411ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:25.697 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.695+0000 7fa411ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:25.698 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:54:25.698 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:25.700 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 10 librados: watch_flush enter 2026-02-17T11:54:25.701 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 10 librados: watch_flush exit 2026-02-17T11:54:25.701 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 20 client.4251.objecter shutdown clearing up homeless session... 2026-02-17T11:54:25.701 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 10 client.4251.objecter successfully canceled tick 2026-02-17T11:54:25.701 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa3f4078da0 msgr2=0x7fa3f407b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:25.701 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa3f4078da0 0x7fa3f407b260 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa424074670 tx=0x7fa4180091c0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.701 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 10 monclient: shutdown 2026-02-17T11:54:25.701 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:25.701 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa4241502e0 msgr2=0x7fa4241f7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:25.701 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa4241502e0 0x7fa4241f7260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa414009130 tx=0x7fa4140047c0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.702 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 shutdown_connections 2026-02-17T11:54:25.702 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa3f4078da0 0x7fa3f407b260 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.702 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa42415c110 0x7fa4240cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.702 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa4241506c0 0x7fa424156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.702 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 --2- 10.20.193.10:0/153320752 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa4241502e0 0x7fa4241f7260 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:25.702 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 >> 10.20.193.10:0/153320752 conn(0x7fa4240cd5d0 msgr2=0x7fa4240cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:25.702 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 shutdown_connections 2026-02-17T11:54:25.702 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 -- 10.20.193.10:0/153320752 wait complete. 2026-02-17T11:54:25.702 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:25.697+0000 7fa42b4b0640 1 librados: shutdown 2026-02-17T11:54:25.709 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:54:28.157 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:20.606 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.180 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:20.621 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.252 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:20.697 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.292 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:20.748 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.362 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:20.719 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.363 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:20.818 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.379 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:20.823 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.385 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:20.842 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.388 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:20.753 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.465 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:20.915 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.495 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:20.936 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.576 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:21.021 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.592 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:20.963 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.597 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:20.954 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.601 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:20.967 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.601 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:21.058 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.608 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:20.976 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.676 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:21.131 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.679 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:21.037 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.693 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:21.136 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.693 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:21.062 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.699 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:21.064 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.706 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:21.163 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.762 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:21.211 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.800 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:21.242 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.838 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:21.194 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.881 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:21.326 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.884 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:21.240 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.911 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:21.367 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.918 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:21.290 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.920 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:21.277 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.920 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:21.287 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.929 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:21.297 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.961 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:21.415 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.965 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:21.322 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.994 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:21.450 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:28.998 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:21.442 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.005 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:21.374 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.008 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:21.373 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.025 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:21.475 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.075 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:21.516 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.148 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:21.505 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.155 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:21.600 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.185 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:21.641 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.198 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:21.555 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.204 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:21.561 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.224 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:21.679 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.225 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:21.592 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.228 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:21.594 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.228 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:21.600 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.241 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:21.599 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.257 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:21.714 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.275 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:21.719 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.282 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:21.647 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.289 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:21.738 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.312 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:21.681 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.348 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:21.790 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.429 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:21.873 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.452 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:21.809 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.459 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:21.915 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.484 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:21.841 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.488 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:21.856 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.489 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:21.846 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.494 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:21.949 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.502 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:21.874 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.510 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:21.877 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.513 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:21.871 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.522 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:21.979 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.549 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:21.993 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.552 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:22.002 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.556 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:21.921 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.589 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:21.957 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.622 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:22.064 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.702 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:22.147 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.726 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:22.083 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.732 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:22.189 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.752 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:22.119 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.757 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:22.115 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.763 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:22.120 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.768 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:22.223 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.776 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:22.148 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.785 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:22.143 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.787 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:22.153 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.791 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:22.248 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.820 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:22.269 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.823 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:22.267 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.830 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:22.195 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.867 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:22.236 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.905 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:22.347 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:29.981 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:22.426 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.000 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:22.357 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.007 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:22.463 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.015 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:22.383 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.026 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:22.384 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.030 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:22.387 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.034 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:22.489 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.052 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:22.410 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.053 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:22.424 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.059 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:22.516 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.061 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:22.428 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.085 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:22.535 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.098 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:22.541 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.114 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:22.479 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.148 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:22.516 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.185 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:22.626 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.258 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:22.703 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.274 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:22.631 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.279 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:22.646 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.280 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:22.737 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.293 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:22.651 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.304 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:22.661 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.306 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:22.761 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.320 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:22.678 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.329 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:22.786 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.330 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:22.702 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.335 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:22.701 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.352 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:22.801 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.371 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:22.815 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.389 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:22.753 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.422 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:22.790 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.458 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:22.900 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.536 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:22.981 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.542 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:22.910 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.554 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:23.011 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.559 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:22.916 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.562 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:22.919 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.570 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:22.927 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.573 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:23.028 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.594 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:22.952 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.601 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:23.058 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.604 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:22.976 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.613 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:22.980 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.645 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:23.089 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.663 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:23.028 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.695 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:23.064 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.711 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:23.160 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.805 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:23.172 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.825 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:23.183 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.833 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:23.274 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.841 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:23.198 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.842 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:23.199 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.894 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:23.260 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.901 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:23.273 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.917 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:23.362 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.929 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:23.386 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.932 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:23.387 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.967 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:23.324 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.974 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:23.432 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.975 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:23.344 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:30.992 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:23.447 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.013 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:23.462 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.027 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:23.482 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.034 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:23.484 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.038 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:23.403 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.040 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:23.484 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.052 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:23.506 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.056 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:23.505 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.056 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:23.511 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.060 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:23.510 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.110 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:23.467 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.120 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:23.561 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.131 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:23.488 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.144 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:23.585 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.161 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:23.528 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.168 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:23.609 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.172 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:23.614 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.181 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:23.538 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.202 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:23.569 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.208 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:23.653 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.216 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:23.573 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.220 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:23.677 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.242 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:23.687 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.243 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:23.699 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.243 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:23.600 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.262 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:23.619 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.265 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:23.721 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.269 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:23.726 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.270 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:23.715 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.272 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:23.629 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.272 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:23.730 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.274 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:23.720 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.276 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:23.634 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.279 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:23.651 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.283 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:23.650 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.310 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:23.768 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.330 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:23.697 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.332 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:23.704 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.339 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:23.783 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.340 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:23.797 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.343 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:23.708 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.344 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:23.802 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.362 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:23.731 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.370 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:23.734 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.394 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:23.758 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.398 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:23.763 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.465 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:23.821 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.479 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:23.846 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.527 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:23.884 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.536 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:23.893 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.566 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:23.923 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.571 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:23.929 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.599 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:23.965 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.610 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:23.981 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.619 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:24.062 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.633 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:23.999 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.637 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:24.003 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.647 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:24.018 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.651 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:24.023 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.658 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:24.027 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.672 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:24.117 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.678 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:24.122 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.683 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:24.052 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.709 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:24.078 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.714 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:24.083 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.755 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:24.122 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.759 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:24.127 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.771 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:24.128 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.801 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:24.158 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:31.829 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:24.186 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:32.091 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:24.448 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:32.097 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:24.453 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:32.115 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:24.472 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:32.155 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:24.512 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:32.159 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:24.516 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:33.318 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:33.383 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.380+0000 7f10cb4fa640 10 monclient: get_monmap_and_config 2026-02-17T11:54:33.383 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.380+0000 7f10cb4fa640 10 monclient: build_initial_monmap 2026-02-17T11:54:33.383 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.380+0000 7f10cb4fa640 10 monclient: monmap: 2026-02-17T11:54:33.383 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:33.383 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:33.383 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:54:33.381980+0000 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:54:33.381980+0000 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:33.384 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 1 Processor -- start 2026-02-17T11:54:33.385 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 1 -- start start 2026-02-17T11:54:33.385 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient: init 2026-02-17T11:54:33.388 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:33.388 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient: _add_conns ranks=[3,5,0,1,2,4] 2026-02-17T11:54:33.388 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f10c41502e0 0x7f10c4159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:33.388 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient(hunting): picked mon.noname-a con 0x7f10c41502e0 addr v2:10.20.193.10:3300/0 2026-02-17T11:54:33.388 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f10c41506c0 0x7f10c415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:33.388 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient(hunting): picked mon.noname-c con 0x7f10c41506c0 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:33.388 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f10c415bf40 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:33.388 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c415c380 con 0x7f10c415bf40 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f10c415a070 con 0x7f10c41502e0 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f10c415afb0 con 0x7f10c41506c0 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.381+0000 7f10cb4fa640 10 monclient(hunting): authenticate will time out at 943.103764s 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f10c41506c0 0x7f10c415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c926f640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f10c41502e0 0x7f10c4159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f10c41506c0 0x7f10c415ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35168/0 (socket says 10.20.193.10:35168) 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 1 -- 10.20.193.10:0/3872706712 learned_addr learned my addr 10.20.193.10:0/3872706712 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:33.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 10 monclient(hunting): get_auth_request con 0x7f10c41506c0 auth_method 0 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c926f640 10 monclient(hunting): get_auth_request con 0x7f10c41502e0 auth_method 0 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c926f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c926f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c926f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.382+0000 7f10c8a6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.383+0000 7f10c926f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:33.390 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.383+0000 7f10c926f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.383+0000 7f10c926f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.384+0000 7f10c8a6e640 10 monclient(hunting): handle_auth_done global_id 4259 payload 274 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.384+0000 7f10c8a6e640 1 -- 10.20.193.10:0/3872706712 >> v2:10.20.193.10:3300/0 conn(0x7f10c41502e0 msgr2=0x7f10c4159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.384+0000 7f10c8a6e640 1 --2- 10.20.193.10:0/3872706712 >> v2:10.20.193.10:3300/0 conn(0x7f10c41502e0 0x7f10c4159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.384+0000 7f10c8a6e640 1 -- 10.20.193.10:0/3872706712 >> v1:10.20.193.10:6789/0 conn(0x7f10c415bf40 legacy=0x7f10c406fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.384+0000 7f10c8a6e640 10 monclient: _finish_hunting 0 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.384+0000 7f10c8a6e640 1 monclient: found mon.noname-c 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.384+0000 7f10c8a6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.384+0000 7f10c8a6e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.384+0000 7f10c8a6e640 1 -- 10.20.193.10:0/3872706712 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c415a290 con 0x7f10c41506c0 2026-02-17T11:54:33.391 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.385+0000 7f10c8a6e640 1 --2- 10.20.193.10:0/3872706712 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41506c0 0x7f10c415ba00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10c415b130 tx=0x7f10b802ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6310d560404490e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:33.398 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 1 -- 10.20.193.10:0/3872706712 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b803c070 con 0x7f10c41506c0 2026-02-17T11:54:33.398 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:33.398 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:33.398 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 10 monclient: dump: 2026-02-17T11:54:33.398 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:33.398 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:33.398 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:33.399 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 1 -- 10.20.193.10:0/3872706712 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b802fc40 con 0x7f10c41506c0 2026-02-17T11:54:33.400 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 5 monclient: authenticate success, global_id 4259 2026-02-17T11:54:33.400 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:33.400 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:33.400 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 1 -- 10.20.193.10:0/3872706712 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8037460 con 0x7f10c41506c0 2026-02-17T11:54:33.400 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:33.400 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:33.400 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 4 set_mon_vals no callback set 2026-02-17T11:54:33.401 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:33.401 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10b3fff640 10 monclient: dump: 2026-02-17T11:54:33.401 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:33.401 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:33.401 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:33.401 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:33.401 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:33.402 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:33.402 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:33.402 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:33.402 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:33.402 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:33.402 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 10 monclient: shutdown 2026-02-17T11:54:33.402 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:33.403 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 1 -- 10.20.193.10:0/3872706712 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41506c0 msgr2=0x7f10c415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:33.403 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 1 --2- 10.20.193.10:0/3872706712 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41506c0 0x7f10c415ba00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10c415b130 tx=0x7f10b802ef70 comp rx=0 tx=0).stop 2026-02-17T11:54:33.403 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 1 -- 10.20.193.10:0/3872706712 shutdown_connections 2026-02-17T11:54:33.403 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 1 --2- 10.20.193.10:0/3872706712 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41506c0 0x7f10c415ba00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:33.403 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 1 --2- 10.20.193.10:0/3872706712 >> v2:10.20.193.10:3300/0 conn(0x7f10c41502e0 0x7f10c4159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:33.403 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 1 -- 10.20.193.10:0/3872706712 >> 10.20.193.10:0/3872706712 conn(0x7f10c40cd5d0 msgr2=0x7f10c40cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:33.403 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 1 -- 10.20.193.10:0/3872706712 shutdown_connections 2026-02-17T11:54:33.403 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.387+0000 7f10cb4fa640 1 -- 10.20.193.10:0/3872706712 wait complete. 2026-02-17T11:54:33.404 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.388+0000 7f10cb4fa640 10 monclient: build_initial_monmap 2026-02-17T11:54:33.404 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.388+0000 7f10cb4fa640 10 monclient: monmap: 2026-02-17T11:54:33.404 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:33.404 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:33.404 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:54:33.404 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.388+0000 7f10cb4fa640 1 librados: starting msgr at 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.388+0000 7f10cb4fa640 1 librados: starting objecter 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.388+0000 7f10cb4fa640 1 Processor -- start 2026-02-17T11:54:33.405 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.388+0000 7f10cb4fa640 1 -- start start 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.388+0000 7f10cb4fa640 1 librados: setting wanted keys 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.388+0000 7f10cb4fa640 1 librados: calling monclient init 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.388+0000 7f10cb4fa640 10 monclient: init 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41502e0 0x7f10c41f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient(hunting): picked mon.noname-c con 0x7f10c41502e0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f10c41506c0 0x7f10c4158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient(hunting): picked mon.noname-b con 0x7f10c41506c0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f10c415bf40 0x7f10c41f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient(hunting): picked mon.noname-a con 0x7f10c415bf40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:33.406 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f10c415b200 con 0x7f10c415bf40 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f10c415a850 con 0x7f10c41506c0 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10c415b4e0 con 0x7f10c41502e0 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10cb4fa640 10 monclient(hunting): authenticate will time out at 943.111209s 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c9a70640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f10c415bf40 0x7f10c41f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c926f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41502e0 0x7f10c41f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c926f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41502e0 0x7f10c41f7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35170/0 (socket says 10.20.193.10:35170) 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c926f640 1 -- 10.20.193.10:0/1285033820 learned_addr learned my addr 10.20.193.10:0/1285033820 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:33.407 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c926f640 10 monclient(hunting): get_auth_request con 0x7f10c41502e0 auth_method 0 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c926f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c926f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c926f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c9a70640 10 monclient(hunting): get_auth_request con 0x7f10c415bf40 auth_method 0 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c9a70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c9a70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c9a70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c8a6e640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f10c41506c0 0x7f10c4158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c926f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.389+0000 7f10c926f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c926f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:33.408 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c8a6e640 10 monclient(hunting): get_auth_request con 0x7f10c41506c0 auth_method 0 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c8a6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c8a6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c8a6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c9a70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c9a70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c9a70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c8a6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c8a6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.390+0000 7f10c8a6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 10 monclient(hunting): handle_auth_done global_id 4262 payload 824 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 1 -- 10.20.193.10:0/1285033820 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f10c41506c0 msgr2=0x7f10c4158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:33.409 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f10c41506c0 0x7f10c4158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 1 -- 10.20.193.10:0/1285033820 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f10c415bf40 msgr2=0x7f10c41f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f10c415bf40 0x7f10c41f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 10 monclient: _finish_hunting 0 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 1 monclient: found mon.noname-c 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.391+0000 7f10c926f640 1 -- 10.20.193.10:0/1285033820 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c41f4b70 con 0x7f10c41502e0 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.392+0000 7f10c926f640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41502e0 0x7f10c41f7b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10b400e890 tx=0x7f10b400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.392+0000 7f10b1ffb640 10 client.?.objecter ms_handle_connect 0x7f10c41502e0 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.392+0000 7f10b1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 1 -- 10.20.193.10:0/1285033820 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4017070 con 0x7f10c41502e0 2026-02-17T11:54:33.410 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 10 monclient: dump: 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:33.411 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 5 monclient: authenticate success, global_id 4262 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 10 monclient: _renew_subs 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c4146250 con 0x7f10c41502e0 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 10 client.4262.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 10 monclient: _renew_subs 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c4072620 con 0x7f10c41502e0 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 1 librados: init done 2026-02-17T11:54:33.412 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 1 -- 10.20.193.10:0/1285033820 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b4005a90 con 0x7f10c41502e0 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 1 -- 10.20.193.10:0/1285033820 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4021060 con 0x7f10c41502e0 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b37fe640 4 set_mon_vals no callback set 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10b1ffb640 10 monclient: dump: 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:33.413 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:33.414 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:33.414 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:33.414 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:33.414 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:33.414 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:33.414 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:33.414 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:33.414 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.394+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c4159b30 con 0x7f10c41502e0 2026-02-17T11:54:33.416 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.405+0000 7f10b1ffb640 1 -- 10.20.193.10:0/1285033820 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f10b4024060 con 0x7f10c41502e0 2026-02-17T11:54:33.416 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.406+0000 7f10b1ffb640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1094078da0 0x7f109407b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:33.416 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.406+0000 7f10c8a6e640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1094078da0 0x7f109407b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:33.416 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.406+0000 7f10c8a6e640 10 monclient: get_auth_request con 0x7f1094078da0 auth_method 0 2026-02-17T11:54:33.416 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.406+0000 7f10c8a6e640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1094078da0 0x7f109407b260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f10c40c4440 tx=0x7f10b8039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:33.417 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.406+0000 7f10b1ffb640 10 client.4262.objecter ms_handle_connect 0x7f1094078da0 2026-02-17T11:54:33.417 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.407+0000 7f10b1ffb640 1 -- 10.20.193.10:0/1285033820 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f10b4097480 con 0x7f10c41502e0 2026-02-17T11:54:33.417 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.407+0000 7f10b1ffb640 10 client.4262.objecter ms_dispatch2 0x7f10c4000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:54:33.417 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.407+0000 7f10b1ffb640 3 client.4262.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:54:33.417 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.407+0000 7f10b1ffb640 3 client.4262.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:54:33.417 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.407+0000 7f10b1ffb640 20 client.4262.objecter dump_active .. 0 homeless 2026-02-17T11:54:33.517 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.515+0000 7f10b1ffb640 1 -- 10.20.193.10:0/1285033820 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f10b4061c20 con 0x7f10c41502e0 2026-02-17T11:54:33.518 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.515+0000 7f10b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:33.518 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.515+0000 7f10b1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:33.604 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.602+0000 7f10cb4fa640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:33.605 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.602+0000 7f10cb4fa640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:33.605 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.602+0000 7f10cb4fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:33.605 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.602+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10c414f0f0 con 0x7f10c41502e0 2026-02-17T11:54:33.615 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.613+0000 7f10b1ffb640 1 -- 10.20.193.10:0/1285033820 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f10b4065f20 con 0x7f10c41502e0 2026-02-17T11:54:33.616 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.613+0000 7f10b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:33.616 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.613+0000 7f10b1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:33.616 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:54:33.616 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:33.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 10 librados: watch_flush enter 2026-02-17T11:54:33.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 10 librados: watch_flush exit 2026-02-17T11:54:33.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 20 client.4262.objecter shutdown clearing up homeless session... 2026-02-17T11:54:33.619 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 10 client.4262.objecter successfully canceled tick 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1094078da0 msgr2=0x7f109407b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1094078da0 0x7f109407b260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f10c40c4440 tx=0x7f10b8039040 comp rx=0 tx=0).stop 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 10 monclient: shutdown 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41502e0 msgr2=0x7f10c41f7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41502e0 0x7f10c41f7b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10b400e890 tx=0x7f10b400ed60 comp rx=0 tx=0).stop 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 shutdown_connections 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1094078da0 0x7f109407b260 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f10c415bf40 0x7f10c41f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:33.620 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f10c41506c0 0x7f10c4158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:33.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 --2- 10.20.193.10:0/1285033820 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10c41502e0 0x7f10c41f7b60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:33.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 >> 10.20.193.10:0/1285033820 conn(0x7f10c40cd5d0 msgr2=0x7f10c414db00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:33.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 shutdown_connections 2026-02-17T11:54:33.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 -- 10.20.193.10:0/1285033820 wait complete. 2026-02-17T11:54:33.621 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:33.616+0000 7f10cb4fa640 1 librados: shutdown 2026-02-17T11:54:33.627 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:54:41.234 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:41.294 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.293+0000 7f201321a640 10 monclient: get_monmap_and_config 2026-02-17T11:54:41.294 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.293+0000 7f201321a640 10 monclient: build_initial_monmap 2026-02-17T11:54:41.294 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.293+0000 7f201321a640 10 monclient: monmap: 2026-02-17T11:54:41.294 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:41.294 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:41.294 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:54:41.293362+0000 2026-02-17T11:54:41.294 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:54:41.293362+0000 2026-02-17T11:54:41.294 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:41.295 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:41.295 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:41.295 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:41.295 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:41.295 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:41.295 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:41.295 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:41.295 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:41.298 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.293+0000 7f201321a640 1 Processor -- start 2026-02-17T11:54:41.298 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.293+0000 7f201321a640 1 -- start start 2026-02-17T11:54:41.298 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.293+0000 7f201321a640 10 monclient: init 2026-02-17T11:54:41.298 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:41.298 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 10 monclient: _add_conns ranks=[0,1,2,5,4,3] 2026-02-17T11:54:41.298 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f200c15f850 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:41.298 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f200c15fc30 addr v1:10.20.193.71:6789/0 2026-02-17T11:54:41.298 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f200c0c9ee0 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:41.298 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200c0d2900 con 0x7f200c15f850 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200c0cc4c0 con 0x7f200c15fc30 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200c0cc7a0 con 0x7f200c0c9ee0 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.294+0000 7f201321a640 10 monclient(hunting): authenticate will time out at 951.015471s 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.295+0000 7f2010f8f640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f200c15f850 0x7f200c0cb850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:51456/0 (socket says 10.20.193.10:51456) 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.295+0000 7f2010f8f640 1 -- 10.20.193.10:0/3085195263 learned_addr learned my addr 10.20.193.10:0/3085195263 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2037184765 0 0) 0x7f200c0cc7a0 con 0x7f200c0c9ee0 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): _negotiate 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): my global_id is 4265 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ff8003620 con 0x7f200c0c9ee0 2026-02-17T11:54:41.299 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863023511 0 0) 0x7f200c0cc4c0 con 0x7f200c15fc30 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): _negotiate 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): my global_id is 4288 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f200c0cc7a0 con 0x7f200c15fc30 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134315097 0 0) 0x7f200c0d2900 con 0x7f200c15f850 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): _negotiate 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 10 monclient(hunting): my global_id is 4263 2026-02-17T11:54:41.300 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.296+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f200c0cc4c0 con 0x7f200c15f850 2026-02-17T11:54:41.303 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1602489609 0 0) 0x7f200c0cc7a0 con 0x7f200c15fc30 2026-02-17T11:54:41.303 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 >> v1:10.20.193.153:6789/0 conn(0x7f200c0c9ee0 legacy=0x7f200c0cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 >> v1:10.20.193.10:6789/0 conn(0x7f200c15f850 legacy=0x7f200c0cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient: _finish_hunting 0 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c0cca80 con 0x7f200c15fc30 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient: _finish_auth 0 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient: _check_auth_tickets 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f1ff4002ee0 con 0x7f200c15fc30 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:41.304 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient: dump: 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:41.305 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 >> v1:10.20.193.71:6789/0 conn(0x7f200c15fc30 legacy=0x7f200c0c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1ff8003fe0 0x7f1ff8004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient(hunting): picked mon.b con 0x7f1ff8003fe0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1ff8004e40 0x7f1ff80052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient(hunting): picked mon.c con 0x7f1ff8004e40 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1ff8009ab0 0x7f1ff800bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient(hunting): picked mon.a con 0x7f1ff8009ab0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff800c490 con 0x7f1ff8009ab0 2026-02-17T11:54:41.306 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff800c640 con 0x7f1ff8003fe0 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff800c840 con 0x7f1ff8004e40 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.298+0000 7f20037fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.299+0000 7f2003fff640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1ff8004e40 0x7f1ff80052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.299+0000 7f2003fff640 10 monclient(hunting): get_auth_request con 0x7f1ff8004e40 auth_method 0 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.299+0000 7f2003fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.299+0000 7f2003fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.299+0000 7f2003fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.300+0000 7f2010f8f640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1ff8003fe0 0x7f1ff8004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:41.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.300+0000 7f2003fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.300+0000 7f2003fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.300+0000 7f2003fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.300+0000 7f2010f8f640 10 monclient(hunting): get_auth_request con 0x7f1ff8003fe0 auth_method 0 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.300+0000 7f2010f8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.300+0000 7f2010f8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.300+0000 7f2010f8f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2010f8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2010f8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2010f8f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 10 monclient(hunting): handle_auth_done global_id 4288 payload 293 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 1 -- 10.20.193.10:0/3085195263 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1ff8003fe0 msgr2=0x7f1ff8004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1ff8003fe0 0x7f1ff8004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.308 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 1 -- 10.20.193.10:0/3085195263 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1ff8009ab0 msgr2=0x7f1ff800bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1ff8009ab0 0x7f1ff800bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 1 monclient: found mon.c 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 1 -- 10.20.193.10:0/3085195263 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c0cc7a0 con 0x7f1ff8004e40 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 10 monclient: _finish_auth 0 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 10 monclient: _check_auth_tickets 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2003fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f2011790640 1 -- 10.20.193.10:0/3085195263 reap_dead start 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f201321a640 5 monclient: authenticate success, global_id 4288 2026-02-17T11:54:41.309 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.301+0000 7f201321a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:41.310 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.302+0000 7f2003fff640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1ff8004e40 0x7f1ff80052c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4007fb0 tx=0x7f1ff402f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=813c3b04ad9eace8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:41.315 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff403c070 con 0x7f1ff8004e40 2026-02-17T11:54:41.315 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:41.315 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 10 monclient: dump: 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff402fe00 con 0x7f1ff8004e40 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 1 -- 10.20.193.10:0/3085195263 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4007bd0 con 0x7f1ff8004e40 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f201321a640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f201321a640 4 set_mon_vals no callback set 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.303+0000 7f20037fe640 10 monclient: dump: 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 10 monclient: shutdown 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 1 -- 10.20.193.10:0/3085195263 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1ff8004e40 msgr2=0x7f1ff80052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:41.316 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1ff8004e40 0x7f1ff80052c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4007fb0 tx=0x7f1ff402f3a0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 1 -- 10.20.193.10:0/3085195263 shutdown_connections 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 1 --2- 10.20.193.10:0/3085195263 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1ff8004e40 0x7f1ff80052c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 1 -- 10.20.193.10:0/3085195263 >> 10.20.193.10:0/3085195263 conn(0x7f200c0d19c0 msgr2=0x7f200c0d1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 1 -- 10.20.193.10:0/3085195263 shutdown_connections 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 1 -- 10.20.193.10:0/3085195263 wait complete. 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 10 monclient: build_initial_monmap 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.304+0000 7f201321a640 10 monclient: monmap: 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 librados: starting msgr at 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 librados: starting objecter 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 Processor -- start 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 -- start start 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 librados: setting wanted keys 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 librados: calling monclient init 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient: init 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1ff8004e40 0x7f200c15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient(hunting): picked mon.noname-b con 0x7f1ff8004e40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f200c153080 0x7f200c06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient(hunting): picked mon.noname-c con 0x7f200c153080 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f200c1437c0 0x7f200c143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient(hunting): picked mon.noname-a con 0x7f200c1437c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0ca3c0 con 0x7f200c1437c0 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f200c160080 con 0x7f1ff8004e40 2026-02-17T11:54:41.317 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0cd040 con 0x7f200c153080 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.305+0000 7f201321a640 10 monclient(hunting): authenticate will time out at 951.026690s 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f200c153080 0x7f200c06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2011790640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f200c1437c0 0x7f200c143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f200c153080 0x7f200c06c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35184/0 (socket says 10.20.193.10:35184) 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 1 -- 10.20.193.10:0/381504893 learned_addr learned my addr 10.20.193.10:0/381504893 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 10 monclient(hunting): get_auth_request con 0x7f200c153080 auth_method 0 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2010f8f640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1ff8004e40 0x7f200c15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2011790640 10 monclient(hunting): get_auth_request con 0x7f200c1437c0 auth_method 0 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2011790640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2011790640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2011790640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2003fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2010f8f640 10 monclient(hunting): get_auth_request con 0x7f1ff8004e40 auth_method 0 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2010f8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2010f8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2010f8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2011790640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2011790640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2011790640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2010f8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2010f8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.306+0000 7f2010f8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 10 monclient(hunting): handle_auth_done global_id 4268 payload 824 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 1 -- 10.20.193.10:0/381504893 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1ff8004e40 msgr2=0x7f200c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1ff8004e40 0x7f200c15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 1 -- 10.20.193.10:0/381504893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f200c1437c0 msgr2=0x7f200c143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f200c1437c0 0x7f200c143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 1 monclient: found mon.noname-c 2026-02-17T11:54:41.318 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.307+0000 7f2003fff640 1 -- 10.20.193.10:0/381504893 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c154cd0 con 0x7f200c153080 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.309+0000 7f2003fff640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f200c153080 0x7f200c06c8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c1b0 tx=0x7f200c0ccc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.309+0000 7f20017fa640 10 client.?.objecter ms_handle_connect 0x7f200c153080 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.309+0000 7f20017fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 1 -- 10.20.193.10:0/381504893 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff403c070 con 0x7f200c153080 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 10 monclient: dump: 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 10 monclient: _finish_auth 0 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 10 monclient: _check_auth_tickets 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 5 monclient: authenticate success, global_id 4268 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 10 monclient: _renew_subs 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c154fb0 con 0x7f200c153080 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 10 client.4268.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 10 monclient: _renew_subs 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c155570 con 0x7f200c153080 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 1 librados: init done 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 1 -- 10.20.193.10:0/381504893 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff403d040 con 0x7f200c153080 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 1 -- 10.20.193.10:0/381504893 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4003ae0 con 0x7f200c153080 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f2002ffd640 4 set_mon_vals no callback set 2026-02-17T11:54:41.319 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f20017fa640 10 monclient: dump: 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.310+0000 7f201321a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.311+0000 7f201321a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.311+0000 7f201321a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:41.320 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.311+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200c0cc010 con 0x7f200c153080 2026-02-17T11:54:41.323 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.322+0000 7f20017fa640 1 -- 10.20.193.10:0/381504893 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f1ff4003c80 con 0x7f200c153080 2026-02-17T11:54:41.323 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.323+0000 7f20017fa640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1fdc078d70 0x7f1fdc07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:41.323 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.323+0000 7f2010f8f640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1fdc078d70 0x7f1fdc07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:41.323 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.323+0000 7f2010f8f640 10 monclient: get_auth_request con 0x7f1fdc078d70 auth_method 0 2026-02-17T11:54:41.323 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.323+0000 7f2010f8f640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1fdc078d70 0x7f1fdc07b230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc007180 tx=0x7f1ffc004990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:41.323 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.323+0000 7f20017fa640 10 client.4268.objecter ms_handle_connect 0x7f1fdc078d70 2026-02-17T11:54:41.325 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.325+0000 7f20017fa640 1 -- 10.20.193.10:0/381504893 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f1ff402fe00 con 0x7f200c153080 2026-02-17T11:54:41.326 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.325+0000 7f20017fa640 10 client.4268.objecter ms_dispatch2 0x7f200c000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:54:41.326 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.325+0000 7f20017fa640 3 client.4268.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:54:41.326 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.325+0000 7f20017fa640 3 client.4268.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:54:41.326 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.325+0000 7f20017fa640 20 client.4268.objecter dump_active .. 0 homeless 2026-02-17T11:54:41.435 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.434+0000 7f20017fa640 1 -- 10.20.193.10:0/381504893 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f200c0cc010 con 0x7f200c153080 2026-02-17T11:54:41.435 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.434+0000 7f20017fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:41.435 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.434+0000 7f20017fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:41.522 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.521+0000 7f201321a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:41.522 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.521+0000 7f201321a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:41.523 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.521+0000 7f201321a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:41.523 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.521+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f200c0cb850 con 0x7f200c153080 2026-02-17T11:54:41.534 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.533+0000 7f20017fa640 1 -- 10.20.193.10:0/381504893 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f1ff4087080 con 0x7f200c153080 2026-02-17T11:54:41.534 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.533+0000 7f20017fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:41.534 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.533+0000 7f20017fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:41.534 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:54:41.534 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 10 librados: watch_flush enter 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 10 librados: watch_flush exit 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 20 client.4268.objecter shutdown clearing up homeless session... 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 10 client.4268.objecter successfully canceled tick 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1fdc078d70 msgr2=0x7f1fdc07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1fdc078d70 0x7f1fdc07b230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc007180 tx=0x7f1ffc004990 comp rx=0 tx=0).stop 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 10 monclient: shutdown 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f200c153080 msgr2=0x7f200c06c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:41.537 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f200c153080 0x7f200c06c8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c1b0 tx=0x7f200c0ccc50 comp rx=0 tx=0).stop 2026-02-17T11:54:41.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 shutdown_connections 2026-02-17T11:54:41.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1fdc078d70 0x7f1fdc07b230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f200c1437c0 0x7f200c143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f200c153080 0x7f200c06c8b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 --2- 10.20.193.10:0/381504893 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1ff8004e40 0x7f200c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:41.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 >> 10.20.193.10:0/381504893 conn(0x7f200c0d19c0 msgr2=0x7f200c150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:41.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 shutdown_connections 2026-02-17T11:54:41.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 -- 10.20.193.10:0/381504893 wait complete. 2026-02-17T11:54:41.538 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:41.535+0000 7f201321a640 1 librados: shutdown 2026-02-17T11:54:41.546 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:54:42.452 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:34.907 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:42.673 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:35.123 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:42.806 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:35.247 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:42.823 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:35.280 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:42.872 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:35.328 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:42.945 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:35.390 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:42.979 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:35.336 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:43.042 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:35.406 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:43.223 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:35.594 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:43.223 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:35.667 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:43.273 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:35.639 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:43.332 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:35.690 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:43.372 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:35.741 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:43.438 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:35.805 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:43.917 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:36.274 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:43.965 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:36.322 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.106 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:37.561 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.125 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:37.575 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.132 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:37.587 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.134 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:37.589 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.153 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:37.602 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.155 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:37.605 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.445 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:37.887 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.472 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:37.913 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.474 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:37.916 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.528 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:37.985 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.530 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:37.987 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.570 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:38.015 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.575 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:38.032 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.578 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:38.035 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.612 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:38.058 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.615 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:38.060 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.645 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:38.002 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.665 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:38.022 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.668 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:38.026 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.678 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:38.043 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.819 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:38.275 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.822 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:38.279 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.824 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:38.181 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.862 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:38.219 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.865 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:38.223 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.867 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:38.239 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.906 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:38.272 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.917 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:38.360 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.942 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:38.307 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.945 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:38.309 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.956 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:38.400 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:45.959 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:38.403 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.030 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:38.399 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.049 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:38.418 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.052 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:38.421 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.114 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:38.482 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.144 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:38.515 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.147 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:38.518 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.147 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:38.514 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.149 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:38.517 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.173 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:38.539 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.176 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:38.542 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.634 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:38.991 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.657 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:39.014 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.719 INFO:tasks.ceph.osd.8.trial010.stderr:==00:00:00:39.174 45104== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.924 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:39.280 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.926 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:39.283 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.942 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:39.298 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.944 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:39.301 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:46.959 INFO:tasks.ceph.osd.12.trial010.stderr:==00:00:00:39.408 45105== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.173 INFO:tasks.ceph.osd.9.trial071.stderr:==00:00:00:39.614 44584== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.250 INFO:tasks.ceph.osd.0.trial010.stderr:==00:00:00:39.706 45102== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.366 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:39.723 45095== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.431 INFO:tasks.ceph.osd.1.trial071.stderr:==00:00:00:39.876 44582== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.584 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:39.942 45096== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.647 INFO:tasks.ceph.osd.10.trial153.stderr:==00:00:00:40.012 44858== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.665 INFO:tasks.ceph.osd.4.trial010.stderr:==00:00:00:40.122 45103== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.727 INFO:tasks.ceph.osd.6.trial153.stderr:==00:00:00:40.096 44855== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.765 INFO:tasks.ceph.osd.5.trial071.stderr:==00:00:00:40.209 44583== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.780 INFO:tasks.ceph.osd.2.trial153.stderr:==00:00:00:40.148 44856== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.959 INFO:tasks.ceph.osd.13.trial071.stderr:==00:00:00:40.331 44611== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:47.992 INFO:tasks.ceph.osd.14.trial153.stderr:==00:00:00:40.359 44857== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:48.670 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:41.027 45094== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:48.781 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:41.138 45097== Warning: unimplemented fcntl command: 1038 2026-02-17T11:54:49.158 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.217+0000 7fa556a6c640 10 monclient: get_monmap_and_config 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.217+0000 7fa556a6c640 10 monclient: build_initial_monmap 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.217+0000 7fa556a6c640 10 monclient: monmap: 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:54:49.218845+0000 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:54:49.218845+0000 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:49.219 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:49.220 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:49.220 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.217+0000 7fa556a6c640 1 Processor -- start 2026-02-17T11:54:49.220 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 1 -- start start 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient: init 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient: _add_conns ranks=[4,2,5,0,3,1] 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa5501502e0 0x7fa550159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient(hunting): picked mon.noname-b con 0x7fa5501502e0 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa5501506c0 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa55015c110 0x7fa55006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient(hunting): picked mon.noname-c con 0x7fa55015c110 addr v2:10.20.193.153:3300/0 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55015a290 con 0x7fa5501506c0 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa55015a070 con 0x7fa5501502e0 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa55015afb0 con 0x7fa55015c110 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.218+0000 7fa556a6c640 10 monclient(hunting): authenticate will time out at 958.940556s 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54ffff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa5501502e0 0x7fa550159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54f7fe640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fa5501506c0 0x7fa55015ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:60648/0 (socket says 10.20.193.10:60648) 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54f7fe640 1 -- 10.20.193.10:0/1906876099 learned_addr learned my addr 10.20.193.10:0/1906876099 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:54:49.221 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54ffff640 10 monclient(hunting): get_auth_request con 0x7fa5501502e0 auth_method 0 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.219+0000 7fa54ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa554fe2640 1 --2- 10.20.193.10:0/1906876099 >> v2:10.20.193.153:3300/0 conn(0x7fa55015c110 0x7fa55006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa554fe2640 10 monclient(hunting): get_auth_request con 0x7fa55015c110 auth_method 0 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa554fe2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa554fe2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa554fe2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:49.222 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa54ffff640 10 monclient(hunting): handle_auth_done global_id 4294 payload 274 2026-02-17T11:54:49.223 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa54ffff640 1 -- 10.20.193.10:0/1906876099 >> v2:10.20.193.153:3300/0 conn(0x7fa55015c110 msgr2=0x7fa55006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:54:49.223 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa54ffff640 1 --2- 10.20.193.10:0/1906876099 >> v2:10.20.193.153:3300/0 conn(0x7fa55015c110 0x7fa55006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.223 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa54ffff640 1 -- 10.20.193.10:0/1906876099 >> v1:10.20.193.153:6789/0 conn(0x7fa5501506c0 legacy=0x7fa55015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:49.223 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa54ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:54:49.223 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa54ffff640 1 monclient: found mon.noname-b 2026-02-17T11:54:49.223 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa54ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:49.223 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa54ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:49.223 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.220+0000 7fa54ffff640 1 -- 10.20.193.10:0/1906876099 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55015a570 con 0x7fa5501502e0 2026-02-17T11:54:49.223 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.222+0000 7fa54ffff640 1 --2- 10.20.193.10:0/1906876099 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501502e0 0x7fa550159b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5500c4440 tx=0x7fa53c02eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f42c1ee92b68de server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.223+0000 7fa54effd640 1 -- 10.20.193.10:0/1906876099 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c03c070 con 0x7fa5501502e0 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.223+0000 7fa54effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.223+0000 7fa54effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.223+0000 7fa54effd640 10 monclient: dump: 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:49.225 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.223+0000 7fa54effd640 10 monclient: _finish_auth 0 2026-02-17T11:54:49.226 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.223+0000 7fa54effd640 10 monclient: _check_auth_tickets 2026-02-17T11:54:49.226 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.223+0000 7fa54effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:49.226 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.223+0000 7fa556a6c640 5 monclient: authenticate success, global_id 4294 2026-02-17T11:54:49.226 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.223+0000 7fa556a6c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:49.226 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa54effd640 1 -- 10.20.193.10:0/1906876099 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c02fb80 con 0x7fa5501502e0 2026-02-17T11:54:49.226 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa54effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa54effd640 1 -- 10.20.193.10:0/1906876099 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c037440 con 0x7fa5501502e0 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa54effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa54effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa54effd640 10 monclient: dump: 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 4 set_mon_vals no callback set 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 10 monclient: shutdown 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 1 -- 10.20.193.10:0/1906876099 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501502e0 msgr2=0x7fa550159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 1 --2- 10.20.193.10:0/1906876099 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501502e0 0x7fa550159b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5500c4440 tx=0x7fa53c02eeb0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 1 -- 10.20.193.10:0/1906876099 shutdown_connections 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 1 --2- 10.20.193.10:0/1906876099 >> v2:10.20.193.153:3300/0 conn(0x7fa55015c110 0x7fa55006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 1 --2- 10.20.193.10:0/1906876099 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501502e0 0x7fa550159b30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 1 -- 10.20.193.10:0/1906876099 >> 10.20.193.10:0/1906876099 conn(0x7fa5500cd5d0 msgr2=0x7fa5500cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 1 -- 10.20.193.10:0/1906876099 shutdown_connections 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 1 -- 10.20.193.10:0/1906876099 wait complete. 2026-02-17T11:54:49.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 10 monclient: build_initial_monmap 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.224+0000 7fa556a6c640 10 monclient: monmap: 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 librados: starting msgr at 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 librados: starting objecter 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 Processor -- start 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 -- start start 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 librados: setting wanted keys 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 librados: calling monclient init 2026-02-17T11:54:49.228 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient: init 2026-02-17T11:54:49.229 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:49.229 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:54:49.229 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5501502e0 0x7fa550158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient(hunting): picked mon.noname-a con 0x7fa5501502e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501506c0 0x7fa5501ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient(hunting): picked mon.noname-b con 0x7fa5501506c0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa55015c110 0x7fa5501ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient(hunting): picked mon.noname-c con 0x7fa55015c110 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa55015b4e0 con 0x7fa5501502e0 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa55015b200 con 0x7fa5501506c0 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa5500700b0 con 0x7fa55015c110 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa556a6c640 10 monclient(hunting): authenticate will time out at 958.947523s 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa554fe2640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa55015c110 0x7fa5501ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.225+0000 7fa54f7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501506c0 0x7fa5501ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54ffff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5501502e0 0x7fa550158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54f7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501506c0 0x7fa5501ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:42824/0 (socket says 10.20.193.10:42824) 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54f7fe640 1 -- 10.20.193.10:0/3516013012 learned_addr learned my addr 10.20.193.10:0/3516013012 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54f7fe640 10 monclient(hunting): get_auth_request con 0x7fa5501506c0 auth_method 0 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa554fe2640 10 monclient(hunting): get_auth_request con 0x7fa55015c110 auth_method 0 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa554fe2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa554fe2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa554fe2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54ffff640 10 monclient(hunting): get_auth_request con 0x7fa5501502e0 auth_method 0 2026-02-17T11:54:49.230 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa554fe2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa554fe2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa554fe2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.226+0000 7fa54ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 10 monclient(hunting): handle_auth_done global_id 4277 payload 824 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 1 -- 10.20.193.10:0/3516013012 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501506c0 msgr2=0x7fa5501ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501506c0 0x7fa5501ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 1 -- 10.20.193.10:0/3516013012 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5501502e0 msgr2=0x7fa550158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5501502e0 0x7fa550158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 10 monclient: _finish_hunting 0 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 1 monclient: found mon.noname-c 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:54:49.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.228+0000 7fa554fe2640 1 -- 10.20.193.10:0/3516013012 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5501455d0 con 0x7fa55015c110 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.229+0000 7fa554fe2640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa55015c110 0x7fa5501ed620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa544007d20 tx=0x7fa54400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.229+0000 7fa54cff9640 10 client.?.objecter ms_handle_connect 0x7fa55015c110 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.229+0000 7fa54cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 1 -- 10.20.193.10:0/3516013012 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54400ede0 con 0x7fa55015c110 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 10 monclient: dump: 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:49.232 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 10 monclient: _finish_auth 0 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa556a6c640 5 monclient: authenticate success, global_id 4277 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa556a6c640 10 monclient: _renew_subs 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa556a6c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5501458b0 con 0x7fa55015c110 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa556a6c640 10 client.4277.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa556a6c640 10 monclient: _renew_subs 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa556a6c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa550145e70 con 0x7fa55015c110 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa556a6c640 1 librados: init done 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 1 -- 10.20.193.10:0/3516013012 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa544003a90 con 0x7fa55015c110 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 1 -- 10.20.193.10:0/3516013012 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544004020 con 0x7fa55015c110 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54cff9640 10 monclient: dump: 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:49.233 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.230+0000 7fa54e7fc640 4 set_mon_vals no callback set 2026-02-17T11:54:49.234 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.231+0000 7fa556a6c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:49.234 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.231+0000 7fa556a6c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:49.234 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.231+0000 7fa556a6c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:49.234 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.231+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa550070490 con 0x7fa55015c110 2026-02-17T11:54:49.243 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.242+0000 7fa54cff9640 1 -- 10.20.193.10:0/3516013012 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7fa5440041c0 con 0x7fa55015c110 2026-02-17T11:54:49.244 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.242+0000 7fa54cff9640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa520078da0 0x7fa52007b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:49.244 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.242+0000 7fa54ffff640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa520078da0 0x7fa52007b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:49.244 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.242+0000 7fa54ffff640 10 monclient: get_auth_request con 0x7fa520078da0 auth_method 0 2026-02-17T11:54:49.244 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.242+0000 7fa54cff9640 10 client.4277.objecter ms_handle_connect 0x7fa520078da0 2026-02-17T11:54:49.244 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.242+0000 7fa54ffff640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa520078da0 0x7fa52007b260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa53c039000 tx=0x7fa53c033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:49.246 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.244+0000 7fa54cff9640 1 -- 10.20.193.10:0/3516013012 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fa54405eb30 con 0x7fa55015c110 2026-02-17T11:54:49.246 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.244+0000 7fa54cff9640 10 client.4277.objecter ms_dispatch2 0x7fa550000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:54:49.246 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.244+0000 7fa54cff9640 3 client.4277.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:54:49.246 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.244+0000 7fa54cff9640 3 client.4277.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:54:49.246 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.244+0000 7fa54cff9640 20 client.4277.objecter dump_active .. 0 homeless 2026-02-17T11:54:49.359 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.357+0000 7fa54cff9640 1 -- 10.20.193.10:0/3516013012 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa544062af0 con 0x7fa55015c110 2026-02-17T11:54:49.359 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.357+0000 7fa54cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:49.359 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.357+0000 7fa54cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:49.451 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.449+0000 7fa556a6c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:49.451 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.449+0000 7fa556a6c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:49.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.449+0000 7fa556a6c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:54:49.452 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.449+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa550158170 con 0x7fa55015c110 2026-02-17T11:54:49.461 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.459+0000 7fa54cff9640 1 -- 10.20.193.10:0/3516013012 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fa544066df0 con 0x7fa55015c110 2026-02-17T11:54:49.462 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.459+0000 7fa54cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:49.462 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.459+0000 7fa54cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:49.462 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:54:49.462 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:49.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 10 librados: watch_flush enter 2026-02-17T11:54:49.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 10 librados: watch_flush exit 2026-02-17T11:54:49.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 20 client.4277.objecter shutdown clearing up homeless session... 2026-02-17T11:54:49.465 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 10 client.4277.objecter successfully canceled tick 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa520078da0 msgr2=0x7fa52007b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa520078da0 0x7fa52007b260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa53c039000 tx=0x7fa53c033000 comp rx=0 tx=0).stop 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 10 monclient: shutdown 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa55015c110 msgr2=0x7fa5501ed620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa55015c110 0x7fa5501ed620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa544007d20 tx=0x7fa54400e4b0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 shutdown_connections 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa520078da0 0x7fa52007b260 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa55015c110 0x7fa5501ed620 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5501506c0 0x7fa5501ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 --2- 10.20.193.10:0/3516013012 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5501502e0 0x7fa550158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:49.466 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 >> 10.20.193.10:0/3516013012 conn(0x7fa5500cd5d0 msgr2=0x7fa5500cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:49.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 shutdown_connections 2026-02-17T11:54:49.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 -- 10.20.193.10:0/3516013012 wait complete. 2026-02-17T11:54:49.467 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:49.462+0000 7fa556a6c640 1 librados: shutdown 2026-02-17T11:54:49.474 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:54:54.653 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:01:11.821 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:54:54.702 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:01:11.830 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:54:54.703 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:01:11.866 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:54:54.707 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:01:11.876 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:54:54.732 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:01:11.895 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:54:54.734 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:01:11.862 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:54:54.824 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:01:11.992 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:54:54.854 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:01:12.017 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:54:54.855 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:01:11.984 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:54:57.087 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:57.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.149+0000 7f53057e4640 10 monclient: get_monmap_and_config 2026-02-17T11:54:57.152 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.149+0000 7f53057e4640 10 monclient: build_initial_monmap 2026-02-17T11:54:57.152 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.149+0000 7f53057e4640 10 monclient: monmap: 2026-02-17T11:54:57.152 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:57.152 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:57.152 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:54:57.150442+0000 2026-02-17T11:54:57.153 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:54:57.150442+0000 2026-02-17T11:54:57.153 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:57.153 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:57.153 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:54:57.153 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:54:57.153 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:54:57.153 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:54:57.154 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:54:57.154 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:54:57.154 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:57.154 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.149+0000 7f53057e4640 1 Processor -- start 2026-02-17T11:54:57.154 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.149+0000 7f53057e4640 1 -- start start 2026-02-17T11:54:57.154 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.149+0000 7f53057e4640 10 monclient: init 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 10 monclient: _add_conns ranks=[2,0,4,3,5,1] 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f530006fde0 addr v1:10.20.193.153:6789/0 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f530015d1e0 addr v1:10.20.193.10:6789/0 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f53001560f0 0x7f53000701c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 10 monclient(hunting): picked mon.noname-b con 0x7f53001560f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530015cb20 con 0x7f530015d1e0 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5300072740 con 0x7f530006fde0 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5300072510 con 0x7f53001560f0 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f53057e4640 10 monclient(hunting): authenticate will time out at 966.872209s 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f52fe7fc640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f530015d1e0 0x7f53001559e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:59486/0 (socket says 10.20.193.10:59486) 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f52fe7fc640 1 -- 10.20.193.10:0/1968496920 learned_addr learned my addr 10.20.193.10:0/1968496920 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.150+0000 7f52ff7fe640 1 --2- 10.20.193.10:0/1968496920 >> v2:10.20.193.71:3300/0 conn(0x7f53001560f0 0x7f53000701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.151+0000 7f52ff7fe640 10 monclient(hunting): get_auth_request con 0x7f53001560f0 auth_method 0 2026-02-17T11:54:57.163 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.151+0000 7f52ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.151+0000 7f52ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.151+0000 7f52ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.151+0000 7f52ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.151+0000 7f52ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.151+0000 7f52ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.151+0000 7f52fdffb640 1 -- 10.20.193.10:0/1968496920 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577509362 0 0) 0x7f530015cb20 con 0x7f530015d1e0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 10 monclient(hunting): _negotiate 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 10 monclient(hunting): my global_id is 4272 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 1 -- 10.20.193.10:0/1968496920 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52ec003620 con 0x7f530015d1e0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 1 -- 10.20.193.10:0/1968496920 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535833910 0 0) 0x7f5300072740 con 0x7f530006fde0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 10 monclient(hunting): _negotiate 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 10 monclient(hunting): my global_id is 4280 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52fdffb640 1 -- 10.20.193.10:0/1968496920 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f530015cb20 con 0x7f530006fde0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52ff7fe640 10 monclient(hunting): handle_auth_done global_id 4300 payload 274 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52ff7fe640 1 -- 10.20.193.10:0/1968496920 >> v1:10.20.193.153:6789/0 conn(0x7f530006fde0 legacy=0x7f53000c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52ff7fe640 1 -- 10.20.193.10:0/1968496920 >> v1:10.20.193.10:6789/0 conn(0x7f530015d1e0 legacy=0x7f53001559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52ff7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52ff7fe640 1 monclient: found mon.noname-b 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52ff7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.152+0000 7f52ff7fe640 1 -- 10.20.193.10:0/1968496920 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5300072a20 con 0x7f53001560f0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.154+0000 7f52ff7fe640 1 --2- 10.20.193.10:0/1968496920 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53001560f0 0x7f53000701c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009d90 tx=0x7f52f002f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b63cafd9bba1c2d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.155+0000 7f52fdffb640 1 -- 10.20.193.10:0/1968496920 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f003c070 con 0x7f53001560f0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.155+0000 7f52fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.155+0000 7f52fdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.155+0000 7f52fdffb640 10 monclient: dump: 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.155+0000 7f52fdffb640 10 monclient: _finish_auth 0 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.155+0000 7f52fdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.155+0000 7f52fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:57.164 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.155+0000 7f53057e4640 5 monclient: authenticate success, global_id 4300 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.155+0000 7f53057e4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f52fdffb640 1 -- 10.20.193.10:0/1968496920 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f0037440 con 0x7f53001560f0 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f52fdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f52fdffb640 1 -- 10.20.193.10:0/1968496920 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f00377f0 con 0x7f53001560f0 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f52fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f52fdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f52fdffb640 10 monclient: dump: 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 10 monclient: get_monmap_and_config success 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 4 set_mon_vals no callback set 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 10 monclient: shutdown 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 1 -- 10.20.193.10:0/1968496920 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53001560f0 msgr2=0x7f53000701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 1 --2- 10.20.193.10:0/1968496920 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53001560f0 0x7f53000701c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009d90 tx=0x7f52f002f230 comp rx=0 tx=0).stop 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 1 -- 10.20.193.10:0/1968496920 shutdown_connections 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 1 --2- 10.20.193.10:0/1968496920 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53001560f0 0x7f53000701c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 1 -- 10.20.193.10:0/1968496920 >> 10.20.193.10:0/1968496920 conn(0x7f53000cd5d0 msgr2=0x7f53000cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 1 -- 10.20.193.10:0/1968496920 shutdown_connections 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 1 -- 10.20.193.10:0/1968496920 wait complete. 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 10 monclient: build_initial_monmap 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.156+0000 7f53057e4640 10 monclient: monmap: 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 librados: starting msgr at 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 librados: starting objecter 2026-02-17T11:54:57.165 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 Processor -- start 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 -- start start 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 librados: setting wanted keys 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 librados: calling monclient init 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient: init 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient: _reopen_session rank -1 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530006fde0 0x7f530015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient(hunting): picked mon.noname-a con 0x7f530006fde0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53001560f0 0x7f530015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient(hunting): picked mon.noname-c con 0x7f53001560f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f530015d1e0 0x7f5300152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient(hunting): picked mon.noname-b con 0x7f530015d1e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5300073500 con 0x7f530006fde0 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5300073070 con 0x7f530015d1e0 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5300073680 con 0x7f53001560f0 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient(hunting): _renew_subs 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f53057e4640 10 monclient(hunting): authenticate will time out at 966.879639s 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.157+0000 7f52feffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530006fde0 0x7f530015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52feffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530006fde0 0x7f530015bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:54690/0 (socket says 10.20.193.10:54690) 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52feffd640 1 -- 10.20.193.10:0/2281324008 learned_addr learned my addr 10.20.193.10:0/2281324008 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52feffd640 10 monclient(hunting): get_auth_request con 0x7f530006fde0 auth_method 0 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52feffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52ff7fe640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f530015d1e0 0x7f5300152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52fe7fc640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53001560f0 0x7f530015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52ff7fe640 10 monclient(hunting): get_auth_request con 0x7f530015d1e0 auth_method 0 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52feffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52feffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52feffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52fe7fc640 10 monclient(hunting): get_auth_request con 0x7f53001560f0 auth_method 0 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52fe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52fe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:54:57.166 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52fe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.158+0000 7f52fe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 10 monclient(hunting): handle_auth_done global_id 4275 payload 824 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 1 -- 10.20.193.10:0/2281324008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53001560f0 msgr2=0x7f530015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53001560f0 0x7f530015b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 1 -- 10.20.193.10:0/2281324008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f530015d1e0 msgr2=0x7f5300152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f530015d1e0 0x7f5300152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 10 monclient: _finish_hunting 0 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 1 monclient: found mon.noname-a 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.159+0000 7f52feffd640 1 -- 10.20.193.10:0/2281324008 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53001f7ce0 con 0x7f530006fde0 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.160+0000 7f52feffd640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530006fde0 0x7f530015bce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c700 tx=0x7f52f400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.161+0000 7f52df7fe640 10 client.?.objecter ms_handle_connect 0x7f530006fde0 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.161+0000 7f52df7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 1 -- 10.20.193.10:0/2281324008 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40052d0 con 0x7f530006fde0 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 10 monclient: dump: 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:57.167 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 10 monclient: _finish_auth 0 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 1 -- 10.20.193.10:0/2281324008 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f4005490 con 0x7f530006fde0 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 1 -- 10.20.193.10:0/2281324008 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40038d0 con 0x7f530006fde0 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52df7fe640 10 monclient: dump: 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f52fd7fa640 4 set_mon_vals no callback set 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f53057e4640 5 monclient: authenticate success, global_id 4275 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f53057e4640 10 monclient: _renew_subs 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f53057e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53001f7160 con 0x7f530006fde0 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f53057e4640 10 client.4275.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f53057e4640 10 monclient: _renew_subs 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f53057e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53001f7720 con 0x7f530006fde0 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.162+0000 7f53057e4640 1 librados: init done 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.163+0000 7f53057e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.163+0000 7f53057e4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.163+0000 7f53057e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:57.168 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.163+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53000701c0 con 0x7f530006fde0 2026-02-17T11:54:57.178 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.176+0000 7f52df7fe640 1 -- 10.20.193.10:0/2281324008 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f52f4003a70 con 0x7f530006fde0 2026-02-17T11:54:57.178 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.176+0000 7f52df7fe640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52cc078dc0 0x7f52cc07b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:54:57.179 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.177+0000 7f52fe7fc640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52cc078dc0 0x7f52cc07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:54:57.179 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.177+0000 7f52fe7fc640 10 monclient: get_auth_request con 0x7f52cc078dc0 auth_method 0 2026-02-17T11:54:57.179 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.177+0000 7f52fe7fc640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52cc078dc0 0x7f52cc07b280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53000cdf20 tx=0x7f52e8006ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:54:57.179 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.177+0000 7f52df7fe640 10 client.4275.objecter ms_handle_connect 0x7f52cc078dc0 2026-02-17T11:54:57.288 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.286+0000 7f52df7fe640 1 -- 10.20.193.10:0/2281324008 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f52f405e0c0 con 0x7f530006fde0 2026-02-17T11:54:57.288 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.286+0000 7f52df7fe640 10 client.4275.objecter ms_dispatch2 0x7f5300000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:54:57.289 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.286+0000 7f52df7fe640 3 client.4275.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:54:57.289 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.286+0000 7f52df7fe640 3 client.4275.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:54:57.289 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.286+0000 7f52df7fe640 20 client.4275.objecter dump_active .. 0 homeless 2026-02-17T11:54:57.289 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.286+0000 7f52df7fe640 1 -- 10.20.193.10:0/2281324008 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f52f4062080 con 0x7f530006fde0 2026-02-17T11:54:57.289 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.286+0000 7f52df7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:54:57.289 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.286+0000 7f52df7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:54:57.376 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.374+0000 7f53057e4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:57.376 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.374+0000 7f53057e4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:57.377 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.374+0000 7f53057e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:54:57.377 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.374+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5300159710 con 0x7f530006fde0 2026-02-17T11:54:57.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.387+0000 7f52df7fe640 1 -- 10.20.193.10:0/2281324008 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f52f4066380 con 0x7f530006fde0 2026-02-17T11:54:57.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.387+0000 7f52df7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:54:57.389 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.387+0000 7f52df7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:54:57.389 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:54:57.389 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:57.392 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 10 librados: watch_flush enter 2026-02-17T11:54:57.392 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 10 librados: watch_flush exit 2026-02-17T11:54:57.392 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 20 client.4275.objecter shutdown clearing up homeless session... 2026-02-17T11:54:57.392 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 10 client.4275.objecter successfully canceled tick 2026-02-17T11:54:57.392 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52cc078dc0 msgr2=0x7f52cc07b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:57.392 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52cc078dc0 0x7f52cc07b280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53000cdf20 tx=0x7f52e8006ba0 comp rx=0 tx=0).stop 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 10 monclient: shutdown 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530006fde0 msgr2=0x7f530015bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530006fde0 0x7f530015bce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c700 tx=0x7f52f400cbd0 comp rx=0 tx=0).stop 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 shutdown_connections 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52cc078dc0 0x7f52cc07b280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f530015d1e0 0x7f5300152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53001560f0 0x7f530015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 --2- 10.20.193.10:0/2281324008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530006fde0 0x7f530015bce0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 >> 10.20.193.10:0/2281324008 conn(0x7f53000cd5d0 msgr2=0x7f530015efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 shutdown_connections 2026-02-17T11:54:57.393 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 -- 10.20.193.10:0/2281324008 wait complete. 2026-02-17T11:54:57.394 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:54:57.389+0000 7f53057e4640 1 librados: shutdown 2026-02-17T11:54:57.400 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:55:05.012 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:55:05.080 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.074+0000 7f1b7b2a0640 10 monclient: get_monmap_and_config 2026-02-17T11:55:05.080 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.074+0000 7f1b7b2a0640 10 monclient: build_initial_monmap 2026-02-17T11:55:05.080 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient: monmap: 2026-02-17T11:55:05.080 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:05.081 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:05.081 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:55:05.075258+0000 2026-02-17T11:55:05.081 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:55:05.075258+0000 2026-02-17T11:55:05.081 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:05.081 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:05.081 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:05.081 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:05.082 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:05.082 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:05.082 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:05.082 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:05.082 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:05.082 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 1 Processor -- start 2026-02-17T11:55:05.082 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 1 -- start start 2026-02-17T11:55:05.082 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient: init 2026-02-17T11:55:05.083 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:05.083 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient: _add_conns ranks=[4,5,2,3,0,1] 2026-02-17T11:55:05.083 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1b741502e0 0x7f1b74159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:05.083 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient(hunting): picked mon.noname-b con 0x7f1b741502e0 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:05.083 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1b741506c0 0x7f1b7415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:05.083 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient(hunting): picked mon.noname-c con 0x7f1b741506c0 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:05.083 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1b7415bf40 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:05.083 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7415c380 con 0x7f1b7415bf40 2026-02-17T11:55:05.084 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:05.084 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7415a070 con 0x7f1b741502e0 2026-02-17T11:55:05.084 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:05.084 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7415afb0 con 0x7f1b741506c0 2026-02-17T11:55:05.084 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:05.084 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.075+0000 7f1b7b2a0640 10 monclient(hunting): authenticate will time out at 974.796997s 2026-02-17T11:55:05.084 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b78814640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1b741506c0 0x7f1b7415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:05.084 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b79015640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1b741502e0 0x7f1b74159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:05.085 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b78814640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1b741506c0 0x7f1b7415ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:40976/0 (socket says 10.20.193.10:40976) 2026-02-17T11:55:05.085 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b78814640 1 -- 10.20.193.10:0/848889905 learned_addr learned my addr 10.20.193.10:0/848889905 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:05.085 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b78814640 10 monclient(hunting): get_auth_request con 0x7f1b741506c0 auth_method 0 2026-02-17T11:55:05.085 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b78814640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:05.085 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b78814640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:05.085 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b78814640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:05.085 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b79015640 10 monclient(hunting): get_auth_request con 0x7f1b741502e0 auth_method 0 2026-02-17T11:55:05.085 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b79015640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:05.086 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b79015640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:05.086 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.076+0000 7f1b79015640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:05.086 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.077+0000 7f1b78814640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:05.086 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.077+0000 7f1b78814640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:05.086 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.077+0000 7f1b78814640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:05.086 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.077+0000 7f1b79015640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:05.086 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.077+0000 7f1b79015640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:05.086 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.077+0000 7f1b79015640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:05.087 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.078+0000 7f1b79015640 10 monclient(hunting): handle_auth_done global_id 4306 payload 274 2026-02-17T11:55:05.087 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.078+0000 7f1b79015640 1 -- 10.20.193.10:0/848889905 >> v2:10.20.193.153:3300/0 conn(0x7f1b741506c0 msgr2=0x7f1b7415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:05.087 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.078+0000 7f1b79015640 1 --2- 10.20.193.10:0/848889905 >> v2:10.20.193.153:3300/0 conn(0x7f1b741506c0 0x7f1b7415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:05.087 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.078+0000 7f1b79015640 1 -- 10.20.193.10:0/848889905 >> v1:10.20.193.153:6789/0 conn(0x7f1b7415bf40 legacy=0x7f1b7406fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:05.087 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.078+0000 7f1b79015640 10 monclient: _finish_hunting 0 2026-02-17T11:55:05.087 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.078+0000 7f1b79015640 1 monclient: found mon.noname-b 2026-02-17T11:55:05.087 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.078+0000 7f1b79015640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:05.087 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.078+0000 7f1b79015640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:05.088 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.078+0000 7f1b79015640 1 -- 10.20.193.10:0/848889905 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7415a290 con 0x7f1b741502e0 2026-02-17T11:55:05.097 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.079+0000 7f1b79015640 1 --2- 10.20.193.10:0/848889905 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b741502e0 0x7f1b74159b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b7415b130 tx=0x7f1b6402ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd1a10d700533d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:05.098 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 1 -- 10.20.193.10:0/848889905 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6403c070 con 0x7f1b741502e0 2026-02-17T11:55:05.098 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:05.098 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:05.098 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 10 monclient: dump: 2026-02-17T11:55:05.098 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:05.098 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:05.098 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:05.099 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:05.099 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:05.099 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:05.099 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:05.099 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:05.099 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:05.099 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:05.099 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 10 monclient: _finish_auth 0 2026-02-17T11:55:05.100 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:05.100 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:05.100 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 1 -- 10.20.193.10:0/848889905 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6402fad0 con 0x7f1b741502e0 2026-02-17T11:55:05.100 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 5 monclient: authenticate success, global_id 4306 2026-02-17T11:55:05.100 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:05.100 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:05.100 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 1 -- 10.20.193.10:0/848889905 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64037440 con 0x7f1b741502e0 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 4 set_mon_vals no callback set 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b63fff640 10 monclient: dump: 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:05.101 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 10 monclient: shutdown 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/848889905 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b741502e0 msgr2=0x7f1b74159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 1 --2- 10.20.193.10:0/848889905 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b741502e0 0x7f1b74159b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b7415b130 tx=0x7f1b6402ee60 comp rx=0 tx=0).stop 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/848889905 shutdown_connections 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 1 --2- 10.20.193.10:0/848889905 >> v2:10.20.193.153:3300/0 conn(0x7f1b741506c0 0x7f1b7415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:05.102 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 1 --2- 10.20.193.10:0/848889905 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b741502e0 0x7f1b74159b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/848889905 >> 10.20.193.10:0/848889905 conn(0x7f1b740cd5d0 msgr2=0x7f1b740cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/848889905 shutdown_connections 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.081+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/848889905 wait complete. 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 10 monclient: build_initial_monmap 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 10 monclient: monmap: 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:05.103 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 1 librados: starting msgr at 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 1 librados: starting objecter 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 1 Processor -- start 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 1 -- start start 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 1 librados: setting wanted keys 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 1 librados: calling monclient init 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 10 monclient: init 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.082+0000 7f1b7b2a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:05.104 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b741502e0 0x7f1b741f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 10 monclient(hunting): picked mon.noname-a con 0x7f1b741502e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b741506c0 0x7f1b740c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 10 monclient(hunting): picked mon.noname-c con 0x7f1b741506c0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b7415bf40 0x7f1b741f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 10 monclient(hunting): picked mon.noname-b con 0x7f1b7415bf40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7415b200 con 0x7f1b741502e0 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7415a850 con 0x7f1b7415bf40 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:05.105 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7415b4e0 con 0x7f1b741506c0 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b7b2a0640 10 monclient(hunting): authenticate will time out at 974.804050s 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b78814640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b741506c0 0x7f1b740c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b79816640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b7415bf40 0x7f1b741f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b78814640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b741506c0 0x7f1b740c1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:40980/0 (socket says 10.20.193.10:40980) 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b78814640 1 -- 10.20.193.10:0/2192927719 learned_addr learned my addr 10.20.193.10:0/2192927719 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b78814640 10 monclient(hunting): get_auth_request con 0x7f1b741506c0 auth_method 0 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b78814640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b78814640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b78814640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b79816640 10 monclient(hunting): get_auth_request con 0x7f1b7415bf40 auth_method 0 2026-02-17T11:55:05.106 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b79816640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b79816640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b79816640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.083+0000 7f1b79015640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b741502e0 0x7f1b741f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b78814640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b78814640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b78814640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79816640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79816640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79816640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79015640 10 monclient(hunting): get_auth_request con 0x7f1b741502e0 auth_method 0 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79015640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:05.107 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79015640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79015640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79015640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79015640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.084+0000 7f1b79015640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 10 monclient(hunting): handle_auth_done global_id 4309 payload 824 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 1 -- 10.20.193.10:0/2192927719 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b741506c0 msgr2=0x7f1b740c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b741506c0 0x7f1b740c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 1 -- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b741502e0 msgr2=0x7f1b741f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b741502e0 0x7f1b741f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 10 monclient: _finish_hunting 0 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 1 monclient: found mon.noname-b 2026-02-17T11:55:05.108 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.085+0000 7f1b79816640 1 -- 10.20.193.10:0/2192927719 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b741f1cc0 con 0x7f1b7415bf40 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.086+0000 7f1b79816640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b7415bf40 0x7f1b741f0dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000be20 tx=0x7f1b7000bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.086+0000 7f1b61ffb640 10 client.?.objecter ms_handle_connect 0x7f1b7415bf40 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.086+0000 7f1b61ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b61ffb640 1 -- 10.20.193.10:0/2192927719 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70006e60 con 0x7f1b7415bf40 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b61ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b61ffb640 10 monclient: dump: 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:05.109 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b61ffb640 10 monclient: _finish_auth 0 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b61ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b7b2a0640 5 monclient: authenticate success, global_id 4309 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b7b2a0640 10 monclient: _renew_subs 2026-02-17T11:55:05.110 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b7b2a0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b741f1700 con 0x7f1b7415bf40 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b7b2a0640 10 client.4309.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b7b2a0640 10 monclient: _renew_subs 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b7b2a0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b740c11c0 con 0x7f1b7415bf40 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.087+0000 7f1b7b2a0640 1 librados: init done 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b61ffb640 1 -- 10.20.193.10:0/2192927719 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b70010070 con 0x7f1b7415bf40 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b61ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b61ffb640 1 -- 10.20.193.10:0/2192927719 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000ccb0 con 0x7f1b7415bf40 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b61ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b61ffb640 10 monclient: dump: 2026-02-17T11:55:05.111 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b637fe640 4 set_mon_vals no callback set 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b7b2a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b7b2a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b7b2a0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:05.112 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.088+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b74159b30 con 0x7f1b7415bf40 2026-02-17T11:55:05.114 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.100+0000 7f1b61ffb640 1 -- 10.20.193.10:0/2192927719 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f1b7001d030 con 0x7f1b7415bf40 2026-02-17T11:55:05.114 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.100+0000 7f1b61ffb640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b44078d70 0x7f1b4407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:05.114 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.100+0000 7f1b79015640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b44078d70 0x7f1b4407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:05.114 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.100+0000 7f1b79015640 10 monclient: get_auth_request con 0x7f1b44078d70 auth_method 0 2026-02-17T11:55:05.114 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.100+0000 7f1b61ffb640 10 client.4309.objecter ms_handle_connect 0x7f1b44078d70 2026-02-17T11:55:05.114 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.100+0000 7f1b79015640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b44078d70 0x7f1b4407b230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b64039000 tx=0x7f1b64033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:05.114 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.101+0000 7f1b61ffb640 1 -- 10.20.193.10:0/2192927719 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f1b70097120 con 0x7f1b7415bf40 2026-02-17T11:55:05.114 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.101+0000 7f1b61ffb640 10 client.4309.objecter ms_dispatch2 0x7f1b74000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:55:05.115 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.101+0000 7f1b61ffb640 3 client.4309.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:55:05.115 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.101+0000 7f1b61ffb640 3 client.4309.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:55:05.115 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.101+0000 7f1b61ffb640 20 client.4309.objecter dump_active .. 0 homeless 2026-02-17T11:55:05.204 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.203+0000 7f1b61ffb640 1 -- 10.20.193.10:0/2192927719 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1b700618c0 con 0x7f1b7415bf40 2026-02-17T11:55:05.204 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.203+0000 7f1b61ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:05.204 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.203+0000 7f1b61ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:05.296 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.295+0000 7f1b7b2a0640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:05.296 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.295+0000 7f1b7b2a0640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:05.297 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.295+0000 7f1b7b2a0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:05.297 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.295+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b74070510 con 0x7f1b7415bf40 2026-02-17T11:55:05.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.306+0000 7f1b61ffb640 1 -- 10.20.193.10:0/2192927719 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f1b70065bc0 con 0x7f1b7415bf40 2026-02-17T11:55:05.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.306+0000 7f1b61ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:05.307 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.306+0000 7f1b61ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:05.307 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:55:05.307 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:55:05.310 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 10 librados: watch_flush enter 2026-02-17T11:55:05.310 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 10 librados: watch_flush exit 2026-02-17T11:55:05.310 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 20 client.4309.objecter shutdown clearing up homeless session... 2026-02-17T11:55:05.310 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 10 client.4309.objecter successfully canceled tick 2026-02-17T11:55:05.310 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b44078d70 msgr2=0x7f1b4407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b44078d70 0x7f1b4407b230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b64039000 tx=0x7f1b64033000 comp rx=0 tx=0).stop 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 10 monclient: shutdown 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b7415bf40 msgr2=0x7f1b741f0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b7415bf40 0x7f1b741f0dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000be20 tx=0x7f1b7000bf20 comp rx=0 tx=0).stop 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 shutdown_connections 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b44078d70 0x7f1b4407b230 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b7415bf40 0x7f1b741f0dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b741506c0 0x7f1b740c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 --2- 10.20.193.10:0/2192927719 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b741502e0 0x7f1b741f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 >> 10.20.193.10:0/2192927719 conn(0x7f1b740cd5d0 msgr2=0x7f1b7406eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:05.311 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 shutdown_connections 2026-02-17T11:55:05.312 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 -- 10.20.193.10:0/2192927719 wait complete. 2026-02-17T11:55:05.312 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:05.308+0000 7f1b7b2a0640 1 librados: shutdown 2026-02-17T11:55:05.318 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:55:12.931 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:55:12.995 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.994+0000 7fa127b55640 10 monclient: get_monmap_and_config 2026-02-17T11:55:12.995 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.994+0000 7fa127b55640 10 monclient: build_initial_monmap 2026-02-17T11:55:12.995 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.994+0000 7fa127b55640 10 monclient: monmap: 2026-02-17T11:55:12.995 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:55:12.995364+0000 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:55:12.995364+0000 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.994+0000 7fa127b55640 1 Processor -- start 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.994+0000 7fa127b55640 1 -- start start 2026-02-17T11:55:12.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.994+0000 7fa127b55640 10 monclient: init 2026-02-17T11:55:12.998 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:12.998 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 10 monclient: _add_conns ranks=[1,3,2,5,0,4] 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa120155f60 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa1200c1d10 0x7fa12015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 10 monclient(hunting): picked mon.noname-a con 0x7fa1200c1d10 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa120156340 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12006c950 con 0x7fa120155f60 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12006cc30 con 0x7fa120156340 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa120069420 con 0x7fa1200c1d10 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.995+0000 7fa127b55640 10 monclient(hunting): authenticate will time out at 982.717507s 2026-02-17T11:55:12.999 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1258ca640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fa120155f60 0x7fa1200c8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:38144/0 (socket says 10.20.193.10:38144) 2026-02-17T11:55:13.000 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1258ca640 1 -- 10.20.193.10:0/1417586996 learned_addr learned my addr 10.20.193.10:0/1417586996 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:13.000 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1250c9640 1 --2- 10.20.193.10:0/1417586996 >> v2:10.20.193.10:3300/0 conn(0x7fa1200c1d10 0x7fa12015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:13.000 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1250c9640 10 monclient(hunting): get_auth_request con 0x7fa1200c1d10 auth_method 0 2026-02-17T11:55:13.000 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1250c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:13.000 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1250c9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:13.000 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1250c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:13.000 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1250c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:13.000 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1250c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:13.000 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.996+0000 7fa1250c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:13.002 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 1 -- 10.20.193.10:0/1417586996 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139010161 0 0) 0x7fa12006c950 con 0x7fa120155f60 2026-02-17T11:55:13.002 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 10 monclient(hunting): _negotiate 2026-02-17T11:55:13.002 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:13.002 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:13.002 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 10 monclient(hunting): my global_id is 4312 2026-02-17T11:55:13.002 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 1 -- 10.20.193.10:0/1417586996 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa108003620 con 0x7fa120155f60 2026-02-17T11:55:13.002 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 1 -- 10.20.193.10:0/1417586996 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924284471 0 0) 0x7fa12006cc30 con 0x7fa120156340 2026-02-17T11:55:13.002 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 10 monclient(hunting): _negotiate 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 10 monclient(hunting): my global_id is 4292 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1248c8640 1 -- 10.20.193.10:0/1417586996 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa12006c950 con 0x7fa120156340 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1250c9640 10 monclient(hunting): handle_auth_done global_id 4281 payload 274 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1250c9640 1 -- 10.20.193.10:0/1417586996 >> v1:10.20.193.153:6789/0 conn(0x7fa120156340 legacy=0x7fa12015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1250c9640 1 -- 10.20.193.10:0/1417586996 >> v1:10.20.193.71:6789/0 conn(0x7fa120155f60 legacy=0x7fa1200c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1250c9640 10 monclient: _finish_hunting 0 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1250c9640 1 monclient: found mon.noname-a 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1250c9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1250c9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:13.003 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.997+0000 7fa1250c9640 1 -- 10.20.193.10:0/1417586996 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12006cf10 con 0x7fa1200c1d10 2026-02-17T11:55:13.004 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:12.999+0000 7fa1250c9640 1 --2- 10.20.193.10:0/1417586996 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 0x7fa12015bec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1140098a0 tx=0x7fa11402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebdf858390191de server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 1 -- 10.20.193.10:0/1417586996 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11403c070 con 0x7fa1200c1d10 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 10 monclient: dump: 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 10 monclient: _finish_auth 0 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 10 monclient: _check_auth_tickets 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 1 -- 10.20.193.10:0/1417586996 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11402fb70 con 0x7fa1200c1d10 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 1 -- 10.20.193.10:0/1417586996 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114037440 con 0x7fa1200c1d10 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa1248c8640 10 monclient: dump: 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:13.008 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa127b55640 5 monclient: authenticate success, global_id 4281 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa127b55640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.001+0000 7fa127b55640 4 set_mon_vals no callback set 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.002+0000 7fa127b55640 10 monclient: shutdown 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.002+0000 7fa127b55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.002+0000 7fa127b55640 1 -- 10.20.193.10:0/1417586996 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 msgr2=0x7fa12015bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.002+0000 7fa127b55640 1 --2- 10.20.193.10:0/1417586996 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 0x7fa12015bec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1140098a0 tx=0x7fa11402ee60 comp rx=0 tx=0).stop 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.002+0000 7fa127b55640 1 -- 10.20.193.10:0/1417586996 shutdown_connections 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.002+0000 7fa127b55640 1 --2- 10.20.193.10:0/1417586996 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 0x7fa12015bec0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.002+0000 7fa127b55640 1 -- 10.20.193.10:0/1417586996 >> 10.20.193.10:0/1417586996 conn(0x7fa1200cb080 msgr2=0x7fa1200cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.002+0000 7fa127b55640 1 -- 10.20.193.10:0/1417586996 shutdown_connections 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.002+0000 7fa127b55640 1 -- 10.20.193.10:0/1417586996 wait complete. 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient: build_initial_monmap 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient: monmap: 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 librados: starting msgr at 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 librados: starting objecter 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 Processor -- start 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 -- start start 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 librados: setting wanted keys 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 librados: calling monclient init 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient: init 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 0x7fa12014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient(hunting): picked mon.noname-a con 0x7fa1200c1d10 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa120155f60 0x7fa12006eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient(hunting): picked mon.noname-b con 0x7fa120155f60 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa120156340 0x7fa1200c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient(hunting): picked mon.noname-c con 0x7fa120156340 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa12015cdf0 con 0x7fa1200c1d10 2026-02-17T11:55:13.009 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa12015cb10 con 0x7fa120155f60 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa1200cf410 con 0x7fa120156340 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.003+0000 7fa127b55640 10 monclient(hunting): authenticate will time out at 982.725998s 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 0x7fa12014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 0x7fa12014fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:37512/0 (socket says 10.20.193.10:37512) 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 1 -- 10.20.193.10:0/1696289109 learned_addr learned my addr 10.20.193.10:0/1696289109 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 10 monclient(hunting): get_auth_request con 0x7fa1200c1d10 auth_method 0 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1250c9640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa120155f60 0x7fa12006eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1250c9640 10 monclient(hunting): get_auth_request con 0x7fa120155f60 auth_method 0 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1250c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1250c9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1250c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1260cb640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa120156340 0x7fa1200c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1258ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1260cb640 10 monclient(hunting): get_auth_request con 0x7fa120156340 auth_method 0 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1260cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1260cb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.004+0000 7fa1260cb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.005+0000 7fa1250c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.005+0000 7fa1250c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.005+0000 7fa1250c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.005+0000 7fa1260cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.005+0000 7fa1260cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.005+0000 7fa1260cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 10 monclient(hunting): handle_auth_done global_id 4284 payload 824 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 1 -- 10.20.193.10:0/1696289109 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa120156340 msgr2=0x7fa1200c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa120156340 0x7fa1200c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 1 -- 10.20.193.10:0/1696289109 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa120155f60 msgr2=0x7fa12006eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa120155f60 0x7fa12006eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 10 monclient: _finish_hunting 0 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 1 monclient: found mon.noname-a 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:13.010 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.006+0000 7fa1258ca640 1 -- 10.20.193.10:0/1696289109 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1201f5110 con 0x7fa1200c1d10 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.007+0000 7fa1258ca640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 0x7fa12014fff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c730 tx=0x7fa11000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.007+0000 7fa10e7fc640 10 client.?.objecter ms_handle_connect 0x7fa1200c1d10 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.007+0000 7fa10e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 1 -- 10.20.193.10:0/1696289109 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110017070 con 0x7fa1200c1d10 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 10 monclient: dump: 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:13.011 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 1 -- 10.20.193.10:0/1696289109 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa110005bd0 con 0x7fa1200c1d10 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 1 -- 10.20.193.10:0/1696289109 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110007070 con 0x7fa1200c1d10 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10ffff640 4 set_mon_vals no callback set 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 5 monclient: authenticate success, global_id 4284 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 10 monclient: _renew_subs 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa120150890 con 0x7fa1200c1d10 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa10e7fc640 10 monclient: dump: 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 10 client.4284.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 10 monclient: _renew_subs 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa120150e50 con 0x7fa1200c1d10 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 1 librados: init done 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:13.012 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.009+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1200c0e20 con 0x7fa1200c1d10 2026-02-17T11:55:13.022 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.021+0000 7fa10e7fc640 1 -- 10.20.193.10:0/1696289109 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7fa110007210 con 0x7fa1200c1d10 2026-02-17T11:55:13.023 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.021+0000 7fa10e7fc640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa0f0078da0 0x7fa0f007b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:13.023 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.021+0000 7fa1250c9640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa0f0078da0 0x7fa0f007b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:13.023 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.021+0000 7fa1250c9640 10 monclient: get_auth_request con 0x7fa0f0078da0 auth_method 0 2026-02-17T11:55:13.023 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.022+0000 7fa10e7fc640 10 client.4284.objecter ms_handle_connect 0x7fa0f0078da0 2026-02-17T11:55:13.023 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.022+0000 7fa1250c9640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa0f0078da0 0x7fa0f007b260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa114039000 tx=0x7fa114033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:13.025 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.024+0000 7fa10e7fc640 1 -- 10.20.193.10:0/1696289109 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fa11005d470 con 0x7fa1200c1d10 2026-02-17T11:55:13.025 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.024+0000 7fa10e7fc640 10 client.4284.objecter ms_dispatch2 0x7fa120000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:55:13.025 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.024+0000 7fa10e7fc640 3 client.4284.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:55:13.026 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.024+0000 7fa10e7fc640 3 client.4284.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:55:13.026 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.024+0000 7fa10e7fc640 20 client.4284.objecter dump_active .. 0 homeless 2026-02-17T11:55:13.129 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.127+0000 7fa10e7fc640 1 -- 10.20.193.10:0/1696289109 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa110021020 con 0x7fa1200c1d10 2026-02-17T11:55:13.129 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.127+0000 7fa10e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:13.129 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.127+0000 7fa10e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:13.216 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.214+0000 7fa127b55640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:13.217 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.214+0000 7fa127b55640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:13.217 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.214+0000 7fa127b55640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:13.217 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.214+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1200ca120 con 0x7fa1200c1d10 2026-02-17T11:55:13.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.225+0000 7fa10e7fc640 1 -- 10.20.193.10:0/1696289109 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fa110061430 con 0x7fa1200c1d10 2026-02-17T11:55:13.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.225+0000 7fa10e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:13.227 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.225+0000 7fa10e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:13.228 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:55:13.228 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:55:13.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 10 librados: watch_flush enter 2026-02-17T11:55:13.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 10 librados: watch_flush exit 2026-02-17T11:55:13.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 20 client.4284.objecter shutdown clearing up homeless session... 2026-02-17T11:55:13.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 10 client.4284.objecter successfully canceled tick 2026-02-17T11:55:13.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa0f0078da0 msgr2=0x7fa0f007b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:13.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa0f0078da0 0x7fa0f007b260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa114039000 tx=0x7fa114033000 comp rx=0 tx=0).stop 2026-02-17T11:55:13.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 10 monclient: shutdown 2026-02-17T11:55:13.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:13.231 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 msgr2=0x7fa12014fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 0x7fa12014fff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c730 tx=0x7fa11000cc00 comp rx=0 tx=0).stop 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 shutdown_connections 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa0f0078da0 0x7fa0f007b260 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa120156340 0x7fa1200c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa120155f60 0x7fa12006eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 --2- 10.20.193.10:0/1696289109 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa1200c1d10 0x7fa12014fff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 >> 10.20.193.10:0/1696289109 conn(0x7fa1200cb080 msgr2=0x7fa120070040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 shutdown_connections 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 -- 10.20.193.10:0/1696289109 wait complete. 2026-02-17T11:55:13.232 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:13.228+0000 7fa127b55640 1 librados: shutdown 2026-02-17T11:55:13.239 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:55:14.694 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:01:31.862 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:14.696 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:01:31.864 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:14.714 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:01:31.883 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:14.725 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:01:31.853 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:14.725 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:01:31.888 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:14.726 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:01:31.855 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:14.726 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:01:31.890 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:14.744 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:01:31.873 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:14.745 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:01:31.908 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:20.851 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:55:20.914 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.912+0000 7f74bb238640 10 monclient: get_monmap_and_config 2026-02-17T11:55:20.914 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.912+0000 7f74bb238640 10 monclient: build_initial_monmap 2026-02-17T11:55:20.914 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.912+0000 7f74bb238640 10 monclient: monmap: 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:55:20.913808+0000 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:55:20.913808+0000 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:20.915 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:20.916 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:20.918 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 1 Processor -- start 2026-02-17T11:55:20.918 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 1 -- start start 2026-02-17T11:55:20.918 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 10 monclient: init 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 10 monclient: _add_conns ranks=[2,1,4,0,3,5] 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f74b415f5a0 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f74b40c8630 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f74b415f980 0x7f74b40737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 10 monclient(hunting): picked mon.noname-b con 0x7f74b415f980 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b406dd90 con 0x7f74b40c8630 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b4074150 con 0x7f74b415f5a0 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f74b4076990 con 0x7f74b415f980 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:20.919 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.913+0000 7f74bb238640 10 monclient(hunting): authenticate will time out at 990.635603s 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.914+0000 7f74b97ae640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f74b415f980 0x7f74b40737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.914+0000 7f74b8fad640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f74b415f5a0 0x7f74b406edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:57992/0 (socket says 10.20.193.10:57992) 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.914+0000 7f74b8fad640 1 -- 10.20.193.10:0/1392012756 learned_addr learned my addr 10.20.193.10:0/1392012756 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.914+0000 7f74b97ae640 10 monclient(hunting): get_auth_request con 0x7f74b415f980 auth_method 0 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.914+0000 7f74b97ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.914+0000 7f74b97ae640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.914+0000 7f74b97ae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.915+0000 7f74b97ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.915+0000 7f74b97ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.915+0000 7f74b97ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74ab7fe640 1 -- 10.20.193.10:0/1392012756 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354979027 0 0) 0x7f74b4074150 con 0x7f74b415f5a0 2026-02-17T11:55:20.920 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74ab7fe640 10 monclient(hunting): _negotiate 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74ab7fe640 10 monclient(hunting): my global_id is 4298 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74ab7fe640 1 -- 10.20.193.10:0/1392012756 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74a0003620 con 0x7f74b415f5a0 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74b97ae640 10 monclient(hunting): handle_auth_done global_id 4318 payload 274 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74b97ae640 1 -- 10.20.193.10:0/1392012756 >> v1:10.20.193.153:6789/0 conn(0x7f74b415f5a0 legacy=0x7f74b406edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74b97ae640 1 -- 10.20.193.10:0/1392012756 >> v1:10.20.193.71:6789/0 conn(0x7f74b40c8630 legacy=0x7f74b4076280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74b97ae640 10 monclient: _finish_hunting 0 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74b97ae640 1 monclient: found mon.noname-b 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74b97ae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74b97ae640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:20.921 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.916+0000 7f74b97ae640 1 -- 10.20.193.10:0/1392012756 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b406e030 con 0x7f74b415f980 2026-02-17T11:55:20.922 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.919+0000 7f74b97ae640 1 --2- 10.20.193.10:0/1392012756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b415f980 0x7f74b40737c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009d90 tx=0x7f74b002f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b5d58f3ad9ef12 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:20.926 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 1 -- 10.20.193.10:0/1392012756 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b003c070 con 0x7f74b415f980 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 10 monclient: dump: 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:20.927 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 1 -- 10.20.193.10:0/1392012756 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b0037440 con 0x7f74b415f980 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 1 -- 10.20.193.10:0/1392012756 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b0037810 con 0x7f74b415f980 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:20.928 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74ab7fe640 10 monclient: dump: 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 5 monclient: authenticate success, global_id 4318 2026-02-17T11:55:20.929 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 4 set_mon_vals no callback set 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 10 monclient: shutdown 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 1 -- 10.20.193.10:0/1392012756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b415f980 msgr2=0x7f74b40737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 1 --2- 10.20.193.10:0/1392012756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b415f980 0x7f74b40737c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009d90 tx=0x7f74b002f230 comp rx=0 tx=0).stop 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 1 -- 10.20.193.10:0/1392012756 shutdown_connections 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 1 --2- 10.20.193.10:0/1392012756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b415f980 0x7f74b40737c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 1 -- 10.20.193.10:0/1392012756 >> 10.20.193.10:0/1392012756 conn(0x7f74b40ca730 msgr2=0x7f74b40cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 1 -- 10.20.193.10:0/1392012756 shutdown_connections 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.921+0000 7f74bb238640 1 -- 10.20.193.10:0/1392012756 wait complete. 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.922+0000 7f74bb238640 10 monclient: build_initial_monmap 2026-02-17T11:55:20.930 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.922+0000 7f74bb238640 10 monclient: monmap: 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.922+0000 7f74bb238640 1 librados: starting msgr at 2026-02-17T11:55:20.931 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.922+0000 7f74bb238640 1 librados: starting objecter 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.922+0000 7f74bb238640 1 Processor -- start 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.922+0000 7f74bb238640 1 -- start start 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.922+0000 7f74bb238640 1 librados: setting wanted keys 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.922+0000 7f74bb238640 1 librados: calling monclient init 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.922+0000 7f74bb238640 10 monclient: init 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b40c8630 0x7f74b41f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient(hunting): picked mon.noname-b con 0x7f74b40c8630 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f74b415f5a0 0x7f74b4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient(hunting): picked mon.noname-a con 0x7f74b415f5a0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f74b415f980 0x7f74b40bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:20.932 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient(hunting): picked mon.noname-c con 0x7f74b415f980 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f74b406e8d0 con 0x7f74b415f5a0 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74b406e5f0 con 0x7f74b40c8630 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4160100 con 0x7f74b415f980 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74bb238640 10 monclient(hunting): authenticate will time out at 990.645107s 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b40c8630 0x7f74b41f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b97ae640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f74b415f980 0x7f74b40bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b40c8630 0x7f74b41f7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:46938/0 (socket says 10.20.193.10:46938) 2026-02-17T11:55:20.933 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 1 -- 10.20.193.10:0/3094358478 learned_addr learned my addr 10.20.193.10:0/3094358478 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 10 monclient(hunting): get_auth_request con 0x7f74b40c8630 auth_method 0 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74abfff640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f74b415f5a0 0x7f74b4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b97ae640 10 monclient(hunting): get_auth_request con 0x7f74b415f980 auth_method 0 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b97ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b97ae640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b97ae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74b8fad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:20.934 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74abfff640 10 monclient(hunting): get_auth_request con 0x7f74b415f5a0 auth_method 0 2026-02-17T11:55:20.935 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:20.935 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:20.935 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.923+0000 7f74abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:20.935 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.924+0000 7f74b97ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:20.935 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.924+0000 7f74b97ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:20.935 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.924+0000 7f74b97ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:20.935 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.924+0000 7f74abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:20.935 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.924+0000 7f74abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:20.935 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.924+0000 7f74abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:20.937 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 10 monclient(hunting): handle_auth_done global_id 4324 payload 824 2026-02-17T11:55:20.937 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 1 -- 10.20.193.10:0/3094358478 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f74b415f980 msgr2=0x7f74b40bec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f74b415f980 0x7f74b40bec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 1 -- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f74b415f5a0 msgr2=0x7f74b4151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f74b415f5a0 0x7f74b4151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 10 monclient: _finish_hunting 0 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 1 monclient: found mon.noname-b 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.925+0000 7f74b8fad640 1 -- 10.20.193.10:0/3094358478 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b41f8610 con 0x7f74b40c8630 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.926+0000 7f74b8fad640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b40c8630 0x7f74b41f7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c730 tx=0x7f74a400cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.926+0000 7f74a97fa640 10 client.?.objecter ms_handle_connect 0x7f74b40c8630 2026-02-17T11:55:20.938 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.926+0000 7f74a97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74a97fa640 1 -- 10.20.193.10:0/3094358478 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4017070 con 0x7f74b40c8630 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74a97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74a97fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74a97fa640 10 monclient: dump: 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:20.939 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74a97fa640 10 monclient: _finish_auth 0 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74a97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74a97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74bb238640 5 monclient: authenticate success, global_id 4324 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74bb238640 10 monclient: _renew_subs 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74bb238640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b41f7d70 con 0x7f74b40c8630 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.927+0000 7f74bb238640 10 client.4324.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74bb238640 10 monclient: _renew_subs 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74bb238640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:20.940 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b41f8330 con 0x7f74b40c8630 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74bb238640 1 librados: init done 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74a97fa640 1 -- 10.20.193.10:0/3094358478 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a4005bb0 con 0x7f74b40c8630 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74a97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74a97fa640 1 -- 10.20.193.10:0/3094358478 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4021060 con 0x7f74b40c8630 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74a97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74a97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74aaffd640 4 set_mon_vals no callback set 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74a97fa640 10 monclient: dump: 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:20.941 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74bb238640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74bb238640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74bb238640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:20.942 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.928+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b4076280 con 0x7f74b40c8630 2026-02-17T11:55:20.943 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.940+0000 7f74a97fa640 1 -- 10.20.193.10:0/3094358478 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f74a4024080 con 0x7f74b40c8630 2026-02-17T11:55:20.943 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.940+0000 7f74a97fa640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7484078d70 0x7f748407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:20.943 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.940+0000 7f74abfff640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7484078d70 0x7f748407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:20.943 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.940+0000 7f74abfff640 10 monclient: get_auth_request con 0x7f7484078d70 auth_method 0 2026-02-17T11:55:20.944 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.941+0000 7f74abfff640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7484078d70 0x7f748407b230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f74b40c94b0 tx=0x7f749c007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:20.944 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:20.941+0000 7f74a97fa640 10 client.4324.objecter ms_handle_connect 0x7f7484078d70 2026-02-17T11:55:21.049 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.047+0000 7f74a97fa640 1 -- 10.20.193.10:0/3094358478 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f74a405d500 con 0x7f74b40c8630 2026-02-17T11:55:21.049 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.047+0000 7f74a97fa640 10 client.4324.objecter ms_dispatch2 0x7f74b4000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:55:21.049 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.047+0000 7f74a97fa640 3 client.4324.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:55:21.050 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.047+0000 7f74a97fa640 3 client.4324.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:55:21.050 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.047+0000 7f74a97fa640 20 client.4324.objecter dump_active .. 0 homeless 2026-02-17T11:55:21.050 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.047+0000 7f74a97fa640 1 -- 10.20.193.10:0/3094358478 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f74a40614c0 con 0x7f74b40c8630 2026-02-17T11:55:21.050 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.047+0000 7f74a97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:21.050 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.047+0000 7f74a97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:21.136 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.134+0000 7f74bb238640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:21.136 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.134+0000 7f74bb238640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:21.137 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.134+0000 7f74bb238640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:21.137 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.134+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74b4159760 con 0x7f74b40c8630 2026-02-17T11:55:21.147 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.145+0000 7f74a97fa640 1 -- 10.20.193.10:0/3094358478 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f74a40657c0 con 0x7f74b40c8630 2026-02-17T11:55:21.147 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.145+0000 7f74a97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:21.147 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.145+0000 7f74a97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:21.147 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:55:21.148 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:55:21.150 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 10 librados: watch_flush enter 2026-02-17T11:55:21.150 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 10 librados: watch_flush exit 2026-02-17T11:55:21.150 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 20 client.4324.objecter shutdown clearing up homeless session... 2026-02-17T11:55:21.150 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 10 client.4324.objecter successfully canceled tick 2026-02-17T11:55:21.150 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7484078d70 msgr2=0x7f748407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7484078d70 0x7f748407b230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f74b40c94b0 tx=0x7f749c007f50 comp rx=0 tx=0).stop 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 10 monclient: shutdown 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b40c8630 msgr2=0x7f74b41f7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b40c8630 0x7f74b41f7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c730 tx=0x7f74a400cc00 comp rx=0 tx=0).stop 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 shutdown_connections 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7484078d70 0x7f748407b230 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f74b415f980 0x7f74b40bec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f74b415f5a0 0x7f74b4151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 --2- 10.20.193.10:0/3094358478 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f74b40c8630 0x7f74b41f7710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:21.151 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 >> 10.20.193.10:0/3094358478 conn(0x7f74b40ca730 msgr2=0x7f74b4155b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:21.152 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 shutdown_connections 2026-02-17T11:55:21.152 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 -- 10.20.193.10:0/3094358478 wait complete. 2026-02-17T11:55:21.152 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:21.147+0000 7f74bb238640 1 librados: shutdown 2026-02-17T11:55:21.157 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:55:28.764 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.822+0000 7f010e6f3640 10 monclient: get_monmap_and_config 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.822+0000 7f010e6f3640 10 monclient: build_initial_monmap 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.822+0000 7f010e6f3640 10 monclient: monmap: 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:55:28.823975+0000 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:55:28.823975+0000 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:28.824 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 1 Processor -- start 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 1 -- start start 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient: init 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient: _add_conns ranks=[5,3,0,2,1,4] 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f01081502e0 0x7f0108159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient(hunting): picked mon.noname-c con 0x7f01081502e0 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f01081506c0 0x7f010815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient(hunting): picked mon.noname-a con 0x7f01081506c0 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f010815bf40 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010815c380 con 0x7f010815bf40 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f010815a070 con 0x7f01081506c0 2026-02-17T11:55:28.825 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f010815afb0 con 0x7f01081502e0 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.823+0000 7f010e6f3640 10 monclient(hunting): authenticate will time out at 998.545696s 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f01077fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f01081506c0 0x7f010815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f0107fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f01081502e0 0x7f0108159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f010cc69640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f010815bf40 0x7f010806fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:59308/0 (socket says 10.20.193.10:59308) 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f010cc69640 1 -- 10.20.193.10:0/2258898255 learned_addr learned my addr 10.20.193.10:0/2258898255 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f0107fff640 10 monclient(hunting): get_auth_request con 0x7f01081502e0 auth_method 0 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f0107fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f0107fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f0107fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f01077fe640 10 monclient(hunting): get_auth_request con 0x7f01081506c0 auth_method 0 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f01077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f01077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.824+0000 7f01077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.825+0000 7f0107fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.825+0000 7f0107fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.825+0000 7f0107fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.825+0000 7f01077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.825+0000 7f01077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:28.826 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.825+0000 7f01077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:28.827 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.826+0000 7f0107fff640 10 monclient(hunting): handle_auth_done global_id 4304 payload 274 2026-02-17T11:55:28.827 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.826+0000 7f0107fff640 1 -- 10.20.193.10:0/2258898255 >> v2:10.20.193.10:3300/0 conn(0x7f01081506c0 msgr2=0x7f010815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:28.827 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.826+0000 7f0107fff640 1 --2- 10.20.193.10:0/2258898255 >> v2:10.20.193.10:3300/0 conn(0x7f01081506c0 0x7f010815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:28.827 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.826+0000 7f0107fff640 1 -- 10.20.193.10:0/2258898255 >> v1:10.20.193.10:6789/0 conn(0x7f010815bf40 legacy=0x7f010806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:28.828 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.826+0000 7f0107fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:28.828 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.826+0000 7f0107fff640 1 monclient: found mon.noname-c 2026-02-17T11:55:28.828 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.826+0000 7f0107fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:28.828 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.826+0000 7f0107fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:28.828 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.826+0000 7f0107fff640 1 -- 10.20.193.10:0/2258898255 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010815a290 con 0x7f01081502e0 2026-02-17T11:55:28.829 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.827+0000 7f0107fff640 1 --2- 10.20.193.10:0/2258898255 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f01081502e0 0x7f0108159b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f010815b130 tx=0x7f00f402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=349b5fabb6df64fb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 1 -- 10.20.193.10:0/2258898255 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f403c070 con 0x7f01081502e0 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 10 monclient: dump: 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 1 -- 10.20.193.10:0/2258898255 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f402fb70 con 0x7f01081502e0 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f010e6f3640 5 monclient: authenticate success, global_id 4304 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 1 -- 10.20.193.10:0/2258898255 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4037440 con 0x7f01081502e0 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f0106ffd640 10 monclient: dump: 2026-02-17T11:55:28.831 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f010e6f3640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f010e6f3640 4 set_mon_vals no callback set 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f010e6f3640 10 monclient: shutdown 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f010e6f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f010e6f3640 1 -- 10.20.193.10:0/2258898255 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f01081502e0 msgr2=0x7f0108159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.829+0000 7f010e6f3640 1 --2- 10.20.193.10:0/2258898255 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f01081502e0 0x7f0108159b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f010815b130 tx=0x7f00f402ee60 comp rx=0 tx=0).stop 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 -- 10.20.193.10:0/2258898255 shutdown_connections 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 --2- 10.20.193.10:0/2258898255 >> v2:10.20.193.10:3300/0 conn(0x7f01081506c0 0x7f010815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 --2- 10.20.193.10:0/2258898255 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f01081502e0 0x7f0108159b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 -- 10.20.193.10:0/2258898255 >> 10.20.193.10:0/2258898255 conn(0x7f01080cd5d0 msgr2=0x7f01080cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 -- 10.20.193.10:0/2258898255 shutdown_connections 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 -- 10.20.193.10:0/2258898255 wait complete. 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 10 monclient: build_initial_monmap 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 10 monclient: monmap: 2026-02-17T11:55:28.832 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 librados: starting msgr at 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 librados: starting objecter 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 Processor -- start 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 -- start start 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 librados: setting wanted keys 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 1 librados: calling monclient init 2026-02-17T11:55:28.833 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.830+0000 7f010e6f3640 10 monclient: init 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f01081502e0 0x7f010814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient(hunting): picked mon.noname-b con 0x7f01081502e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01081506c0 0x7f01081f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient(hunting): picked mon.noname-a con 0x7f01081506c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f010815bf40 0x7f01081f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient(hunting): picked mon.noname-c con 0x7f010815bf40 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f010815b200 con 0x7f01081506c0 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f010815a850 con 0x7f01081502e0 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f010815b4e0 con 0x7f010815bf40 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010e6f3640 10 monclient(hunting): authenticate will time out at 998.553286s 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f01077fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01081506c0 0x7f01081f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010cc69640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f010815bf40 0x7f01081f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f01077fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01081506c0 0x7f01081f53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:46154/0 (socket says 10.20.193.10:46154) 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f01077fe640 1 -- 10.20.193.10:0/422192756 learned_addr learned my addr 10.20.193.10:0/422192756 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f01077fe640 10 monclient(hunting): get_auth_request con 0x7f01081506c0 auth_method 0 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f01077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f01077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f01077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010cc69640 10 monclient(hunting): get_auth_request con 0x7f010815bf40 auth_method 0 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010cc69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010cc69640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f010cc69640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.831+0000 7f0107fff640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f01081502e0 0x7f010814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f01077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f01077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f01077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f0107fff640 10 monclient(hunting): get_auth_request con 0x7f01081502e0 auth_method 0 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f0107fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f0107fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f0107fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f010cc69640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:28.834 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f010cc69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f010cc69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f0107fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f0107fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.832+0000 7f0107fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 10 monclient(hunting): handle_auth_done global_id 4296 payload 824 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 1 -- 10.20.193.10:0/422192756 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f010815bf40 msgr2=0x7f01081f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f010815bf40 0x7f01081f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 1 -- 10.20.193.10:0/422192756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f01081502e0 msgr2=0x7f010814ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f01081502e0 0x7f010814ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 1 monclient: found mon.noname-a 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:28.835 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.833+0000 7f01077fe640 1 -- 10.20.193.10:0/422192756 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010814b310 con 0x7f01081506c0 2026-02-17T11:55:28.837 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.836+0000 7f01077fe640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01081506c0 0x7f01081f53b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00f800ec10 tx=0x7f00f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:28.837 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.836+0000 7f0104ff9640 10 client.?.objecter ms_handle_connect 0x7f01081506c0 2026-02-17T11:55:28.837 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.836+0000 7f0104ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:28.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 1 -- 10.20.193.10:0/422192756 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8017070 con 0x7f01081506c0 2026-02-17T11:55:28.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:28.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:28.840 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 10 monclient: dump: 2026-02-17T11:55:28.840 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 10 monclient: _finish_auth 0 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 5 monclient: authenticate success, global_id 4296 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 1 -- 10.20.193.10:0/422192756 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f800cc40 con 0x7f01081506c0 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 1 -- 10.20.193.10:0/422192756 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8013470 con 0x7f01081506c0 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f01067fc640 4 set_mon_vals no callback set 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f0104ff9640 10 monclient: dump: 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 10 monclient: _renew_subs 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01080bf270 con 0x7f01081506c0 2026-02-17T11:55:28.841 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 10 client.4296.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:28.842 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 10 monclient: _renew_subs 2026-02-17T11:55:28.842 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:28.842 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01080bf830 con 0x7f01081506c0 2026-02-17T11:55:28.842 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 1 librados: init done 2026-02-17T11:55:28.842 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:28.842 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:28.842 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:28.842 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.839+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0108159b30 con 0x7f01081506c0 2026-02-17T11:55:28.853 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.852+0000 7f0104ff9640 1 -- 10.20.193.10:0/422192756 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f00f8024060 con 0x7f01081506c0 2026-02-17T11:55:28.854 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.852+0000 7f0104ff9640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f00d8078dc0 0x7f00d807b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:28.854 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.852+0000 7f0107fff640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f00d8078dc0 0x7f00d807b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:28.854 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.852+0000 7f0107fff640 10 monclient: get_auth_request con 0x7f00d8078dc0 auth_method 0 2026-02-17T11:55:28.854 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.853+0000 7f0104ff9640 10 client.4296.objecter ms_handle_connect 0x7f00d8078dc0 2026-02-17T11:55:28.854 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.853+0000 7f0107fff640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f00d8078dc0 0x7f00d807b280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00f4039000 tx=0x7f00f4033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:28.965 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.963+0000 7f0104ff9640 1 -- 10.20.193.10:0/422192756 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f00f805e1c0 con 0x7f01081506c0 2026-02-17T11:55:28.965 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.963+0000 7f0104ff9640 10 client.4296.objecter ms_dispatch2 0x7f0108000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:55:28.965 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.963+0000 7f0104ff9640 3 client.4296.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:55:28.965 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.963+0000 7f0104ff9640 3 client.4296.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:55:28.965 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.963+0000 7f0104ff9640 20 client.4296.objecter dump_active .. 0 homeless 2026-02-17T11:55:28.965 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.963+0000 7f0104ff9640 1 -- 10.20.193.10:0/422192756 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f00f8062180 con 0x7f01081506c0 2026-02-17T11:55:28.966 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.963+0000 7f0104ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:28.966 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:28.963+0000 7f0104ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:29.055 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.053+0000 7f010e6f3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:29.055 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.053+0000 7f010e6f3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:29.055 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.053+0000 7f010e6f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:29.055 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.053+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01081574e0 con 0x7f01081506c0 2026-02-17T11:55:29.067 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.065+0000 7f0104ff9640 1 -- 10.20.193.10:0/422192756 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f00f8066480 con 0x7f01081506c0 2026-02-17T11:55:29.067 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.065+0000 7f0104ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:29.067 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.065+0000 7f0104ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:29.068 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:55:29.068 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:55:29.071 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 10 librados: watch_flush enter 2026-02-17T11:55:29.071 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 10 librados: watch_flush exit 2026-02-17T11:55:29.071 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 20 client.4296.objecter shutdown clearing up homeless session... 2026-02-17T11:55:29.071 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 10 client.4296.objecter successfully canceled tick 2026-02-17T11:55:29.071 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f00d8078dc0 msgr2=0x7f00d807b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:29.071 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f00d8078dc0 0x7f00d807b280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00f4039000 tx=0x7f00f4033000 comp rx=0 tx=0).stop 2026-02-17T11:55:29.071 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 10 monclient: shutdown 2026-02-17T11:55:29.071 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:29.071 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01081506c0 msgr2=0x7f01081f53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01081506c0 0x7f01081f53b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00f800ec10 tx=0x7f00f800c520 comp rx=0 tx=0).stop 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 shutdown_connections 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f00d8078dc0 0x7f00d807b280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f010815bf40 0x7f01081f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01081506c0 0x7f01081f53b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 --2- 10.20.193.10:0/422192756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f01081502e0 0x7f010814ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 >> 10.20.193.10:0/422192756 conn(0x7f01080cd5d0 msgr2=0x7f010815c570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 shutdown_connections 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 -- 10.20.193.10:0/422192756 wait complete. 2026-02-17T11:55:29.072 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:29.068+0000 7f010e6f3640 1 librados: shutdown 2026-02-17T11:55:29.080 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:55:34.703 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:01:51.871 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:34.729 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:01:51.897 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:34.736 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:01:51.904 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:34.758 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:01:51.921 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:34.758 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:01:51.887 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:34.759 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:01:51.922 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:34.759 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:01:51.888 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:34.766 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:01:51.929 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:34.768 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:01:51.897 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:36.689 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:55:36.752 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.751+0000 7fcdda06f640 10 monclient: get_monmap_and_config 2026-02-17T11:55:36.752 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.751+0000 7fcdda06f640 10 monclient: build_initial_monmap 2026-02-17T11:55:36.752 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.751+0000 7fcdda06f640 10 monclient: monmap: 2026-02-17T11:55:36.752 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:55:36.752096+0000 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:55:36.752096+0000 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.752+0000 7fcdda06f640 1 Processor -- start 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.752+0000 7fcdda06f640 1 -- start start 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.752+0000 7fcdda06f640 10 monclient: init 2026-02-17T11:55:36.753 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.752+0000 7fcdda06f640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 10 monclient: _add_conns ranks=[0,3,2,1,4,5] 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcdd4155de0 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fcdd41561c0 0x7fcdd40cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 10 monclient(hunting): picked mon.noname-a con 0x7fcdd41561c0 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcdd40c97a0 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd406cb00 con 0x7fcdd4155de0 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd406cde0 con 0x7fcdd40c97a0 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd406c8b0 con 0x7fcdd41561c0 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdda06f640 10 monclient(hunting): authenticate will time out at 1006.474095s 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdd2ffd640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fcdd41561c0 0x7fcdd40cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdd3fff640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fcdd40c97a0 0x7fcdd40c9bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:45910/0 (socket says 10.20.193.10:45910) 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.753+0000 7fcdd3fff640 1 -- 10.20.193.10:0/2651415932 learned_addr learned my addr 10.20.193.10:0/2651415932 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.754+0000 7fcdd2ffd640 10 monclient(hunting): get_auth_request con 0x7fcdd41561c0 auth_method 0 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.754+0000 7fcdd2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.754+0000 7fcdd2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:36.754 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.754+0000 7fcdd2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:36.755 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.754+0000 7fcdd2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:36.755 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.754+0000 7fcdd2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:36.755 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.754+0000 7fcdd2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:36.756 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.755+0000 7fcdd27fc640 1 -- 10.20.193.10:0/2651415932 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949230977 0 0) 0x7fcdd406cde0 con 0x7fcdd40c97a0 2026-02-17T11:55:36.756 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.755+0000 7fcdd27fc640 10 monclient(hunting): _negotiate 2026-02-17T11:55:36.756 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.755+0000 7fcdd27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:36.756 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.755+0000 7fcdd27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:36.756 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.755+0000 7fcdd27fc640 10 monclient(hunting): my global_id is 4310 2026-02-17T11:55:36.756 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.755+0000 7fcdd27fc640 1 -- 10.20.193.10:0/2651415932 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdb8003620 con 0x7fcdd40c97a0 2026-02-17T11:55:36.758 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.757+0000 7fcdd2ffd640 10 monclient(hunting): handle_auth_done global_id 4299 payload 274 2026-02-17T11:55:36.758 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.757+0000 7fcdd2ffd640 1 -- 10.20.193.10:0/2651415932 >> v1:10.20.193.153:6789/0 conn(0x7fcdd40c97a0 legacy=0x7fcdd40c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:36.758 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.757+0000 7fcdd2ffd640 1 -- 10.20.193.10:0/2651415932 >> v1:10.20.193.10:6789/0 conn(0x7fcdd4155de0 legacy=0x7fcdd406dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:36.758 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.757+0000 7fcdd2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:36.758 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.757+0000 7fcdd2ffd640 1 monclient: found mon.noname-a 2026-02-17T11:55:36.758 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.757+0000 7fcdd2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:36.758 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.757+0000 7fcdd2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:36.758 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.757+0000 7fcdd2ffd640 1 -- 10.20.193.10:0/2651415932 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd406d0c0 con 0x7fcdd41561c0 2026-02-17T11:55:36.759 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.759+0000 7fcdd2ffd640 1 --2- 10.20.193.10:0/2651415932 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 0x7fcdd40cb800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40098a0 tx=0x7fcdc402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b28418cb32fe055 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:36.761 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 1 -- 10.20.193.10:0/2651415932 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc403c070 con 0x7fcdd41561c0 2026-02-17T11:55:36.761 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:36.761 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:36.761 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 10 monclient: dump: 2026-02-17T11:55:36.761 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 1 -- 10.20.193.10:0/2651415932 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc402fb70 con 0x7fcdd41561c0 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 5 monclient: authenticate success, global_id 4299 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 1 -- 10.20.193.10:0/2651415932 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4037440 con 0x7fcdd41561c0 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 4 set_mon_vals no callback set 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdd27fc640 10 monclient: dump: 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:36.762 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 10 monclient: shutdown 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 1 -- 10.20.193.10:0/2651415932 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 msgr2=0x7fcdd40cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 1 --2- 10.20.193.10:0/2651415932 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 0x7fcdd40cb800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40098a0 tx=0x7fcdc402ee60 comp rx=0 tx=0).stop 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 1 -- 10.20.193.10:0/2651415932 shutdown_connections 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 1 --2- 10.20.193.10:0/2651415932 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 0x7fcdd40cb800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 1 -- 10.20.193.10:0/2651415932 >> 10.20.193.10:0/2651415932 conn(0x7fcdd40d1990 msgr2=0x7fcdd40d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 1 -- 10.20.193.10:0/2651415932 shutdown_connections 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.761+0000 7fcdda06f640 1 -- 10.20.193.10:0/2651415932 wait complete. 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient: build_initial_monmap 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient: monmap: 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 librados: starting msgr at 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 librados: starting objecter 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 Processor -- start 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 -- start start 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 librados: setting wanted keys 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 librados: calling monclient init 2026-02-17T11:55:36.763 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient: init 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcdd40c97a0 0x7fcdd415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient(hunting): picked mon.noname-c con 0x7fcdd40c97a0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcdd4155de0 0x7fcdd41f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient(hunting): picked mon.noname-b con 0x7fcdd4155de0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 0x7fcdd4147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient(hunting): picked mon.noname-a con 0x7fcdd41561c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd40d26d0 con 0x7fcdd41561c0 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd406d680 con 0x7fcdd4155de0 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:36.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd4159ff0 con 0x7fcdd40c97a0 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.762+0000 7fcdda06f640 10 monclient(hunting): authenticate will time out at 1006.483746s 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 0x7fcdd4147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd37fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcdd40c97a0 0x7fcdd415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 0x7fcdd4147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:54514/0 (socket says 10.20.193.10:54514) 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 1 -- 10.20.193.10:0/558873541 learned_addr learned my addr 10.20.193.10:0/558873541 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 10 monclient(hunting): get_auth_request con 0x7fcdd41561c0 auth_method 0 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd2ffd640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcdd4155de0 0x7fcdd41f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd37fe640 10 monclient(hunting): get_auth_request con 0x7fcdd40c97a0 auth_method 0 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd2ffd640 10 monclient(hunting): get_auth_request con 0x7fcdd4155de0 auth_method 0 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.763+0000 7fcdd37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.764+0000 7fcdd2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.764+0000 7fcdd2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.764+0000 7fcdd2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:36.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 10 monclient(hunting): handle_auth_done global_id 4305 payload 824 2026-02-17T11:55:36.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 1 -- 10.20.193.10:0/558873541 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcdd40c97a0 msgr2=0x7fcdd415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:36.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcdd40c97a0 0x7fcdd415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:36.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 1 -- 10.20.193.10:0/558873541 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcdd4155de0 msgr2=0x7fcdd41f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:36.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcdd4155de0 0x7fcdd41f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:36.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:36.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 1 monclient: found mon.noname-a 2026-02-17T11:55:36.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:36.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:36.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.765+0000 7fcdd3fff640 1 -- 10.20.193.10:0/558873541 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd415a2d0 con 0x7fcdd41561c0 2026-02-17T11:55:36.767 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.766+0000 7fcdd3fff640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 0x7fcdd4147d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800cbb0 tx=0x7fcdc800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:36.767 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.766+0000 7fcdaffff640 10 client.?.objecter ms_handle_connect 0x7fcdd41561c0 2026-02-17T11:55:36.767 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.766+0000 7fcdaffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 1 -- 10.20.193.10:0/558873541 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800ad50 con 0x7fcdd41561c0 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 10 monclient: dump: 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:36.769 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 10 monclient: _finish_auth 0 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 1 -- 10.20.193.10:0/558873541 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8012400 con 0x7fcdd41561c0 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdda06f640 5 monclient: authenticate success, global_id 4305 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdda06f640 10 monclient: _renew_subs 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdda06f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd415a5b0 con 0x7fcdd41561c0 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 1 -- 10.20.193.10:0/558873541 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8012870 con 0x7fcdd41561c0 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdd1ffb640 4 set_mon_vals no callback set 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdaffff640 10 monclient: dump: 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:36.770 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdda06f640 10 client.4305.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdda06f640 10 monclient: _renew_subs 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdda06f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd415ab70 con 0x7fcdd41561c0 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.768+0000 7fcdda06f640 1 librados: init done 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.769+0000 7fcdda06f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.769+0000 7fcdda06f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.769+0000 7fcdda06f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:36.771 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.769+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd414d750 con 0x7fcdd41561c0 2026-02-17T11:55:36.781 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.780+0000 7fcdaffff640 1 -- 10.20.193.10:0/558873541 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7fcdc8012a10 con 0x7fcdd41561c0 2026-02-17T11:55:36.782 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.781+0000 7fcdaffff640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcda4078dc0 0x7fcda407b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:36.782 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.781+0000 7fcdd37fe640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcda4078dc0 0x7fcda407b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:36.782 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.781+0000 7fcdd37fe640 10 monclient: get_auth_request con 0x7fcda4078dc0 auth_method 0 2026-02-17T11:55:36.782 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.781+0000 7fcdd37fe640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcda4078dc0 0x7fcda407b280 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0002410 tx=0x7fcdc0007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:36.782 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.781+0000 7fcdaffff640 10 client.4305.objecter ms_handle_connect 0x7fcda4078dc0 2026-02-17T11:55:36.785 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.784+0000 7fcdaffff640 1 -- 10.20.193.10:0/558873541 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fcdc8012d30 con 0x7fcdd41561c0 2026-02-17T11:55:36.785 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.784+0000 7fcdaffff640 10 client.4305.objecter ms_dispatch2 0x7fcdd4000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:55:36.785 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.784+0000 7fcdaffff640 3 client.4305.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:55:36.785 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.784+0000 7fcdaffff640 3 client.4305.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:55:36.785 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.784+0000 7fcdaffff640 20 client.4305.objecter dump_active .. 0 homeless 2026-02-17T11:55:36.892 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.891+0000 7fcdaffff640 1 -- 10.20.193.10:0/558873541 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcdd414d750 con 0x7fcdd41561c0 2026-02-17T11:55:36.892 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.891+0000 7fcdaffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:36.893 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.891+0000 7fcdaffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:36.981 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.980+0000 7fcdda06f640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:36.981 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.980+0000 7fcdda06f640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:36.981 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.980+0000 7fcdda06f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:36.981 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.980+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdd406a0c0 con 0x7fcdd41561c0 2026-02-17T11:55:36.992 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.991+0000 7fcdaffff640 1 -- 10.20.193.10:0/558873541 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fcdd406a0c0 con 0x7fcdd41561c0 2026-02-17T11:55:36.992 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.991+0000 7fcdaffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:36.992 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.991+0000 7fcdaffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:36.993 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:55:36.993 INFO:teuthology.misc.health.trial010.stdout:{"epoch":18,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:54:07.442553+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:55:36.995 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 10 librados: watch_flush enter 2026-02-17T11:55:36.995 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 10 librados: watch_flush exit 2026-02-17T11:55:36.995 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 20 client.4305.objecter shutdown clearing up homeless session... 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 10 client.4305.objecter successfully canceled tick 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcda4078dc0 msgr2=0x7fcda407b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcda4078dc0 0x7fcda407b280 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0002410 tx=0x7fcdc0007ef0 comp rx=0 tx=0).stop 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 10 monclient: shutdown 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 msgr2=0x7fcdd4147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 0x7fcdd4147d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800cbb0 tx=0x7fcdc800a430 comp rx=0 tx=0).stop 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 shutdown_connections 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcda4078dc0 0x7fcda407b280 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.993+0000 7fcdda06f640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcdd41561c0 0x7fcdd4147d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.994+0000 7fcdda06f640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcdd4155de0 0x7fcdd41f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.994+0000 7fcdda06f640 1 --2- 10.20.193.10:0/558873541 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcdd40c97a0 0x7fcdd415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:36.996 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.994+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 >> 10.20.193.10:0/558873541 conn(0x7fcdd40d1990 msgr2=0x7fcdd406b650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:36.997 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.994+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 shutdown_connections 2026-02-17T11:55:36.997 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.994+0000 7fcdda06f640 1 -- 10.20.193.10:0/558873541 wait complete. 2026-02-17T11:55:36.997 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:36.994+0000 7fcdda06f640 1 librados: shutdown 2026-02-17T11:55:37.003 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:55:37.406 INFO:tasks.ceph.osd.8.trial010.stderr:2026-02-17T11:55:37.403+0000 77b7940 -1 osd.8 0 log_to_monitors true 2026-02-17T11:55:37.944 INFO:tasks.ceph.osd.0.trial010.stderr:2026-02-17T11:55:37.939+0000 77b7940 -1 osd.0 0 log_to_monitors true 2026-02-17T11:55:37.945 INFO:tasks.ceph.osd.12.trial010.stderr:2026-02-17T11:55:37.943+0000 77b7940 -1 osd.12 0 log_to_monitors true 2026-02-17T11:55:39.008 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:39.004+0000 77b7940 -1 osd.1 0 log_to_monitors true 2026-02-17T11:55:39.009 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:39.005+0000 77b7940 -1 osd.9 0 log_to_monitors true 2026-02-17T11:55:39.176 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:39.172+0000 77b7940 -1 osd.6 0 log_to_monitors true 2026-02-17T11:55:39.267 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:39.264+0000 77b7940 -1 osd.10 0 log_to_monitors true 2026-02-17T11:55:39.327 INFO:tasks.ceph.osd.8.trial010.stderr:2026-02-17T11:55:39.324+0000 deb1640 -1 osd.8 0 waiting for initial osdmap 2026-02-17T11:55:39.332 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:39.330+0000 77b7940 -1 osd.4 0 log_to_monitors true 2026-02-17T11:55:39.546 INFO:tasks.ceph.osd.8.trial010.stderr:2026-02-17T11:55:39.539+0000 11c75640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:39.566 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:39.560+0000 77b7940 -1 osd.5 0 log_to_monitors true 2026-02-17T11:55:39.582 INFO:tasks.ceph.osd.2.trial153.stderr:2026-02-17T11:55:39.579+0000 77b7940 -1 osd.2 0 log_to_monitors true 2026-02-17T11:55:39.702 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:39.698+0000 77b7940 -1 osd.14 0 log_to_monitors true 2026-02-17T11:55:39.736 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-17T11:55:39.734+0000 77b7940 -1 osd.7 0 log_to_monitors true 2026-02-17T11:55:39.890 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:39.887+0000 77b7940 -1 osd.13 0 log_to_monitors true 2026-02-17T11:55:39.927 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-17T11:55:39.925+0000 77b7940 -1 osd.11 0 log_to_monitors true 2026-02-17T11:55:40.313 INFO:tasks.ceph.osd.0.trial010.stderr:2026-02-17T11:55:40.310+0000 deb1640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T11:55:40.325 INFO:tasks.ceph.osd.12.trial010.stderr:2026-02-17T11:55:40.322+0000 ce9d640 -1 osd.12 0 waiting for initial osdmap 2026-02-17T11:55:40.540 INFO:tasks.ceph.osd.0.trial010.stderr:2026-02-17T11:55:40.532+0000 11c75640 -1 osd.0 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:40.553 INFO:tasks.ceph.osd.12.trial010.stderr:2026-02-17T11:55:40.545+0000 11c75640 -1 osd.12 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:40.888 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-17T11:55:40.885+0000 77b7940 -1 osd.15 0 log_to_monitors true 2026-02-17T11:55:40.889 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:40.883+0000 77b7940 -1 osd.3 0 log_to_monitors true 2026-02-17T11:55:41.335 INFO:tasks.ceph.osd.2.trial153.stderr:2026-02-17T11:55:41.331+0000 deb1640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T11:55:41.546 INFO:tasks.ceph.osd.2.trial153.stderr:2026-02-17T11:55:41.539+0000 11c75640 -1 osd.2 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:42.437 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-17T11:55:42.434+0000 deb1640 -1 osd.7 0 waiting for initial osdmap 2026-02-17T11:55:42.462 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-17T11:55:42.459+0000 deb1640 -1 osd.11 0 waiting for initial osdmap 2026-02-17T11:55:42.705 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-17T11:55:42.698+0000 11c75640 -1 osd.7 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:42.719 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-17T11:55:42.712+0000 11c75640 -1 osd.11 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:43.420 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-17T11:55:43.417+0000 ce9d640 -1 osd.15 0 waiting for initial osdmap 2026-02-17T11:55:43.698 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-17T11:55:43.690+0000 11c75640 -1 osd.15 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:44.616 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:55:44.652 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.638+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.659 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.651+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.660 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.652+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.673 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.658+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.679 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.677+0000 7f359315e640 10 monclient: get_monmap_and_config 2026-02-17T11:55:44.679 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.677+0000 7f359315e640 10 monclient: build_initial_monmap 2026-02-17T11:55:44.679 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.677+0000 7f359315e640 10 monclient: monmap: 2026-02-17T11:55:44.679 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:44.679 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:44.679 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:55:44.678897+0000 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:55:44.678897+0000 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:44.680 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:44.681 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.678+0000 7f359315e640 1 Processor -- start 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.678+0000 7f359315e640 1 -- start start 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.678+0000 7f359315e640 10 monclient: init 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.678+0000 7f359315e640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.678+0000 7f359315e640 10 monclient: _add_conns ranks=[1,5,0,3,4,2] 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.678+0000 7f359315e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f358c1520e0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.678+0000 7f359315e640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f358c070b30 0x7f358c072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.679+0000 7f359315e640 10 monclient(hunting): picked mon.noname-c con 0x7f358c070b30 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.679+0000 7f359315e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f358c1524c0 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.679+0000 7f359315e640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f358c06dc80 con 0x7f358c1524c0 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.679+0000 7f359315e640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f358c06df60 con 0x7f358c1520e0 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.679+0000 7f359315e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.679+0000 7f359315e640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f358c06e240 con 0x7f358c070b30 2026-02-17T11:55:44.682 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.679+0000 7f359315e640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:44.683 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.679+0000 7f359315e640 10 monclient(hunting): authenticate will time out at 1014.401039s 2026-02-17T11:55:44.684 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.681+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.685 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.671+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.687 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.685+0000 7f3590ed3640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f358c1520e0 0x7f358c070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:59330/0 (socket says 10.20.193.10:59330) 2026-02-17T11:55:44.687 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.685+0000 7f3590ed3640 1 -- 10.20.193.10:0/1039960175 learned_addr learned my addr 10.20.193.10:0/1039960175 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:44.690 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.677+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.693 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.691+0000 7f3583fff640 1 --2- 10.20.193.10:0/1039960175 >> v2:10.20.193.153:3300/0 conn(0x7f358c070b30 0x7f358c072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:44.694 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.692+0000 7f3583fff640 10 monclient(hunting): get_auth_request con 0x7f358c070b30 auth_method 0 2026-02-17T11:55:44.694 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.692+0000 7f3583fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:44.694 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.692+0000 7f3583fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:44.694 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.692+0000 7f3583fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:44.695 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.693+0000 7f3583fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:44.695 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.693+0000 7f3583fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:44.695 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.693+0000 7f3583fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:44.696 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.661+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.696 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.694+0000 7f3583fff640 10 monclient(hunting): handle_auth_done global_id 4364 payload 274 2026-02-17T11:55:44.696 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.694+0000 7f3583fff640 1 -- 10.20.193.10:0/1039960175 >> v1:10.20.193.71:6789/0 conn(0x7f358c1520e0 legacy=0x7f358c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:44.697 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.694+0000 7f3583fff640 1 -- 10.20.193.10:0/1039960175 >> v1:10.20.193.10:6789/0 conn(0x7f358c1524c0 legacy=0x7f358c1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:44.697 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.694+0000 7f3583fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:44.697 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.694+0000 7f3583fff640 1 monclient: found mon.noname-c 2026-02-17T11:55:44.697 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.694+0000 7f3583fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:44.697 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.694+0000 7f3583fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:44.697 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.694+0000 7f3583fff640 1 -- 10.20.193.10:0/1039960175 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358c06e520 con 0x7f358c070b30 2026-02-17T11:55:44.698 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.696+0000 7f3583fff640 1 --2- 10.20.193.10:0/1039960175 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 0x7f358c072510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35740098a0 tx=0x7f357402ff60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=453aade689f485bd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:44.700 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.690+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.701 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.676+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 1 -- 10.20.193.10:0/1039960175 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357403d070 con 0x7f358c070b30 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 10 monclient: dump: 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 1 -- 10.20.193.10:0/1039960175 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3574030c20 con 0x7f358c070b30 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 1 -- 10.20.193.10:0/1039960175 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574038440 con 0x7f358c070b30 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 5 monclient: authenticate success, global_id 4364 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f35837fe640 10 monclient: dump: 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:44.705 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 4 set_mon_vals no callback set 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 10 monclient: shutdown 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 1 -- 10.20.193.10:0/1039960175 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 msgr2=0x7f358c072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 1 --2- 10.20.193.10:0/1039960175 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 0x7f358c072510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35740098a0 tx=0x7f357402ff60 comp rx=0 tx=0).stop 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 1 -- 10.20.193.10:0/1039960175 shutdown_connections 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 1 --2- 10.20.193.10:0/1039960175 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 0x7f358c072510 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 1 -- 10.20.193.10:0/1039960175 >> 10.20.193.10:0/1039960175 conn(0x7f358c0cd5d0 msgr2=0x7f358c0cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 1 -- 10.20.193.10:0/1039960175 shutdown_connections 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 1 -- 10.20.193.10:0/1039960175 wait complete. 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 10 monclient: build_initial_monmap 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.700+0000 7f359315e640 10 monclient: monmap: 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 librados: starting msgr at 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 librados: starting objecter 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 Processor -- start 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 -- start start 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 librados: setting wanted keys 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 librados: calling monclient init 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient: init 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 0x7f358c1f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient(hunting): picked mon.noname-c con 0x7f358c070b30 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f358c1520e0 0x7f358c1f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient(hunting): picked mon.noname-b con 0x7f358c1520e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f358c1524c0 0x7f358c1f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient(hunting): picked mon.noname-a con 0x7f358c1524c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:44.706 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f358c06f000 con 0x7f358c1524c0 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f358c06eae0 con 0x7f358c1520e0 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f358c06f180 con 0x7f358c070b30 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f359315e640 10 monclient(hunting): authenticate will time out at 1014.423554s 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.701+0000 7f3590ed3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 0x7f358c1f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3583fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f358c1520e0 0x7f358c1f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3590ed3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 0x7f358c1f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:57740/0 (socket says 10.20.193.10:57740) 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3590ed3640 1 -- 10.20.193.10:0/1861195399 learned_addr learned my addr 10.20.193.10:0/1861195399 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3590ed3640 10 monclient(hunting): get_auth_request con 0x7f358c070b30 auth_method 0 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3590ed3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3590ed3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3590ed3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3583fff640 10 monclient(hunting): get_auth_request con 0x7f358c1520e0 auth_method 0 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3583fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3583fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3583fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3590ed3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3590ed3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3590ed3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3583fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3583fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.702+0000 7f3583fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 10 monclient(hunting): handle_auth_done global_id 4367 payload 824 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 1 -- 10.20.193.10:0/1861195399 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f358c1520e0 msgr2=0x7f358c1f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:44.707 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f358c1520e0 0x7f358c1f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 1 -- 10.20.193.10:0/1861195399 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f358c1524c0 msgr2=0x7f358c1f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f358c1524c0 0x7f358c1f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 10 monclient: _finish_hunting 0 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 1 monclient: found mon.noname-c 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.703+0000 7f3590ed3640 1 -- 10.20.193.10:0/1861195399 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358c1f4470 con 0x7f358c070b30 2026-02-17T11:55:44.708 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.683+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.704+0000 7f3590ed3640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 0x7f358c1f2560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c730 tx=0x7f357c00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.704+0000 7f35817fa640 10 client.?.objecter ms_handle_connect 0x7f358c070b30 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.704+0000 7f35817fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:44.708 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.688+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.708 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 1 -- 10.20.193.10:0/1861195399 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c017070 con 0x7f358c070b30 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 10 monclient: dump: 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 10 monclient: _finish_auth 0 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 10 monclient: _check_auth_tickets 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 5 monclient: authenticate success, global_id 4367 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 10 monclient: _renew_subs 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358c1f6430 con 0x7f358c070b30 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 10 client.4367.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 10 monclient: _renew_subs 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358c1f14c0 con 0x7f358c070b30 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 1 librados: init done 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 1 -- 10.20.193.10:0/1861195399 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f357c005bb0 con 0x7f358c070b30 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 1 -- 10.20.193.10:0/1861195399 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c021060 con 0x7f358c070b30 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f35817fa640 10 monclient: dump: 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:44.709 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:44.710 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f3582ffd640 4 set_mon_vals no callback set 2026-02-17T11:55:44.710 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:44.710 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:44.710 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:44.710 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.706+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358c072510 con 0x7f358c070b30 2026-02-17T11:55:44.711 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.698+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.717 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.710+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.718 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.696+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.718 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.704+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.718 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.694+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.720 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.715+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.720 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.693+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.721 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.694+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.723 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.717+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.726 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.699+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.726 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.706+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.728 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.717+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.728 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.719+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.730 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.718+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.731 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.706+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 2 2026-02-17T11:55:44.737 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.730+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.740 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.727+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.741 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.727+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.741 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.721+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.742 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.736+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.742 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.741+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.753 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.719+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.753 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.740+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.754 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.741+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.760 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.739+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.762 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.736+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.765 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.752+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.766 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.729+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.769 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.764+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.776 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.758+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.778 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.735+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.778 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.758+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 2 2026-02-17T11:55:44.783 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.747+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.789 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.746+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.789 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.753+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.790 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.771+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.791 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.765+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.791 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.776+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.794 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.786+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.795 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.781+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.795 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.761+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.798 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.777+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.799 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.788+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.803 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.787+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.805 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.793+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.808 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.806+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.810 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.787+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.810 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.808+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.811 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.790+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.818 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.816+0000 7f35817fa640 1 -- 10.20.193.10:0/1861195399 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 4) ==== 99845+0+0 (secure 0 0 0) 0x7f357c024080 con 0x7f358c070b30 2026-02-17T11:55:44.819 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.817+0000 7f35817fa640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f355c078d70 0x7f355c07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:44.819 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.817+0000 7f3583fff640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f355c078d70 0x7f355c07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:44.819 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.817+0000 7f3583fff640 10 monclient: get_auth_request con 0x7f355c078d70 auth_method 0 2026-02-17T11:55:44.819 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.817+0000 7f3583fff640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f355c078d70 0x7f355c07b230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f357403a000 tx=0x7f3574034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:44.820 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.817+0000 7f35817fa640 10 client.4367.objecter ms_handle_connect 0x7f355c078d70 2026-02-17T11:55:44.821 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.819+0000 7f35817fa640 1 -- 10.20.193.10:0/1861195399 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6043+0+0 (secure 0 0 0) 0x7f357c007760 con 0x7f358c070b30 2026-02-17T11:55:44.821 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.819+0000 7f35817fa640 10 client.4367.objecter ms_dispatch2 0x7f358c000b90 osd_map(25..25 src has 1..25) 2026-02-17T11:55:44.821 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.819+0000 7f35817fa640 3 client.4367.objecter handle_osd_map got epochs [25,25] > 0 2026-02-17T11:55:44.822 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.819+0000 7f35817fa640 3 client.4367.objecter handle_osd_map decoding full epoch 25 2026-02-17T11:55:44.822 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.819+0000 7f35817fa640 20 client.4367.objecter dump_active .. 0 homeless 2026-02-17T11:55:44.824 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.803+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.827 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.826+0000 7f35817fa640 1 -- 10.20.193.10:0/1861195399 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f357c061540 con 0x7f358c070b30 2026-02-17T11:55:44.828 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.826+0000 7f35817fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:44.828 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.826+0000 7f35817fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:44.828 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.793+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.829 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.816+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.829 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.814+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.830 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.811+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.831 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.824+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 2 2026-02-17T11:55:44.833 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.828+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.833 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.827+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.837 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.836+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2026-02-17T11:55:44.838 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.830+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.841 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.834+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.842 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.833+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.845 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.774+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.845 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.836+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.846 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.796+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.846 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.844+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.850 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.831+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.851 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.843+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.857 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.837+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.861 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.840+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.862 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.849+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.862 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.860+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.869 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.844+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.871 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.862+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.873 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.843+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.873 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.861+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.877 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.840+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.883 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.872+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.883 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.882+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.884 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.881+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.885 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.872+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2026-02-17T11:55:44.888 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.876+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.889 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.887+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.895 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.870+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 4 2026-02-17T11:55:44.897 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.884+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.909 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.907+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 4 2026-02-17T11:55:44.910 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.894+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.912 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.891+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.915 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.913+0000 7f359315e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:44.915 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.913+0000 7f359315e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:44.915 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.913+0000 7f359315e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:44.915 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.913+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f358c155ae0 con 0x7f358c070b30 2026-02-17T11:55:44.916 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.897+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.930 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.909+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 2 2026-02-17T11:55:44.932 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.896+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.932 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.914+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 2 2026-02-17T11:55:44.938 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.936+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.947 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.908+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.951 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.928+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:44.951 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.933+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.956 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.931+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.957 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.948+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.960 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.959+0000 7f35817fa640 1 -- 10.20.193.10:0/1861195399 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18260 (secure 0 0 0) 0x7f357c065840 con 0x7f358c070b30 2026-02-17T11:55:44.961 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.959+0000 7f35817fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:44.961 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.959+0000 7f35817fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:44.961 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:55:44.961 INFO:teuthology.misc.health.trial010.stdout:{"epoch":25,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:55:44.557283+0000","last_up_change":"2026-02-17T11:55:44.557283+0000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:55:41.943431+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":16.670000076293945,"score_stable":16.670000076293945,"optimal_score":0.059999998658895493,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6826","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6827","nonce":311345990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6828","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6829","nonce":311345990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6832","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6833","nonce":311345990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6830","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6831","nonce":311345990}]},"public_addr":"10.20.193.10:6827/311345990","cluster_addr":"10.20.193.10:6829/311345990","heartbeat_back_addr":"10.20.193.10:6833/311345990","heartbeat_front_addr":"10.20.193.10:6831/311345990","state":["exists","up"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6817","nonce":4180566480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6819","nonce":4180566480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6823","nonce":4180566480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6821","nonce":4180566480}]},"public_addr":"10.20.193.153:6817/4180566480","cluster_addr":"10.20.193.153:6819/4180566480","heartbeat_back_addr":"10.20.193.153:6823/4180566480","heartbeat_front_addr":"10.20.193.153:6821/4180566480","state":["exists","up"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6808","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6809","nonce":561251262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6810","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6811","nonce":561251262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6814","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6815","nonce":561251262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6812","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6813","nonce":561251262}]},"public_addr":"10.20.193.174:6809/561251262","cluster_addr":"10.20.193.174:6811/561251262","heartbeat_back_addr":"10.20.193.174:6815/561251262","heartbeat_front_addr":"10.20.193.174:6813/561251262","state":["exists","up"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6818","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6819","nonce":1997295941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6820","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6821","nonce":1997295941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6824","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6825","nonce":1997295941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6822","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6823","nonce":1997295941}]},"public_addr":"10.20.193.10:6819/1997295941","cluster_addr":"10.20.193.10:6821/1997295941","heartbeat_back_addr":"10.20.193.10:6825/1997295941","heartbeat_front_addr":"10.20.193.10:6823/1997295941","state":["exists","up"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6800","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6801","nonce":4034633078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6802","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6803","nonce":4034633078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6806","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6807","nonce":4034633078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6804","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6805","nonce":4034633078}]},"public_addr":"10.20.193.174:6801/4034633078","cluster_addr":"10.20.193.174:6803/4034633078","heartbeat_back_addr":"10.20.193.174:6807/4034633078","heartbeat_front_addr":"10.20.193.174:6805/4034633078","state":["exists","up"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6802","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6803","nonce":2920105256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6804","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6805","nonce":2920105256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6808","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6809","nonce":2920105256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6806","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6807","nonce":2920105256}]},"public_addr":"10.20.193.10:6803/2920105256","cluster_addr":"10.20.193.10:6805/2920105256","heartbeat_back_addr":"10.20.193.10:6809/2920105256","heartbeat_front_addr":"10.20.193.10:6807/2920105256","state":["exists","up"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6824","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6825","nonce":3564494722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6826","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6827","nonce":3564494722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6830","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6831","nonce":3564494722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6828","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6829","nonce":3564494722}]},"public_addr":"10.20.193.174:6825/3564494722","cluster_addr":"10.20.193.174:6827/3564494722","heartbeat_back_addr":"10.20.193.174:6831/3564494722","heartbeat_front_addr":"10.20.193.174:6829/3564494722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.360736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.960607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.107139+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:38.853441+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.372465+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.295380+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 10 librados: watch_flush enter 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 10 librados: watch_flush exit 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 20 client.4367.objecter shutdown clearing up homeless session... 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 10 client.4367.objecter successfully canceled tick 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f355c078d70 msgr2=0x7f355c07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f355c078d70 0x7f355c07b230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f357403a000 tx=0x7f3574034000 comp rx=0 tx=0).stop 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 10 monclient: shutdown 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 msgr2=0x7f358c1f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 0x7f358c1f2560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c730 tx=0x7f357c00cc00 comp rx=0 tx=0).stop 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 shutdown_connections 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f355c078d70 0x7f355c07b230 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f358c1524c0 0x7f358c1f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f358c1520e0 0x7f358c1f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 --2- 10.20.193.10:0/1861195399 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f358c070b30 0x7f358c1f2560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 >> 10.20.193.10:0/1861195399 conn(0x7f358c0cd5d0 msgr2=0x7f358c0cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 shutdown_connections 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 -- 10.20.193.10:0/1861195399 wait complete. 2026-02-17T11:55:44.963 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:44.961+0000 7f359315e640 1 librados: shutdown 2026-02-17T11:55:44.963 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.950+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:44.963 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.951+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.964 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.918+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.964 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.931+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.964 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.940+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.967 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.951+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 2 2026-02-17T11:55:44.969 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.946+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.970 DEBUG:teuthology.misc:7 of 16 OSDs are up 2026-02-17T11:55:44.973 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.966+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:44.975 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.963+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.978 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.963+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:44.982 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.956+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.982 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.962+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.988 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.974+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.988 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.981+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:44.996 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.981+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:44.997 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:44.950+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 2 2026-02-17T11:55:45.000 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.972+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.001 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.968+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:45.004 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:44.989+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.006 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:44.972+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:45.006 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:44.998+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.010 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.003+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.010 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.008+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.012 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:44.998+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 2 2026-02-17T11:55:45.012 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.000+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:45.013 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.004+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.013 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.009+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.013 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.004+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:45.014 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.011+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:45.014 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.012+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:45.016 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.011+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.018 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.011+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.021 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.987+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:45.021 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:44.993+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:45.024 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:45.018+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:45.027 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.000+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 2 2026-02-17T11:55:45.027 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.015+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.027 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.017+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.027 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.024+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:45.033 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.025+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.033 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.011+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:45.039 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.031+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.042 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.022+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:45.043 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.025+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.047 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:45.023+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:45.048 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.032+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:45.057 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.038+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.062 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.041+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:45.066 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.044+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.070 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.059+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.071 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.069+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.073 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.062+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 3 2026-02-17T11:55:45.081 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.072+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:45.090 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:45.045+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:55:45.093 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.089+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.094 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.035+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.094 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.050+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.096 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.072+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.099 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:45.091+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 2 2026-02-17T11:55:45.103 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.101+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.105 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.076+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.105 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.047+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:45.105 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.060+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:45.106 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.080+0000 77b7940 -1 bdev(0x1ae1ffa0 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:55:45.123 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:45.121+0000 77b7940 -1 bdev(0x16f20a20 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 4 2026-02-17T11:55:45.129 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.073+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.129 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.086+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.129 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.093+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.131 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.103+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 2 2026-02-17T11:55:45.136 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.122+0000 77b7940 -1 bdev(0x16f494b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T11:55:45.141 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.130+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.141 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.081+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:45.147 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.140+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.153 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.146+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.157 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.151+0000 77b7940 -1 bdev(0x16f52060 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T11:55:45.160 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.127+0000 77b7940 -1 bdev(0x16f43e30 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T11:55:45.173 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.115+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:45.174 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.157+0000 77b7940 -1 bdev(0x1a6d8aa0 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T11:55:45.528 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.525+0000 deb1640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T11:55:45.536 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.533+0000 deb1640 -1 osd.6 0 waiting for initial osdmap 2026-02-17T11:55:45.564 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.561+0000 ce9d640 -1 osd.9 0 waiting for initial osdmap 2026-02-17T11:55:45.574 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.571+0000 ce9d640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T11:55:45.575 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.572+0000 ce9d640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T11:55:45.593 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:45.589+0000 ce9d640 -1 osd.10 0 waiting for initial osdmap 2026-02-17T11:55:45.724 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.701+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.728 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.707+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.735 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.724+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.735 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.727+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.740 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.733+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.752 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.739+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.758 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.751+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.774 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.768+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.782 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T11:55:45.774+0000 15c7d640 -1 osd.4 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:45.784 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T11:55:45.776+0000 15c7d640 -1 osd.6 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:45.785 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.772+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.798 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.783+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.798 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.784+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.810 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.797+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.817 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.808+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.819 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.797+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.819 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.800+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.822 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.817+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.823 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T11:55:45.815+0000 15c7d640 -1 osd.10 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:45.825 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T11:55:45.818+0000 15c7d640 -1 osd.9 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:45.826 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.815+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.827 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.821+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.829 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.825+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.838 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T11:55:45.830+0000 15c7d640 -1 osd.5 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:45.839 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.827+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.840 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T11:55:45.833+0000 15c7d640 -1 osd.1 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:45.841 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.825+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.865 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.833+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.881 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.838+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.882 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.880+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.886 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.882+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.891 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.885+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.892 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.839+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.892 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.864+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.899 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.894+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 3 2026-02-17T11:55:45.909 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.889+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.909 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.896+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.918 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.898+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 2 2026-02-17T11:55:45.922 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.916+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.924 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.917+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 2 2026-02-17T11:55:45.931 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.923+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.943 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.922+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 2 2026-02-17T11:55:45.949 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.942+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.955 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.931+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 2 2026-02-17T11:55:45.955 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.948+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.961 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.953+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.966 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.953+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:45.983 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.959+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:45.983 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.970+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.005 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:45.982+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.010 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:45.973+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:46.016 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.009+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:46.022 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.003+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 2 2026-02-17T11:55:46.028 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.014+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:46.028 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.015+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.035 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.021+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.047 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.027+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.054 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.026+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:46.055 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.042+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:46.060 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.034+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.070 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.046+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.092 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.073+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 2 2026-02-17T11:55:46.100 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.093+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.103 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.078+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 6 2026-02-17T11:55:46.107 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.099+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.119 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.106+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.124 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.112+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.137 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.118+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.143 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.106+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 4 2026-02-17T11:55:46.149 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.136+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.149 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.142+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.160 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.147+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.165 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.141+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 2 2026-02-17T11:55:46.166 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.158+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.176 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.158+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:46.176 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.164+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:46.176 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.164+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.185 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.175+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.187 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.175+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:46.192 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.185+0000 77b7940 -1 bdev(0x1ae80ed0 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T11:55:46.202 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.183+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.222 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.204+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 3 2026-02-17T11:55:46.235 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.227+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.241 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.233+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.242 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.239+0000 77b7940 -1 bdev(0x16f548d0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T11:55:46.592 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.588+0000 deb1640 -1 osd.14 0 waiting for initial osdmap 2026-02-17T11:55:46.656 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.653+0000 deb1640 -1 osd.13 0 waiting for initial osdmap 2026-02-17T11:55:46.768 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.758+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.780 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.766+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.786 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.778+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.809 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.784+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.810 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.795+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.823 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.808+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.843 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.829+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.854 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.838+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.882 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.841+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.889 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T11:55:46.881+0000 15c7d640 -1 osd.14 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:46.893 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.864+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.905 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.881+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.905 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.903+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2026-02-17T11:55:46.909 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T11:55:46.902+0000 15c7d640 -1 osd.13 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:46.931 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.913+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.937 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.929+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.967 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.935+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.967 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.965+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:46.971 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.968+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2026-02-17T11:55:47.000 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.981+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2026-02-17T11:55:47.001 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.992+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.010 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:46.998+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.010 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.002+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.016 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.008+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.037 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.023+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.045 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.035+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.051 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.043+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.087 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.050+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.098 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.061+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.099 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.073+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.118 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.085+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.119 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.097+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.148 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.117+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.151 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.130+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.194 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.149+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.194 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.176+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.229 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.196+0000 77b7940 -1 bdev(0x16f39c60 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:55:47.643 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.639+0000 ce9d640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T11:55:47.879 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T11:55:47.869+0000 15c7d640 -1 osd.3 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:55:52.580 DEBUG:teuthology.orchestra.run.trial010:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:55:52.642 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.639+0000 7f2e92b53640 10 monclient: get_monmap_and_config 2026-02-17T11:55:52.642 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.639+0000 7f2e92b53640 10 monclient: build_initial_monmap 2026-02-17T11:55:52.642 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.639+0000 7f2e92b53640 10 monclient: monmap: 2026-02-17T11:55:52.642 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:55:52.641188+0000 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:55:52.641188+0000 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:52.643 INFO:teuthology.misc.health.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:52.644 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:52.644 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 1 Processor -- start 2026-02-17T11:55:52.644 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 1 -- start start 2026-02-17T11:55:52.644 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 10 monclient: init 2026-02-17T11:55:52.651 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:52.651 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 10 monclient: _add_conns ranks=[5,0,1,2,3,4] 2026-02-17T11:55:52.651 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f2e8c0c9130 0x7f2e8c0c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.651 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 10 monclient(hunting): picked mon.noname-c con 0x7f2e8c0c9130 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2e8c06d900 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2e8c14ed10 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8c06f2e0 con 0x7f2e8c06d900 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8c06df60 con 0x7f2e8c14ed10 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2e8c06dd30 con 0x7f2e8c0c9130 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.640+0000 7f2e92b53640 10 monclient(hunting): authenticate will time out at 1022.362912s 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e910c9640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f2e8c14ed10 0x7f2e8c14f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:59346/0 (socket says 10.20.193.10:59346) 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e910c9640 1 -- 10.20.193.10:0/759472236 learned_addr learned my addr 10.20.193.10:0/759472236 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e83fff640 1 --1- 10.20.193.10:0/759472236 >> v1:10.20.193.10:6789/0 conn(0x7f2e8c06d900 0x7f2e8c159df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:35014/0 (socket says 10.20.193.10:35014) 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e908c8640 1 --2- 10.20.193.10:0/759472236 >> v2:10.20.193.153:3300/0 conn(0x7f2e8c0c9130 0x7f2e8c0c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e908c8640 10 monclient(hunting): get_auth_request con 0x7f2e8c0c9130 auth_method 0 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e908c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e908c8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e908c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e908c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.641+0000 7f2e908c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e908c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 1 -- 10.20.193.10:0/759472236 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190372255 0 0) 0x7f2e8c06f2e0 con 0x7f2e8c06d900 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 10 monclient(hunting): _negotiate 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 10 monclient(hunting): my global_id is 4353 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 1 -- 10.20.193.10:0/759472236 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e78003620 con 0x7f2e8c06d900 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 1 -- 10.20.193.10:0/759472236 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318789161 0 0) 0x7f2e8c06df60 con 0x7f2e8c14ed10 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 10 monclient(hunting): _negotiate 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 10 monclient(hunting): my global_id is 4396 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e837fe640 1 -- 10.20.193.10:0/759472236 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e8c06f2e0 con 0x7f2e8c14ed10 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e908c8640 10 monclient(hunting): handle_auth_done global_id 4379 payload 274 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.642+0000 7f2e908c8640 1 -- 10.20.193.10:0/759472236 >> v1:10.20.193.71:6789/0 conn(0x7f2e8c14ed10 legacy=0x7f2e8c14f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.643+0000 7f2e908c8640 1 -- 10.20.193.10:0/759472236 >> v1:10.20.193.10:6789/0 conn(0x7f2e8c06d900 legacy=0x7f2e8c159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.652 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.643+0000 7f2e908c8640 10 monclient: _finish_hunting 0 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.643+0000 7f2e908c8640 1 monclient: found mon.noname-c 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.643+0000 7f2e908c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.643+0000 7f2e908c8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.643+0000 7f2e908c8640 1 -- 10.20.193.10:0/759472236 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c06e240 con 0x7f2e8c0c9130 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.643+0000 7f2e908c8640 1 --2- 10.20.193.10:0/759472236 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c0c9130 0x7f2e8c0c9510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0098a0 tx=0x7f2e7c02ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cca45b6b425df9e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 1 -- 10.20.193.10:0/759472236 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c03c070 con 0x7f2e8c0c9130 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 10 monclient: dump: 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e92b53640 5 monclient: authenticate success, global_id 4379 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e92b53640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 1 -- 10.20.193.10:0/759472236 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c02fca0 con 0x7f2e8c0c9130 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 1 -- 10.20.193.10:0/759472236 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c037640 con 0x7f2e8c0c9130 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e837fe640 10 monclient: dump: 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:52.653 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e92b53640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.645+0000 7f2e92b53640 4 set_mon_vals no callback set 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 10 monclient: shutdown 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 -- 10.20.193.10:0/759472236 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c0c9130 msgr2=0x7f2e8c0c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 --2- 10.20.193.10:0/759472236 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c0c9130 0x7f2e8c0c9510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0098a0 tx=0x7f2e7c02ef90 comp rx=0 tx=0).stop 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 -- 10.20.193.10:0/759472236 shutdown_connections 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 --2- 10.20.193.10:0/759472236 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c0c9130 0x7f2e8c0c9510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 -- 10.20.193.10:0/759472236 >> 10.20.193.10:0/759472236 conn(0x7f2e8c0cd5d0 msgr2=0x7f2e8c0cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 -- 10.20.193.10:0/759472236 shutdown_connections 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 -- 10.20.193.10:0/759472236 wait complete. 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 10 monclient: build_initial_monmap 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 10 monclient: monmap: 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:epoch 0 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:created 0.000000 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 librados: starting msgr at 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 librados: starting objecter 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 Processor -- start 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 -- start start 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 librados: setting wanted keys 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 1 librados: calling monclient init 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.646+0000 7f2e92b53640 10 monclient: init 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c06d900 0x7f2e8c1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient(hunting): picked mon.noname-c con 0x7f2e8c06d900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2e8c0c9130 0x7f2e8c154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.654 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient(hunting): picked mon.noname-a con 0x7f2e8c0c9130 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2e8c14ed10 0x7f2e8c14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient(hunting): picked mon.noname-b con 0x7f2e8c14ed10 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c06e800 con 0x7f2e8c0c9130 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c06ee50 con 0x7f2e8c14ed10 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c06eae0 con 0x7f2e8c06d900 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e92b53640 10 monclient(hunting): authenticate will time out at 1022.369318s 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e908c8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c06d900 0x7f2e8c1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e83fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2e8c0c9130 0x7f2e8c154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e910c9640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2e8c14ed10 0x7f2e8c14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e908c8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c06d900 0x7f2e8c1543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:57796/0 (socket says 10.20.193.10:57796) 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e908c8640 1 -- 10.20.193.10:0/1627992598 learned_addr learned my addr 10.20.193.10:0/1627992598 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e908c8640 10 monclient(hunting): get_auth_request con 0x7f2e8c06d900 auth_method 0 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e908c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e908c8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e908c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e83fff640 10 monclient(hunting): get_auth_request con 0x7f2e8c0c9130 auth_method 0 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e83fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e910c9640 10 monclient(hunting): get_auth_request con 0x7f2e8c14ed10 auth_method 0 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e910c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e910c9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.647+0000 7f2e910c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.648+0000 7f2e908c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.648+0000 7f2e908c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.648+0000 7f2e908c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.648+0000 7f2e83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.648+0000 7f2e83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.648+0000 7f2e83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.648+0000 7f2e910c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.648+0000 7f2e910c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.648+0000 7f2e910c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 10 monclient(hunting): handle_auth_done global_id 4382 payload 824 2026-02-17T11:55:52.655 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 1 -- 10.20.193.10:0/1627992598 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2e8c14ed10 msgr2=0x7f2e8c14af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2e8c14ed10 0x7f2e8c14af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 1 -- 10.20.193.10:0/1627992598 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2e8c0c9130 msgr2=0x7f2e8c154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2e8c0c9130 0x7f2e8c154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 10 monclient: _finish_hunting 0 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 1 monclient: found mon.noname-c 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.649+0000 7f2e908c8640 1 -- 10.20.193.10:0/1627992598 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c073f00 con 0x7f2e8c06d900 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.650+0000 7f2e908c8640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c06d900 0x7f2e8c1543c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c016f60 tx=0x7f2e7c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.650+0000 7f2e817fa640 10 client.?.objecter ms_handle_connect 0x7f2e8c06d900 2026-02-17T11:55:52.656 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.650+0000 7f2e817fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e817fa640 1 -- 10.20.193.10:0/1627992598 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c046020 con 0x7f2e8c06d900 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e817fa640 10 monclient: dump: 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e817fa640 10 monclient: _finish_auth 0 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e817fa640 10 monclient: _check_auth_tickets 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e817fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 5 monclient: authenticate success, global_id 4382 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 10 monclient: _renew_subs 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c153320 con 0x7f2e8c06d900 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 10 client.4382.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 10 monclient: _renew_subs 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c1538e0 con 0x7f2e8c06d900 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 1 librados: init done 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.651+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8c0c9510 con 0x7f2e8c06d900 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.652+0000 7f2e817fa640 1 -- 10.20.193.10:0/1627992598 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c02fe50 con 0x7f2e8c06d900 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.652+0000 7f2e817fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.652+0000 7f2e817fa640 1 -- 10.20.193.10:0/1627992598 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c03c040 con 0x7f2e8c06d900 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.652+0000 7f2e817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.652+0000 7f2e817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.652+0000 7f2e817fa640 10 monclient: dump: 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:epoch 1 2026-02-17T11:55:52.657 INFO:teuthology.misc.health.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.658 INFO:teuthology.misc.health.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.658 INFO:teuthology.misc.health.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.658 INFO:teuthology.misc.health.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:52.658 INFO:teuthology.misc.health.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.658 INFO:teuthology.misc.health.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:52.658 INFO:teuthology.misc.health.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:52.658 INFO:teuthology.misc.health.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:52.658 INFO:teuthology.misc.health.trial010.stderr: 2026-02-17T11:55:52.658 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.652+0000 7f2e82ffd640 4 set_mon_vals no callback set 2026-02-17T11:55:52.764 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.762+0000 7f2e817fa640 1 -- 10.20.193.10:0/1627992598 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f2e7c053070 con 0x7f2e8c06d900 2026-02-17T11:55:52.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.763+0000 7f2e817fa640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2e5c078e00 0x7f2e5c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.763+0000 7f2e83fff640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2e5c078e00 0x7f2e5c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.763+0000 7f2e83fff640 10 monclient: get_auth_request con 0x7f2e5c078e00 auth_method 0 2026-02-17T11:55:52.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.763+0000 7f2e83fff640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2e5c078e00 0x7f2e5c07b2c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e74002ad0 tx=0x7f2e74002a60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:52.765 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.763+0000 7f2e817fa640 10 client.4382.objecter ms_handle_connect 0x7f2e5c078e00 2026-02-17T11:55:52.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.764+0000 7f2e817fa640 1 -- 10.20.193.10:0/1627992598 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 8563+0+0 (secure 0 0 0) 0x7f2e7c02fb60 con 0x7f2e8c06d900 2026-02-17T11:55:52.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.764+0000 7f2e817fa640 10 client.4382.objecter ms_dispatch2 0x7f2e8c000b90 osd_map(30..30 src has 1..30) 2026-02-17T11:55:52.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.764+0000 7f2e817fa640 3 client.4382.objecter handle_osd_map got epochs [30,30] > 0 2026-02-17T11:55:52.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.764+0000 7f2e817fa640 3 client.4382.objecter handle_osd_map decoding full epoch 30 2026-02-17T11:55:52.766 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.764+0000 7f2e817fa640 20 client.4382.objecter dump_active .. 0 homeless 2026-02-17T11:55:52.772 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.771+0000 7f2e817fa640 1 -- 10.20.193.10:0/1627992598 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2e7c050020 con 0x7f2e8c06d900 2026-02-17T11:55:52.772 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.771+0000 7f2e817fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:52.772 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.771+0000 7f2e817fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:52.860 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.858+0000 7f2e92b53640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:52.861 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.858+0000 7f2e92b53640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:52.861 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.858+0000 7f2e92b53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:52.861 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.858+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e8c15cc10 con 0x7f2e8c06d900 2026-02-17T11:55:52.878 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.877+0000 7f2e817fa640 1 -- 10.20.193.10:0/1627992598 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+22754 (secure 0 0 0) 0x7f2e7c087210 con 0x7f2e8c06d900 2026-02-17T11:55:52.878 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.877+0000 7f2e817fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:52.878 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.877+0000 7f2e817fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:52.879 INFO:teuthology.misc.health.trial010.stdout: 2026-02-17T11:55:52.879 INFO:teuthology.misc.health.trial010.stdout:{"epoch":30,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:55:51.069988+0000","last_up_change":"2026-02-17T11:55:49.992320+0000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:55:41.943431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6826","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6827","nonce":311345990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6828","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6829","nonce":311345990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6832","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6833","nonce":311345990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6830","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6831","nonce":311345990}]},"public_addr":"10.20.193.10:6827/311345990","cluster_addr":"10.20.193.10:6829/311345990","heartbeat_back_addr":"10.20.193.10:6833/311345990","heartbeat_front_addr":"10.20.193.10:6831/311345990","state":["exists","up"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6808","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6809","nonce":168831009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6810","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6811","nonce":168831009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6814","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6815","nonce":168831009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6812","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6813","nonce":168831009}]},"public_addr":"10.20.193.71:6809/168831009","cluster_addr":"10.20.193.71:6811/168831009","heartbeat_back_addr":"10.20.193.71:6815/168831009","heartbeat_front_addr":"10.20.193.71:6813/168831009","state":["exists","up"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6817","nonce":4180566480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6819","nonce":4180566480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6823","nonce":4180566480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6821","nonce":4180566480}]},"public_addr":"10.20.193.153:6817/4180566480","cluster_addr":"10.20.193.153:6819/4180566480","heartbeat_back_addr":"10.20.193.153:6823/4180566480","heartbeat_front_addr":"10.20.193.153:6821/4180566480","state":["exists","up"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6816","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6817","nonce":2117394394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6818","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6819","nonce":2117394394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6822","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6823","nonce":2117394394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6820","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6821","nonce":2117394394}]},"public_addr":"10.20.193.174:6817/2117394394","cluster_addr":"10.20.193.174:6819/2117394394","heartbeat_back_addr":"10.20.193.174:6823/2117394394","heartbeat_front_addr":"10.20.193.174:6821/2117394394","state":["exists","up"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6810","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6811","nonce":4049638616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6812","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6813","nonce":4049638616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6816","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6817","nonce":4049638616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6814","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6815","nonce":4049638616}]},"public_addr":"10.20.193.10:6811/4049638616","cluster_addr":"10.20.193.10:6813/4049638616","heartbeat_back_addr":"10.20.193.10:6817/4049638616","heartbeat_front_addr":"10.20.193.10:6815/4049638616","state":["exists","up"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6816","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6817","nonce":1474787626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6818","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6819","nonce":1474787626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6822","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6823","nonce":1474787626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6820","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6821","nonce":1474787626}]},"public_addr":"10.20.193.71:6817/1474787626","cluster_addr":"10.20.193.71:6819/1474787626","heartbeat_back_addr":"10.20.193.71:6823/1474787626","heartbeat_front_addr":"10.20.193.71:6821/1474787626","state":["exists","up"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6824","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6825","nonce":3203696878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6826","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6827","nonce":3203696878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6830","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6831","nonce":3203696878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6828","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6829","nonce":3203696878}]},"public_addr":"10.20.193.153:6825/3203696878","cluster_addr":"10.20.193.153:6827/3203696878","heartbeat_back_addr":"10.20.193.153:6831/3203696878","heartbeat_front_addr":"10.20.193.153:6829/3203696878","state":["exists","up"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6808","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6809","nonce":561251262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6810","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6811","nonce":561251262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6814","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6815","nonce":561251262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6812","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6813","nonce":561251262}]},"public_addr":"10.20.193.174:6809/561251262","cluster_addr":"10.20.193.174:6811/561251262","heartbeat_back_addr":"10.20.193.174:6815/561251262","heartbeat_front_addr":"10.20.193.174:6813/561251262","state":["exists","up"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6818","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6819","nonce":1997295941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6820","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6821","nonce":1997295941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6824","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6825","nonce":1997295941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6822","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6823","nonce":1997295941}]},"public_addr":"10.20.193.10:6819/1997295941","cluster_addr":"10.20.193.10:6821/1997295941","heartbeat_back_addr":"10.20.193.10:6825/1997295941","heartbeat_front_addr":"10.20.193.10:6823/1997295941","state":["exists","up"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6800","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6801","nonce":1369683666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6802","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6803","nonce":1369683666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6806","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6807","nonce":1369683666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6804","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6805","nonce":1369683666}]},"public_addr":"10.20.193.71:6801/1369683666","cluster_addr":"10.20.193.71:6803/1369683666","heartbeat_back_addr":"10.20.193.71:6807/1369683666","heartbeat_front_addr":"10.20.193.71:6805/1369683666","state":["exists","up"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6800","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6801","nonce":22479275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6802","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6803","nonce":22479275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6806","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6807","nonce":22479275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6804","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6805","nonce":22479275}]},"public_addr":"10.20.193.153:6801/22479275","cluster_addr":"10.20.193.153:6803/22479275","heartbeat_back_addr":"10.20.193.153:6807/22479275","heartbeat_front_addr":"10.20.193.153:6805/22479275","state":["exists","up"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6800","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6801","nonce":4034633078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6802","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6803","nonce":4034633078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6806","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6807","nonce":4034633078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6804","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6805","nonce":4034633078}]},"public_addr":"10.20.193.174:6801/4034633078","cluster_addr":"10.20.193.174:6803/4034633078","heartbeat_back_addr":"10.20.193.174:6807/4034633078","heartbeat_front_addr":"10.20.193.174:6805/4034633078","state":["exists","up"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6802","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6803","nonce":2920105256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6804","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6805","nonce":2920105256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6808","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6809","nonce":2920105256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6806","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6807","nonce":2920105256}]},"public_addr":"10.20.193.10:6803/2920105256","cluster_addr":"10.20.193.10:6805/2920105256","heartbeat_back_addr":"10.20.193.10:6809/2920105256","heartbeat_front_addr":"10.20.193.10:6807/2920105256","state":["exists","up"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6824","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6825","nonce":1119039635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6826","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6827","nonce":1119039635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6830","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6831","nonce":1119039635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6828","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6829","nonce":1119039635}]},"public_addr":"10.20.193.71:6825/1119039635","cluster_addr":"10.20.193.71:6827/1119039635","heartbeat_back_addr":"10.20.193.71:6831/1119039635","heartbeat_front_addr":"10.20.193.71:6829/1119039635","state":["exists","up"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6808","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6809","nonce":3794015163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6810","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6811","nonce":3794015163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6814","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6815","nonce":3794015163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6812","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6813","nonce":3794015163}]},"public_addr":"10.20.193.153:6809/3794015163","cluster_addr":"10.20.193.153:6811/3794015163","heartbeat_back_addr":"10.20.193.153:6815/3794015163","heartbeat_front_addr":"10.20.193.153:6813/3794015163","state":["exists","up"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6824","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6825","nonce":3564494722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6826","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6827","nonce":3564494722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6830","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6831","nonce":3564494722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6828","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6829","nonce":3564494722}]},"public_addr":"10.20.193.174:6825/3564494722","cluster_addr":"10.20.193.174:6827/3564494722","heartbeat_back_addr":"10.20.193.174:6831/3564494722","heartbeat_front_addr":"10.20.193.174:6829/3564494722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.360736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.381048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.960607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:42.224431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.663427+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.986296+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.607032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.107139+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:38.853441+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.425353+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.674962+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.372465+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.295380+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.299793+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.045566+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:42.253940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 10 librados: watch_flush enter 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 10 librados: watch_flush exit 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 20 client.4382.objecter shutdown clearing up homeless session... 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 10 client.4382.objecter successfully canceled tick 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2e5c078e00 msgr2=0x7f2e5c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2e5c078e00 0x7f2e5c07b2c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e74002ad0 tx=0x7f2e74002a60 comp rx=0 tx=0).stop 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 10 monclient: shutdown 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c06d900 msgr2=0x7f2e8c1543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c06d900 0x7f2e8c1543c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c016f60 tx=0x7f2e7c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 shutdown_connections 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2e5c078e00 0x7f2e5c07b2c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2e8c14ed10 0x7f2e8c14af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2e8c0c9130 0x7f2e8c154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 --2- 10.20.193.10:0/1627992598 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2e8c06d900 0x7f2e8c1543c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 >> 10.20.193.10:0/1627992598 conn(0x7f2e8c0cd5d0 msgr2=0x7f2e8c15a120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 shutdown_connections 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 -- 10.20.193.10:0/1627992598 wait complete. 2026-02-17T11:55:52.880 INFO:teuthology.misc.health.trial010.stderr:2026-02-17T11:55:52.878+0000 7f2e92b53640 1 librados: shutdown 2026-02-17T11:55:52.888 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-17T11:55:52.888 INFO:tasks.ceph:Creating RBD pool 2026-02-17T11:55:52.888 DEBUG:teuthology.orchestra.run.trial010:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T11:55:52.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.953+0000 7f6514933640 10 monclient: get_monmap_and_config 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.953+0000 7f6514933640 10 monclient: build_initial_monmap 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.953+0000 7f6514933640 10 monclient: monmap: 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:52.954304+0000 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:52.954304+0000 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:52.955 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:52.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.953+0000 7f6514933640 1 Processor -- start 2026-02-17T11:55:52.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.953+0000 7f6514933640 1 -- start start 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.953+0000 7f6514933640 10 monclient: init 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.953+0000 7f6514933640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.953+0000 7f6514933640 10 monclient: _add_conns ranks=[2,5,4,0,3,1] 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f650c152660 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f650c15b030 0x7f650c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 10 monclient(hunting): picked mon.noname-c con 0x7f650c15b030 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f650c152a40 0x7f650c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 10 monclient(hunting): picked mon.noname-b con 0x7f650c152a40 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650c0c71e0 con 0x7f650c152660 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f650c0c77a0 con 0x7f650c152a40 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f650c0c74c0 con 0x7f650c15b030 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6514933640 10 monclient(hunting): authenticate will time out at 1022.676049s 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6511ea7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f650c15b030 0x7f650c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6512ea9640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f650c152a40 0x7f650c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f65126a8640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f650c152660 0x7f650c15a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55908/0 (socket says 10.20.193.10:55908) 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f65126a8640 1 -- 10.20.193.10:0/1107730966 learned_addr learned my addr 10.20.193.10:0/1107730966 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6511ea7640 10 monclient(hunting): get_auth_request con 0x7f650c15b030 auth_method 0 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6511ea7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6511ea7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6511ea7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6512ea9640 10 monclient(hunting): get_auth_request con 0x7f650c152a40 auth_method 0 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6512ea9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6512ea9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.954+0000 7f6512ea9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.955+0000 7f6511ea7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.955+0000 7f6511ea7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.955+0000 7f6511ea7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.955+0000 7f6512ea9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.955+0000 7f6512ea9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.955+0000 7f6512ea9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.956+0000 7f6511ea7640 10 monclient(hunting): handle_auth_done global_id 4385 payload 274 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.956+0000 7f6511ea7640 1 -- 10.20.193.10:0/1107730966 >> v2:10.20.193.71:3300/0 conn(0x7f650c152a40 msgr2=0x7f650c0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.956+0000 7f6511ea7640 1 --2- 10.20.193.10:0/1107730966 >> v2:10.20.193.71:3300/0 conn(0x7f650c152a40 0x7f650c0c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.956+0000 7f6511ea7640 1 -- 10.20.193.10:0/1107730966 >> v1:10.20.193.153:6789/0 conn(0x7f650c152660 legacy=0x7f650c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.956+0000 7f6511ea7640 10 monclient: _finish_hunting 0 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.956+0000 7f6511ea7640 1 monclient: found mon.noname-c 2026-02-17T11:55:52.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.956+0000 7f6511ea7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:52.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.956+0000 7f6511ea7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:52.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.956+0000 7f6511ea7640 1 -- 10.20.193.10:0/1107730966 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c159e40 con 0x7f650c15b030 2026-02-17T11:55:52.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.958+0000 7f6511ea7640 1 --2- 10.20.193.10:0/1107730966 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f650c15b030 0x7f650c0c8dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f650c1563f0 tx=0x7f64f802ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a55d484688f880e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 1 -- 10.20.193.10:0/1107730966 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f803c070 con 0x7f650c15b030 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 10 monclient: dump: 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:52.962 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 10 monclient: _finish_auth 0 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 10 monclient: _check_auth_tickets 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 1 -- 10.20.193.10:0/1107730966 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f802faf0 con 0x7f650c15b030 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 1 -- 10.20.193.10:0/1107730966 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f8037440 con 0x7f650c15b030 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f65116a6640 10 monclient: dump: 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 5 monclient: authenticate success, global_id 4385 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 4 set_mon_vals no callback set 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 10 monclient: shutdown 2026-02-17T11:55:52.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:52.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 1 -- 10.20.193.10:0/1107730966 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f650c15b030 msgr2=0x7f650c0c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 1 --2- 10.20.193.10:0/1107730966 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f650c15b030 0x7f650c0c8dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f650c1563f0 tx=0x7f64f802ede0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 1 -- 10.20.193.10:0/1107730966 shutdown_connections 2026-02-17T11:55:52.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 1 --2- 10.20.193.10:0/1107730966 >> v2:10.20.193.71:3300/0 conn(0x7f650c152a40 0x7f650c0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 1 --2- 10.20.193.10:0/1107730966 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f650c15b030 0x7f650c0c8dd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 1 -- 10.20.193.10:0/1107730966 >> 10.20.193.10:0/1107730966 conn(0x7f650c0c9d80 msgr2=0x7f650c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:52.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 1 -- 10.20.193.10:0/1107730966 shutdown_connections 2026-02-17T11:55:52.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.960+0000 7f6514933640 1 -- 10.20.193.10:0/1107730966 wait complete. 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient: build_initial_monmap 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient: monmap: 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 librados: starting msgr at 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 librados: starting objecter 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 Processor -- start 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 -- start start 2026-02-17T11:55:52.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 librados: setting wanted keys 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 librados: calling monclient init 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient: init 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f650c152660 0x7f650c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient(hunting): picked mon.noname-a con 0x7f650c152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f650c152a40 0x7f650c144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient(hunting): picked mon.noname-b con 0x7f650c152a40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f650c15b030 0x7f650c1f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient(hunting): picked mon.noname-c con 0x7f650c15b030 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f650c0c5cd0 con 0x7f650c152660 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f650c15a400 con 0x7f650c152a40 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f650c0c5e50 con 0x7f650c15b030 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.961+0000 7f6514933640 10 monclient(hunting): authenticate will time out at 1022.683962s 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f650c152a40 0x7f650c144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f65126a8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f650c152660 0x7f650c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6512ea9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f650c15b030 0x7f650c1f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f650c152a40 0x7f650c144230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:49544/0 (socket says 10.20.193.10:49544) 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 1 -- 10.20.193.10:0/1962353759 learned_addr learned my addr 10.20.193.10:0/1962353759 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 10 monclient(hunting): get_auth_request con 0x7f650c152a40 auth_method 0 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:52.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6512ea9640 10 monclient(hunting): get_auth_request con 0x7f650c15b030 auth_method 0 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6512ea9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6512ea9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6512ea9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f65126a8640 10 monclient(hunting): get_auth_request con 0x7f650c152660 auth_method 0 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f65126a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f65126a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f65126a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6511ea7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6512ea9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6512ea9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f6512ea9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f65126a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f65126a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.962+0000 7f65126a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 10 monclient(hunting): handle_auth_done global_id 4405 payload 824 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 1 -- 10.20.193.10:0/1962353759 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f650c15b030 msgr2=0x7f650c1f53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f650c15b030 0x7f650c1f53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 1 -- 10.20.193.10:0/1962353759 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f650c152660 msgr2=0x7f650c148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f650c152660 0x7f650c148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 10 monclient: _finish_hunting 0 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 1 monclient: found mon.noname-b 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:52.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:52.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.964+0000 7f6511ea7640 1 -- 10.20.193.10:0/1962353759 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c0cc020 con 0x7f650c152a40 2026-02-17T11:55:52.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.965+0000 7f6511ea7640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f650c152a40 0x7f650c144230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009130 tx=0x7f64f80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:52.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.965+0000 7f64f6ffd640 10 client.?.objecter ms_handle_connect 0x7f650c152a40 2026-02-17T11:55:52.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.965+0000 7f64f6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 1 -- 10.20.193.10:0/1962353759 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f803c040 con 0x7f650c152a40 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 10 monclient: dump: 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 1 -- 10.20.193.10:0/1962353759 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f8042610 con 0x7f650c152a40 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 5 monclient: authenticate success, global_id 4405 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 10 monclient: _renew_subs 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650c0cc300 con 0x7f650c152a40 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 1 -- 10.20.193.10:0/1962353759 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f80429e0 con 0x7f650c152a40 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:52.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f64f6ffd640 10 monclient: dump: 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6510ea5640 4 set_mon_vals no callback set 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 10 client.4405.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 10 monclient: _renew_subs 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f650c0cc8c0 con 0x7f650c152a40 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 1 librados: init done 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:52.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.967+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f650c15a920 con 0x7f650c152a40 2026-02-17T11:55:52.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.979+0000 7f64f6ffd640 1 -- 10.20.193.10:0/1962353759 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f64f804b450 con 0x7f650c152a40 2026-02-17T11:55:52.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.980+0000 7f64f6ffd640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f64dc078e50 0x7f64dc07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:52.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.980+0000 7f65126a8640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f64dc078e50 0x7f64dc07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:52.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.980+0000 7f65126a8640 10 monclient: get_auth_request con 0x7f64dc078e50 auth_method 0 2026-02-17T11:55:52.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.980+0000 7f65126a8640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f64dc078e50 0x7f64dc07b310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6504002770 tx=0x7f6504002930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:52.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.980+0000 7f64f6ffd640 10 client.4405.objecter ms_handle_connect 0x7f64dc078e50 2026-02-17T11:55:52.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.981+0000 7f64f6ffd640 1 -- 10.20.193.10:0/1962353759 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 8563+0+0 (secure 0 0 0) 0x7f64f802fa70 con 0x7f650c152a40 2026-02-17T11:55:52.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.981+0000 7f64f6ffd640 10 client.4405.objecter ms_dispatch2 0x7f650c000b90 osd_map(30..30 src has 1..30) 2026-02-17T11:55:52.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.981+0000 7f64f6ffd640 3 client.4405.objecter handle_osd_map got epochs [30,30] > 0 2026-02-17T11:55:52.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.981+0000 7f64f6ffd640 3 client.4405.objecter handle_osd_map decoding full epoch 30 2026-02-17T11:55:52.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:52.981+0000 7f64f6ffd640 20 client.4405.objecter dump_active .. 0 homeless 2026-02-17T11:55:53.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:53.084+0000 7f64f6ffd640 1 -- 10.20.193.10:0/1962353759 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f64f8086880 con 0x7f650c152a40 2026-02-17T11:55:53.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:53.084+0000 7f64f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:53.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:53.084+0000 7f64f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:53.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:53.168+0000 7f6514933640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T11:55:53.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:53.168+0000 7f6514933640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T11:55:53.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:53.168+0000 7f6514933640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:53.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:53.168+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f650c14c8a0 con 0x7f650c152a40 2026-02-17T11:55:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.227+0000 7f64f6ffd640 1 -- 10.20.193.10:0/1962353759 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v31) ==== 109+0+0 (secure 0 0 0) 0x7f64f808ab80 con 0x7f650c152a40 2026-02-17T11:55:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.227+0000 7f64f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T11:55:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.227+0000 7f64f6ffd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-17T11:55:54.229 INFO:teuthology.orchestra.run.trial010.stderr:pool 'rbd' created 2026-02-17T11:55:54.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 10 librados: watch_flush enter 2026-02-17T11:55:54.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 10 librados: watch_flush exit 2026-02-17T11:55:54.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 20 client.4405.objecter shutdown clearing up homeless session... 2026-02-17T11:55:54.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 10 client.4405.objecter successfully canceled tick 2026-02-17T11:55:54.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f64dc078e50 msgr2=0x7f64dc07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:54.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f64dc078e50 0x7f64dc07b310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6504002770 tx=0x7f6504002930 comp rx=0 tx=0).stop 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 10 monclient: shutdown 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f650c152a40 msgr2=0x7f650c144230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f650c152a40 0x7f650c144230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009130 tx=0x7f64f80047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 shutdown_connections 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f64dc078e50 0x7f64dc07b310 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f650c15b030 0x7f650c1f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f650c152a40 0x7f650c144230 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 --2- 10.20.193.10:0/1962353759 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f650c152660 0x7f650c148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 >> 10.20.193.10:0/1962353759 conn(0x7f650c0c9d80 msgr2=0x7f650c14cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 shutdown_connections 2026-02-17T11:55:54.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 -- 10.20.193.10:0/1962353759 wait complete. 2026-02-17T11:55:54.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.229+0000 7f6514933640 1 librados: shutdown 2026-02-17T11:55:54.239 DEBUG:teuthology.orchestra.run.trial010:> rbd --cluster ceph pool init rbd 2026-02-17T11:55:54.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.267+0000 7fcdbccc00c0 10 monclient: get_monmap_and_config 2026-02-17T11:55:54.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.267+0000 7fcdbccc00c0 10 monclient: build_initial_monmap 2026-02-17T11:55:54.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.267+0000 7fcdbccc00c0 10 monclient: monmap: 2026-02-17T11:55:54.269 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:54.269 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:54.269 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:54.269200+0000 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:54.269200+0000 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.268+0000 7fcdbccc00c0 1 Processor -- start 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.268+0000 7fcdbccc00c0 1 -- start start 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.268+0000 7fcdbccc00c0 10 monclient: init 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 10 monclient: _reopen_session rank -1 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 10 monclient: _add_conns ranks=[1,2,3,0,4,5] 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 10 monclient(hunting): picked mon.noname-b-legacy con 0x562805961920 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 10 monclient(hunting): picked mon.noname-c-legacy con 0x562805961d00 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:54.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 1 --2- >> v2:10.20.193.10:3300/0 conn(0x562805a2b340 0x562805a2b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:54.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 10 monclient(hunting): picked mon.noname-a con 0x562805a2b340 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:54.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5628057c3d20 con 0x562805961920 2026-02-17T11:55:54.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56280580cf40 con 0x562805961d00 2026-02-17T11:55:54.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:54.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x5628057f0c50 con 0x562805a2b340 2026-02-17T11:55:54.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 10 monclient(hunting): _renew_subs 2026-02-17T11:55:54.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.269+0000 7fcdbccc00c0 10 monclient(hunting): authenticate will time out at 1023.991098s 2026-02-17T11:55:54.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.271+0000 7fcdbaf85640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x562805961d00 0x56280599e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55166/0 (socket says 10.20.193.10:55166) 2026-02-17T11:55:54.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.271+0000 7fcdbaf85640 1 -- 10.20.193.10:0/2596681436 learned_addr learned my addr 10.20.193.10:0/2596681436 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:54.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.274+0000 7fcdbca0f640 1 --2- 10.20.193.10:0/2596681436 >> v2:10.20.193.10:3300/0 conn(0x562805a2b340 0x562805a2b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:54.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.274+0000 7fcdbca0f640 10 monclient(hunting): get_auth_request con 0x562805a2b340 auth_method 0 2026-02-17T11:55:54.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.274+0000 7fcdbca0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:54.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.274+0000 7fcdbca0f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:54.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.274+0000 7fcdbca0f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:54.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.274+0000 7fcdbca0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:54.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.274+0000 7fcdbca0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:54.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.274+0000 7fcdbca0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:54.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 1 -- 10.20.193.10:0/2596681436 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1623002563 0 0) 0x5628057c3d20 con 0x562805961920 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 10 monclient(hunting): _negotiate 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 10 monclient(hunting): my global_id is 4408 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 1 -- 10.20.193.10:0/2596681436 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcda8001e10 con 0x562805961920 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 1 -- 10.20.193.10:0/2596681436 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2252416600 0 0) 0x56280580cf40 con 0x562805961d00 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 10 monclient(hunting): _negotiate 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 10 monclient(hunting): my global_id is 4394 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.275+0000 7fcdba784640 1 -- 10.20.193.10:0/2596681436 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5628057c3d20 con 0x562805961d00 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.276+0000 7fcdbca0f640 10 monclient(hunting): handle_auth_done global_id 4362 payload 274 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.276+0000 7fcdbca0f640 1 -- 10.20.193.10:0/2596681436 >> v1:10.20.193.153:6789/0 conn(0x562805961d00 legacy=0x56280599e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.276+0000 7fcdbca0f640 1 -- 10.20.193.10:0/2596681436 >> v1:10.20.193.71:6789/0 conn(0x562805961920 legacy=0x5628059a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.276+0000 7fcdbca0f640 10 monclient: _finish_hunting 0 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.276+0000 7fcdbca0f640 1 monclient: found mon.noname-a 2026-02-17T11:55:54.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.276+0000 7fcdbca0f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:54.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.276+0000 7fcdbca0f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:54.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.276+0000 7fcdbca0f640 1 -- 10.20.193.10:0/2596681436 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562805a35a30 con 0x562805a2b340 2026-02-17T11:55:54.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.278+0000 7fcdbca0f640 1 --2- 10.20.193.10:0/2596681436 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805a2b340 0x562805a2b790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdac005fd0 tx=0x7fcdac058580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db012a0a66dcf7ab server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 1 -- 10.20.193.10:0/2596681436 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac06d070 con 0x562805a2b340 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 10 monclient: dump: 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:54.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 10 monclient: _finish_auth 0 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 10 monclient: _check_auth_tickets 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 1 -- 10.20.193.10:0/2596681436 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdac060c70 con 0x562805a2b340 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 5 monclient: authenticate success, global_id 4362 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 1 -- 10.20.193.10:0/2596681436 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac068660 con 0x562805a2b340 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdba784640 10 monclient: dump: 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:54.284 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 10 monclient: get_monmap_and_config success 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 4 set_mon_vals no callback set 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 10 monclient: shutdown 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/2596681436 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805a2b340 msgr2=0x562805a2b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 1 --2- 10.20.193.10:0/2596681436 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805a2b340 0x562805a2b790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdac005fd0 tx=0x7fcdac058580 comp rx=0 tx=0).stop 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/2596681436 shutdown_connections 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 1 --2- 10.20.193.10:0/2596681436 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805a2b340 0x562805a2b790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/2596681436 >> 10.20.193.10:0/2596681436 conn(0x5628059a3d00 msgr2=0x5628059a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/2596681436 shutdown_connections 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.280+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/2596681436 wait complete. 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient: build_initial_monmap 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient: monmap: 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:54.285 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:54.286 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:54.286 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:54.286 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:54.286 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:54.286 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:54.286 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:54.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 librados: starting msgr at 2026-02-17T11:55:54.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 librados: starting objecter 2026-02-17T11:55:54.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 Processor -- start 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 -- start start 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 librados: setting wanted keys 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 librados: calling monclient init 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient: init 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient: _reopen_session rank -1 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805961920 0x562805a40c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient(hunting): picked mon.noname-a con 0x562805961920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x562805961d00 0x562805a20d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient(hunting): picked mon.noname-b con 0x562805961d00 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x562805a2b340 0x562805a2fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient(hunting): picked mon.noname-c con 0x562805a2b340 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x562805841240 con 0x562805961920 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x562805845310 con 0x562805961d00 2026-02-17T11:55:54.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x5628057dfe50 con 0x562805a2b340 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient(hunting): _renew_subs 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.281+0000 7fcdbccc00c0 10 monclient(hunting): authenticate will time out at 1024.003992s 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805961920 0x562805a40c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbca0f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x562805a2b340 0x562805a2fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbaf85640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x562805961d00 0x562805a20d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805961920 0x562805a40c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38002/0 (socket says 10.20.193.10:38002) 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 1 -- 10.20.193.10:0/1664263343 learned_addr learned my addr 10.20.193.10:0/1664263343 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 10 monclient(hunting): get_auth_request con 0x562805961920 auth_method 0 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbaf85640 10 monclient(hunting): get_auth_request con 0x562805961d00 auth_method 0 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbaf85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbaf85640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbaf85640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbca0f640 10 monclient(hunting): get_auth_request con 0x562805a2b340 auth_method 0 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbca0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbca0f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbca0f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:54.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbb786640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbaf85640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbaf85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbaf85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbca0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbca0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.282+0000 7fcdbca0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 10 monclient(hunting): handle_auth_done global_id 4365 payload 824 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 1 -- 10.20.193.10:0/1664263343 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x562805a2b340 msgr2=0x562805a2fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x562805a2b340 0x562805a2fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 1 -- 10.20.193.10:0/1664263343 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x562805961d00 msgr2=0x562805a20d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x562805961d00 0x562805a20d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 10 monclient: _finish_hunting 0 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 1 monclient: found mon.noname-a 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.284+0000 7fcdbb786640 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562805a420c0 con 0x562805961920 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.285+0000 7fcdbb786640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805961920 0x562805a40c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000bf20 tx=0x7fcdb0009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.285+0000 7fcda37fe640 10 client.?.objecter ms_handle_connect 0x562805961920 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.285+0000 7fcda37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:54.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0014030 con 0x562805961920 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 10 monclient: dump: 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcdbccc00c0 5 monclient: authenticate success, global_id 4365 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb000f400 con 0x562805961920 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0009e60 con 0x562805961920 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:54.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcda37fe640 10 monclient: dump: 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcdbccc00c0 10 monclient: _renew_subs 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcdbccc00c0 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcdb9f83640 4 set_mon_vals no callback set 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562805a41260 con 0x562805961920 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcdbccc00c0 10 client.4365.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcdbccc00c0 10 monclient: _renew_subs 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.286+0000 7fcdbccc00c0 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.287+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562805a41820 con 0x562805961920 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.287+0000 7fcdbccc00c0 1 librados: init done 2026-02-17T11:55:54.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.287+0000 7fcdbccc00c0 10 librados: wait_for_osdmap waiting 2026-02-17T11:55:54.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.299+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fcdb0021060 con 0x562805961920 2026-02-17T11:55:54.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.299+0000 7fcda37fe640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd9c076e80 0x7fcd9c079340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:54.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.299+0000 7fcdbaf85640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd9c076e80 0x7fcd9c079340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:54.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.300+0000 7fcdbaf85640 10 monclient: get_auth_request con 0x7fcd9c076e80 auth_method 0 2026-02-17T11:55:54.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.300+0000 7fcdbaf85640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd9c076e80 0x7fcd9c079340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcda4001960 tx=0x7fcda40018f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:54.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.300+0000 7fcda37fe640 10 client.4365.objecter ms_handle_connect 0x7fcd9c076e80 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 8905+0+0 (secure 0 0 0) 0x7fcdb005c0a0 con 0x562805961920 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcda37fe640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 osd_map(31..31 src has 1..31) 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcda37fe640 3 client.4365.objecter handle_osd_map got epochs [31,31] > 0 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcda37fe640 3 client.4365.objecter handle_osd_map decoding full epoch 31 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcda37fe640 20 client.4365.objecter dump_active .. 0 homeless 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcdbccc00c0 10 librados: wait_for_osdmap done waiting 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcdbccc00c0 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcdbccc00c0 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcdbccc00c0 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:54.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:54.301+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x562805a2f590 con 0x562805961920 2026-02-17T11:55:54.776 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:02:11.943 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:54.778 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:02:11.946 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:54.779 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:02:11.942 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:54.781 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:02:11.944 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:54.808 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:02:11.936 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:54.809 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:02:11.972 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:54.810 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:02:11.939 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:54.817 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:02:11.985 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:54.839 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:02:11.967 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:55:55.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.255+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v32) ==== 141+0+0 (secure 0 0 0) 0x562805a420c0 con 0x562805961920 2026-02-17T11:55:55.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.255+0000 7fcda37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T11:55:55.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.255+0000 7fcda37fe640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-17T11:55:55.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.255+0000 7fcdbccc00c0 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:55.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.255+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcdac060c70 con 0x562805961920 2026-02-17T11:55:55.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.300+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcdb005c460 con 0x562805961920 2026-02-17T11:55:55.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.300+0000 7fcda37fe640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T11:55:55.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.300+0000 7fcdb9f83640 10 client.4365.objecter _get_latest_version latest 32, waiting 2026-02-17T11:55:55.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.300+0000 7fcdb9f83640 10 client.4365.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:55.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.300+0000 7fcdb9f83640 10 monclient: _renew_subs 2026-02-17T11:55:55.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.300+0000 7fcdb9f83640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:55.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.300+0000 7fcdb9f83640 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=32}) -- 0x7fcd94003c90 con 0x562805961920 2026-02-17T11:55:55.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 8 ==== osd_map(32..32 src has 1..32) ==== 682+0+0 (secure 0 0 0) 0x7fcdb005f920 con 0x562805961920 2026-02-17T11:55:55.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcda37fe640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 osd_map(32..32 src has 1..32) 2026-02-17T11:55:55.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcda37fe640 3 client.4365.objecter handle_osd_map got epochs [32,32] > 31 2026-02-17T11:55:55.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcda37fe640 3 client.4365.objecter handle_osd_map decoding incremental epoch 32 2026-02-17T11:55:55.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcda37fe640 20 client.4365.objecter dump_active .. 0 homeless 2026-02-17T11:55:55.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 10 librados: create oid=rbd_trash nspace= 2026-02-17T11:55:55.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 10 client.4365.objecter _op_submit op 0x562805a302d0 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 20 client.4365.objecter _calc_target epoch 32 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 20 client.4365.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 10 client.4365.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [11,2] primary 11 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x5628059a1ff0 0x562805a443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 20 client.4365.objecter _get_session s=0x5628057e0230 osd=11 3 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 10 client.4365.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.11 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 20 client.4365.objecter get_session s=0x5628057e0230 osd=11 3 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 15 client.4365.objecter _session_op_assign 11 1 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 15 client.4365.objecter _send_op 1 to 2.3 on osd.11 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562805a44920 con 0x5628059a1ff0 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 20 client.4365.objecter put_session s=0x5628057e0230 osd=11 4 2026-02-17T11:55:55.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.302+0000 7fcdbccc00c0 5 client.4365.objecter 1 in flight 2026-02-17T11:55:55.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.305+0000 7fcdbca0f640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x5628059a1ff0 0x562805a443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:55.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.306+0000 7fcdbca0f640 10 monclient: get_auth_request con 0x5628059a1ff0 auth_method 0 2026-02-17T11:55:55.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.323+0000 7fcdbca0f640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x5628059a1ff0 0x562805a443e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:55.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.323+0000 7fcda37fe640 10 client.4365.objecter ms_handle_connect 0x5628059a1ff0 2026-02-17T11:55:55.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 1 -- 10.20.193.10:0/1664263343 <== osd.11 v2:10.20.193.174:6800/4034633078 1 ==== osd_op_reply(1 rbd_trash [create] v32'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fcdac068440 con 0x5628059a1ff0 2026-02-17T11:55:55.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 osd_op_reply(1 rbd_trash [create] v32'1 uv1 ondisk = 0) 2026-02-17T11:55:55.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 10 client.4365.objecter in handle_osd_op_reply 2026-02-17T11:55:55.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 7 client.4365.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-17T11:55:55.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 10 client.4365.objecter op 0 rval 0 len 0 2026-02-17T11:55:55.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 15 client.4365.objecter handle_osd_op_reply completed tid 1 2026-02-17T11:55:55.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 15 client.4365.objecter _finish_op 1 2026-02-17T11:55:55.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 20 client.4365.objecter put_session s=0x5628057e0230 osd=11 4 2026-02-17T11:55:55.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 15 client.4365.objecter _session_op_remove 11 1 2026-02-17T11:55:55.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbca0f640 5 client.4365.objecter 0 in flight 2026-02-17T11:55:55.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.559+0000 7fcdbccc00c0 10 librados: Objecter returned from create r=0 2026-02-17T11:55:55.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 10 client.4365.objecter _op_submit op 0x562805a9dbc0 2026-02-17T11:55:55.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 20 client.4365.objecter _calc_target epoch 32 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-17T11:55:55.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 20 client.4365.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T11:55:55.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 10 client.4365.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [2,12] primary 2 2026-02-17T11:55:55.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x562805a9e770 0x562805aa0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:55.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 20 client.4365.objecter _get_session s=0x562805a9e0f0 osd=2 3 2026-02-17T11:55:55.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 10 client.4365.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.2 2026-02-17T11:55:55.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 20 client.4365.objecter get_session s=0x562805a9e0f0 osd=2 3 2026-02-17T11:55:55.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 15 client.4365.objecter _session_op_assign 2 2 2026-02-17T11:55:55.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 15 client.4365.objecter _send_op 2 to 2.2 on osd.2 2026-02-17T11:55:55.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562805aa1180 con 0x562805a9e770 2026-02-17T11:55:55.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 20 client.4365.objecter put_session s=0x562805a9e0f0 osd=2 4 2026-02-17T11:55:55.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.561+0000 7fcdbccc00c0 5 client.4365.objecter 1 in flight 2026-02-17T11:55:55.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.562+0000 7fcdbb786640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x562805a9e770 0x562805aa0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:55.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.562+0000 7fcdbb786640 10 monclient: get_auth_request con 0x562805a9e770 auth_method 0 2026-02-17T11:55:55.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.564+0000 7fcdbb786640 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x562805a9e770 0x562805aa0c00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:55.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.564+0000 7fcda37fe640 10 client.4365.objecter ms_handle_connect 0x562805a9e770 2026-02-17T11:55:55.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 1 -- 10.20.193.10:0/1664263343 <== osd.2 v2:10.20.193.153:6816/4180566480 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcdb0060460 con 0x562805a9e770 2026-02-17T11:55:55.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-17T11:55:55.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 10 client.4365.objecter in handle_osd_op_reply 2026-02-17T11:55:55.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 7 client.4365.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-17T11:55:55.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 10 client.4365.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-17T11:55:55.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 10 client.4365.objecter op 0 rval 0 len 0 2026-02-17T11:55:55.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 15 client.4365.objecter handle_osd_op_reply completed tid 2 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 15 client.4365.objecter _finish_op 2 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 20 client.4365.objecter put_session s=0x562805a9e0f0 osd=2 4 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 15 client.4365.objecter _session_op_remove 2 2 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbb786640 5 client.4365.objecter 0 in flight 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 10 client.4365.objecter _op_submit op 0x562805a9cda0 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 20 client.4365.objecter _calc_target epoch 32 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 20 client.4365.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 10 client.4365.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [2,12] primary 2 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 20 client.4365.objecter _get_session s=0x562805a9e0f0 osd=2 3 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 10 client.4365.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.2 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 20 client.4365.objecter get_session s=0x562805a9e0f0 osd=2 3 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 15 client.4365.objecter _session_op_assign 2 3 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 15 client.4365.objecter _send_op 3 to 2.2 on osd.2 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562805a9d250 con 0x562805a9e770 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 20 client.4365.objecter put_session s=0x562805a9e0f0 osd=2 4 2026-02-17T11:55:55.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.678+0000 7fcdbccc00c0 5 client.4365.objecter 1 in flight 2026-02-17T11:55:55.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 1 -- 10.20.193.10:0/1664263343 <== osd.2 v2:10.20.193.153:6816/4180566480 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcdb0060460 con 0x562805a9e770 2026-02-17T11:55:55.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-17T11:55:55.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 10 client.4365.objecter in handle_osd_op_reply 2026-02-17T11:55:55.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 7 client.4365.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-17T11:55:55.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 10 client.4365.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-17T11:55:55.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 10 client.4365.objecter op 0 rval 0 len 0 2026-02-17T11:55:55.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 15 client.4365.objecter handle_osd_op_reply completed tid 3 2026-02-17T11:55:55.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 15 client.4365.objecter _finish_op 3 2026-02-17T11:55:55.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 20 client.4365.objecter put_session s=0x562805a9e0f0 osd=2 4 2026-02-17T11:55:55.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 15 client.4365.objecter _session_op_remove 2 3 2026-02-17T11:55:55.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdbb786640 5 client.4365.objecter 0 in flight 2026-02-17T11:55:55.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdb9782640 10 client.4365.objecter allocate_selfmanaged_snap; pool: 2 2026-02-17T11:55:55.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdb9782640 10 client.4365.objecter pool_op_submit 4 2026-02-17T11:55:55.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdb9782640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:55.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:55.684+0000 7fcdb9782640 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fcd980030d0 con 0x562805961920 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v33) ==== 55+0+0 (secure 0 0 0) 0x7fcdb0068d80 con 0x562805961920 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 pool_op_reply(tid 4 (0) Success v33) 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 10 client.4365.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v33) 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 10 client.4365.objecter have request 4 at 0x7fcd98003060 Op: create unmanaged snap 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 20 client.4365.objecter waiting for client to reach epoch 33 before calling back 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 10 client.4365.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 10 monclient: _renew_subs 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=33}) -- 0x7fcd9c07f610 con 0x562805961920 2026-02-17T11:55:56.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.420+0000 7fcda37fe640 10 client.4365.objecter done 2026-02-17T11:55:56.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 10 ==== osd_map(33..33 src has 1..33) ==== 626+0+0 (secure 0 0 0) 0x7fcdb007f020 con 0x562805961920 2026-02-17T11:55:56.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcda37fe640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 osd_map(33..33 src has 1..33) 2026-02-17T11:55:56.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcda37fe640 3 client.4365.objecter handle_osd_map got epochs [33,33] > 32 2026-02-17T11:55:56.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcda37fe640 3 client.4365.objecter handle_osd_map decoding incremental epoch 33 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcda37fe640 20 client.4365.objecter dump_active .. 0 homeless 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 20 librados: queue_aio_write 0x562805a99150 completion 0x562805804b20 write_seq 1 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 10 client.4365.objecter _op_submit op 0x7fcd94006380 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 20 client.4365.objecter _calc_target epoch 33 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 20 client.4365.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 10 client.4365.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [2,12] primary 2 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 20 client.4365.objecter _get_session s=0x562805a9e0f0 osd=2 3 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 10 client.4365.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.2 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 20 client.4365.objecter get_session s=0x562805a9e0f0 osd=2 3 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 15 client.4365.objecter _session_op_assign 2 5 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 15 client.4365.objecter _send_op 5 to 2.2 on osd.2 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x7fcd94006aa0 con 0x562805a9e770 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 20 client.4365.objecter put_session s=0x562805a9e0f0 osd=2 4 2026-02-17T11:55:56.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.425+0000 7fcdb9f83640 5 client.4365.objecter 1 in flight 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 1 -- 10.20.193.10:0/1664263343 <== osd.2 v2:10.20.193.153:6816/4180566480 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v33'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcdb0060460 con 0x562805a9e770 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 osd_op_reply(5 rbd_info [create,write 0~8] v33'1 uv1 ondisk = 0) 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 10 client.4365.objecter in handle_osd_op_reply 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 7 client.4365.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 10 client.4365.objecter op 0 rval 0 len 0 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 10 client.4365.objecter op 1 rval 0 len 0 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 15 client.4365.objecter handle_osd_op_reply completed tid 5 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 15 client.4365.objecter _finish_op 5 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 20 client.4365.objecter put_session s=0x562805a9e0f0 osd=2 4 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 15 client.4365.objecter _session_op_remove 2 5 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 5 client.4365.objecter 0 in flight 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdbb786640 20 librados: complete_aio_write 0x562805804b20 2026-02-17T11:55:56.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdb9782640 10 client.4365.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-17T11:55:56.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdb9782640 10 client.4365.objecter pool_op_submit 6 2026-02-17T11:55:56.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdb9782640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:56.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:56.634+0000 7fcdb9782640 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v33) -- 0x7fcd98004520 con 0x562805961920 2026-02-17T11:55:57.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.282+0000 7fcda27fc640 10 monclient: tick 2026-02-17T11:55:57.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.282+0000 7fcda27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:57.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.282+0000 7fcda27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:57.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.282+0000 7fcda27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:57.465 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v34) ==== 43+0+0 (secure 0 0 0) 0x7fcdb005f350 con 0x562805961920 2026-02-17T11:55:57.465 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 pool_op_reply(tid 6 (0) Success v34) 2026-02-17T11:55:57.465 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 10 client.4365.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v34) 2026-02-17T11:55:57.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 10 client.4365.objecter have request 6 at 0x7fcd98003060 Op: delete unmanaged snap 2026-02-17T11:55:57.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 20 client.4365.objecter waiting for client to reach epoch 34 before calling back 2026-02-17T11:55:57.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 10 client.4365.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:57.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 10 monclient: _renew_subs 2026-02-17T11:55:57.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:57.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=34}) -- 0x7fcd9c07f890 con 0x562805961920 2026-02-17T11:55:57.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.463+0000 7fcda37fe640 10 client.4365.objecter done 2026-02-17T11:55:57.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcda37fe640 1 -- 10.20.193.10:0/1664263343 <== mon.0 v2:10.20.193.10:3300/0 12 ==== osd_map(34..34 src has 1..34) ==== 654+0+0 (secure 0 0 0) 0x7fcdb0068f60 con 0x562805961920 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcda37fe640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 osd_map(34..34 src has 1..34) 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcda37fe640 3 client.4365.objecter handle_osd_map got epochs [34,34] > 33 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcda37fe640 3 client.4365.objecter handle_osd_map decoding incremental epoch 34 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcda37fe640 20 client.4365.objecter dump_active .. 0 homeless 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 20 librados: queue_aio_write 0x562805a99150 completion 0x7fcd98001d60 write_seq 2 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 10 client.4365.objecter _op_submit op 0x7fcd94006380 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 20 client.4365.objecter _calc_target epoch 34 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 20 client.4365.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 10 client.4365.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [2,12] primary 2 2026-02-17T11:55:57.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 20 client.4365.objecter _get_session s=0x562805a9e0f0 osd=2 3 2026-02-17T11:55:57.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 10 client.4365.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.2 2026-02-17T11:55:57.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 20 client.4365.objecter get_session s=0x562805a9e0f0 osd=2 3 2026-02-17T11:55:57.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 15 client.4365.objecter _session_op_assign 2 7 2026-02-17T11:55:57.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 15 client.4365.objecter _send_op 7 to 2.2 on osd.2 2026-02-17T11:55:57.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 1 -- 10.20.193.10:0/1664263343 --> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x7fcd94006e40 con 0x562805a9e770 2026-02-17T11:55:57.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 20 client.4365.objecter put_session s=0x562805a9e0f0 osd=2 4 2026-02-17T11:55:57.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.466+0000 7fcdb9f83640 5 client.4365.objecter 1 in flight 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 1 -- 10.20.193.10:0/1664263343 <== osd.2 v2:10.20.193.153:6816/4180566480 4 ==== osd_op_reply(7 rbd_info [write 0~19] v34'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdb0060460 con 0x562805a9e770 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 10 client.4365.objecter ms_dispatch2 0x56280585b4b0 osd_op_reply(7 rbd_info [write 0~19] v34'2 uv2 ondisk = 0) 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 10 client.4365.objecter in handle_osd_op_reply 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 7 client.4365.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 10 client.4365.objecter op 0 rval 0 len 0 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 15 client.4365.objecter handle_osd_op_reply completed tid 7 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 15 client.4365.objecter _finish_op 7 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 20 client.4365.objecter put_session s=0x562805a9e0f0 osd=2 4 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 15 client.4365.objecter _session_op_remove 2 7 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 5 client.4365.objecter 0 in flight 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbb786640 20 librados: complete_aio_write 0x7fcd98001d60 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 10 librados: watch_flush enter 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 10 librados: watch_flush exit 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 10 client.4365.objecter close_session for osd.2 2026-02-17T11:55:57.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x562805a9e770 msgr2=0x562805aa0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x562805a9e770 0x562805aa0c00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 20 client.4365.objecter put_session s=0x562805a9e0f0 osd=2 1 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 10 client.4365.objecter close_session for osd.11 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x5628059a1ff0 msgr2=0x562805a443e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x5628059a1ff0 0x562805a443e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 20 client.4365.objecter put_session s=0x5628057e0230 osd=11 1 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 20 client.4365.objecter shutdown clearing up homeless session... 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 10 client.4365.objecter successfully canceled tick 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd9c076e80 msgr2=0x7fcd9c079340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd9c076e80 0x7fcd9c079340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcda4001960 tx=0x7fcda40018f0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 10 monclient: shutdown 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805961920 msgr2=0x562805a40c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805961920 0x562805a40c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000bf20 tx=0x7fcdb0009530 comp rx=0 tx=0).stop 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbca0f640 1 -- 10.20.193.10:0/1664263343 reap_dead start 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 shutdown_connections 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 --2- 10.20.193.10:0/1664263343 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x562805961920 0x562805a40c40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.574+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 >> 10.20.193.10:0/1664263343 conn(0x5628059a3d00 msgr2=0x562805a25120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.575+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 shutdown_connections 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.575+0000 7fcdbccc00c0 1 -- 10.20.193.10:0/1664263343 wait complete. 2026-02-17T11:55:57.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.575+0000 7fcdbccc00c0 1 librados: shutdown 2026-02-17T11:55:57.581 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T11:55:57.581 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T11:55:57.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T11:55:57.582 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T11:55:57.582 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T11:55:57.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.686+0000 7ff29ea32640 10 monclient: get_monmap_and_config 2026-02-17T11:55:57.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.686+0000 7ff29ea32640 10 monclient: build_initial_monmap 2026-02-17T11:55:57.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.686+0000 7ff29ea32640 10 monclient: monmap: 2026-02-17T11:55:57.688 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:57.688197+0000 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:57.688197+0000 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:57.689 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 1 Processor -- start 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 1 -- start start 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 10 monclient: init 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 10 monclient: _add_conns ranks=[2,1,3,4,0,5] 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff29815d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff2980c92f0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff298153d60 0x7ff29815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 10 monclient(hunting): picked mon.noname-a con 0x7ff298153d60 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2980c58a0 con 0x7ff2980c92f0 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2980c55c0 con 0x7ff29815d220 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7ff2980c7e20 con 0x7ff298153d60 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.687+0000 7ff29ea32640 10 monclient(hunting): authenticate will time out at 1027.409908s 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff29cfa8640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff298153d60 0x7ff29815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff2977fe640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7ff2980c92f0 0x7ff298153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:57924/0 (socket says 10.20.193.10:57924) 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff2977fe640 1 -- 10.20.193.10:0/965908120 learned_addr learned my addr 10.20.193.10:0/965908120 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff297fff640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7ff29815d220 0x7ff2980c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55174/0 (socket says 10.20.193.10:55174) 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff29cfa8640 10 monclient(hunting): get_auth_request con 0x7ff298153d60 auth_method 0 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff29cfa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff29cfa8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff29cfa8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.688+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373195248 0 0) 0x7ff2980c58a0 con 0x7ff2980c92f0 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 10 monclient(hunting): my global_id is 4414 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff27c003620 con 0x7ff2980c92f0 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486215430 0 0) 0x7ff2980c55c0 con 0x7ff29815d220 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 10 monclient(hunting): my global_id is 4400 2026-02-17T11:55:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.689+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2980c58a0 con 0x7ff29815d220 2026-02-17T11:55:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3750847836 0 0) 0x7ff27c003620 con 0x7ff2980c92f0 2026-02-17T11:55:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 >> v2:10.20.193.10:3300/0 conn(0x7ff298153d60 msgr2=0x7ff29815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 --2- 10.20.193.10:0/965908120 >> v2:10.20.193.10:3300/0 conn(0x7ff298153d60 0x7ff29815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 >> v1:10.20.193.153:6789/0 conn(0x7ff29815d220 legacy=0x7ff2980c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:55:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2980c8100 con 0x7ff2980c92f0 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7ff288002f00 con 0x7ff2980c92f0 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient: dump: 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 >> v1:10.20.193.71:6789/0 conn(0x7ff2980c92f0 legacy=0x7ff298153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 --2- 10.20.193.10:0/965908120 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff27c003dd0 0x7ff27c0041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient(hunting): picked mon.a con 0x7ff27c003dd0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 --2- 10.20.193.10:0/965908120 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff27c004900 0x7ff27c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient(hunting): picked mon.c con 0x7ff27c004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 --2- 10.20.193.10:0/965908120 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff27c005490 0x7ff27c00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient(hunting): picked mon.b con 0x7ff27c005490 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff2980c7e20 con 0x7ff27c003dd0 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c00c380 con 0x7ff27c005490 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c00c580 con 0x7ff27c004900 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.691+0000 7ff296ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.692+0000 7ff29cfa8640 1 --2- 10.20.193.10:0/965908120 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff27c005490 0x7ff27c00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.693+0000 7ff29cfa8640 10 monclient(hunting): get_auth_request con 0x7ff27c005490 auth_method 0 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.693+0000 7ff29cfa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.693+0000 7ff29cfa8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.693+0000 7ff29cfa8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.693+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.693+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.693+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_done global_id 4414 payload 293 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 1 -- 10.20.193.10:0/965908120 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff27c004900 msgr2=0x7ff27c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 1 --2- 10.20.193.10:0/965908120 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff27c004900 0x7ff27c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 1 -- 10.20.193.10:0/965908120 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff27c003dd0 msgr2=0x7ff27c0041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 1 --2- 10.20.193.10:0/965908120 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff27c003dd0 0x7ff27c0041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 10 monclient: _finish_hunting 0 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 1 monclient: found mon.b 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:57.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 1 -- 10.20.193.10:0/965908120 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c003620 con 0x7ff27c005490 2026-02-17T11:55:57.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 10 monclient: _finish_auth 0 2026-02-17T11:55:57.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 10 monclient: _check_auth_tickets 2026-02-17T11:55:57.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:57.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29ea32640 5 monclient: authenticate success, global_id 4414 2026-02-17T11:55:57.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29ea32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:57.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.694+0000 7ff29cfa8640 1 -- 10.20.193.10:0/965908120 reap_dead start 2026-02-17T11:55:57.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.695+0000 7ff29cfa8640 1 --2- 10.20.193.10:0/965908120 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff27c005490 0x7ff27c00bac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009fc0 tx=0x7ff28c02f5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7a3c2fbe22b62f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:57.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c009c10 con 0x7ff27c005490 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 10 monclient: dump: 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28c003cd0 con 0x7ff27c005490 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff29ea32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 1 -- 10.20.193.10:0/965908120 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c004260 con 0x7ff27c005490 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff296ffd640 10 monclient: dump: 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:57.699 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff29ea32640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.696+0000 7ff29ea32640 4 set_mon_vals no callback set 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 10 monclient: shutdown 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 1 -- 10.20.193.10:0/965908120 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff27c005490 msgr2=0x7ff27c00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 1 --2- 10.20.193.10:0/965908120 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff27c005490 0x7ff27c00bac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009fc0 tx=0x7ff28c02f5b0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 1 -- 10.20.193.10:0/965908120 shutdown_connections 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 1 --2- 10.20.193.10:0/965908120 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff27c005490 0x7ff27c00bac0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 1 -- 10.20.193.10:0/965908120 >> 10.20.193.10:0/965908120 conn(0x7ff2980c9d80 msgr2=0x7ff2980ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 1 -- 10.20.193.10:0/965908120 shutdown_connections 2026-02-17T11:55:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 1 -- 10.20.193.10:0/965908120 wait complete. 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 10 monclient: build_initial_monmap 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 10 monclient: monmap: 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:57.702 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 1 librados: starting msgr at 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.697+0000 7ff29ea32640 1 librados: starting objecter 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 Processor -- start 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 -- start start 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 librados: setting wanted keys 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 librados: calling monclient init 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient: init 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff27c005490 0x7ff298145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient(hunting): picked mon.noname-a con 0x7ff27c005490 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff2981f3690 0x7ff2981f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient(hunting): picked mon.noname-b con 0x7ff2981f3690 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff2981e8100 0x7ff2981e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient(hunting): picked mon.noname-c con 0x7ff2981e8100 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff29815d600 con 0x7ff27c005490 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff2980c86c0 con 0x7ff2981f3690 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff29815d780 con 0x7ff2981e8100 2026-02-17T11:55:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29ea32640 10 monclient(hunting): authenticate will time out at 1027.420492s 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff2977fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff2981f3690 0x7ff2981f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff29cfa8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff2981e8100 0x7ff2981e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff2977fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff2981f3690 0x7ff2981f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:46808/0 (socket says 10.20.193.10:46808) 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff2977fe640 1 -- 10.20.193.10:0/2054246045 learned_addr learned my addr 10.20.193.10:0/2054246045 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff2977fe640 10 monclient(hunting): get_auth_request con 0x7ff2981f3690 auth_method 0 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff2977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff2977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.698+0000 7ff2977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff29cfa8640 10 monclient(hunting): get_auth_request con 0x7ff2981e8100 auth_method 0 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff29cfa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff29cfa8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff29cfa8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff297fff640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff27c005490 0x7ff298145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff297fff640 10 monclient(hunting): get_auth_request con 0x7ff27c005490 auth_method 0 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff297fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff297fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff2977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff2977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff2977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff29cfa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff297fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff297fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.699+0000 7ff297fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 10 monclient(hunting): handle_auth_done global_id 4417 payload 824 2026-02-17T11:55:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 1 -- 10.20.193.10:0/2054246045 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff2981e8100 msgr2=0x7ff2981e85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff2981e8100 0x7ff2981e85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 1 -- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff27c005490 msgr2=0x7ff298145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff27c005490 0x7ff298145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 1 monclient: found mon.noname-b 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.700+0000 7ff2977fe640 1 -- 10.20.193.10:0/2054246045 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2981f31e0 con 0x7ff2981f3690 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.701+0000 7ff2977fe640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff2981f3690 0x7ff2981f3b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c730 tx=0x7ff28800cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.701+0000 7ff294ff9640 10 client.?.objecter ms_handle_connect 0x7ff2981f3690 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.701+0000 7ff294ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 1 -- 10.20.193.10:0/2054246045 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28800ce60 con 0x7ff2981f3690 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 10 monclient: dump: 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.709 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 10 monclient: _finish_auth 0 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 1 -- 10.20.193.10:0/2054246045 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288004cf0 con 0x7ff2981f3690 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 5 monclient: authenticate success, global_id 4417 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 10 monclient: _renew_subs 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2981f4050 con 0x7ff2981f3690 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 1 -- 10.20.193.10:0/2054246045 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288007310 con 0x7ff2981f3690 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:57.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff294ff9640 10 monclient: dump: 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff2967fc640 4 set_mon_vals no callback set 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 10 client.4417.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 10 monclient: _renew_subs 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2981f5520 con 0x7ff2981f3690 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 1 librados: init done 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:57.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:57.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.703+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff298069900 con 0x7ff2981f3690 2026-02-17T11:55:57.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.715+0000 7ff294ff9640 1 -- 10.20.193.10:0/2054246045 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7ff2880074b0 con 0x7ff2981f3690 2026-02-17T11:55:57.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.715+0000 7ff294ff9640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff268078e50 0x7ff26807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:57.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.715+0000 7ff297fff640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff268078e50 0x7ff26807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:57.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.715+0000 7ff297fff640 10 monclient: get_auth_request con 0x7ff268078e50 auth_method 0 2026-02-17T11:55:57.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.716+0000 7ff297fff640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff268078e50 0x7ff26807b310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff284002410 tx=0x7ff284009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:57.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.716+0000 7ff294ff9640 10 client.4417.objecter ms_handle_connect 0x7ff268078e50 2026-02-17T11:55:57.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.716+0000 7ff294ff9640 1 -- 10.20.193.10:0/2054246045 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7ff28805df90 con 0x7ff2981f3690 2026-02-17T11:55:57.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.716+0000 7ff294ff9640 10 client.4417.objecter ms_dispatch2 0x7ff298000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:57.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.716+0000 7ff294ff9640 3 client.4417.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:57.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.716+0000 7ff294ff9640 3 client.4417.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:57.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.716+0000 7ff294ff9640 20 client.4417.objecter dump_active .. 0 homeless 2026-02-17T11:55:57.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.822+0000 7ff294ff9640 1 -- 10.20.193.10:0/2054246045 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff298069900 con 0x7ff2981f3690 2026-02-17T11:55:57.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.822+0000 7ff294ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:57.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.822+0000 7ff294ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:57.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.925+0000 7ff29ea32640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-17T11:55:57.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.925+0000 7ff29ea32640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T11:55:57.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.925+0000 7ff29ea32640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:57.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.925+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff2981573e0 con 0x7ff2981f3690 2026-02-17T11:55:57.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.990+0000 7ff294ff9640 1 -- 10.20.193.10:0/2054246045 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+191889 (secure 0 0 0) 0x7ff2981f4050 con 0x7ff2981f3690 2026-02-17T11:55:57.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.990+0000 7ff294ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T11:55:57.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.990+0000 7ff294ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:57.995 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:55:57.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 10 librados: watch_flush enter 2026-02-17T11:55:57.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 10 librados: watch_flush exit 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 20 client.4417.objecter shutdown clearing up homeless session... 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 10 client.4417.objecter successfully canceled tick 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff268078e50 msgr2=0x7ff26807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff268078e50 0x7ff26807b310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff284002410 tx=0x7ff284009040 comp rx=0 tx=0).stop 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 10 monclient: shutdown 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff2981f3690 msgr2=0x7ff2981f3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff2981f3690 0x7ff2981f3b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c730 tx=0x7ff28800cc00 comp rx=0 tx=0).stop 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 shutdown_connections 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff268078e50 0x7ff26807b310 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff2981e8100 0x7ff2981e85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:57.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff2981f3690 0x7ff2981f3b10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 --2- 10.20.193.10:0/2054246045 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff27c005490 0x7ff298145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 >> 10.20.193.10:0/2054246045 conn(0x7ff2980c9d80 msgr2=0x7ff29814e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 shutdown_connections 2026-02-17T11:55:58.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 -- 10.20.193.10:0/2054246045 wait complete. 2026-02-17T11:55:58.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:57.991+0000 7ff29ea32640 1 librados: shutdown 2026-02-17T11:55:58.001 INFO:teuthology.orchestra.run.trial010.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6800","nonce":3440664462},{"type":"v1","addr":"10.20.193.10:6801","nonce":3440664462}]},"active_addr":"10.20.193.10:6801/3440664462","active_change":"2026-02-17T11:54:03.660231+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.10:0","nonce":3385552908}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.10:0","nonce":2943382272}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.10:0","nonce":3858881244}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.10:0","nonce":4273814196}]}]} 2026-02-17T11:55:58.005 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T11:55:58.005 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T11:55:58.005 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:55:58.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.110+0000 7f85abc76640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.110+0000 7f85abc76640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.110+0000 7f85abc76640 10 monclient: monmap: 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.111526+0000 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.111526+0000 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.113 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.114 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.114 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.114 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.114 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.114 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.110+0000 7f85abc76640 1 Processor -- start 2026-02-17T11:55:58.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.110+0000 7f85abc76640 1 -- start start 2026-02-17T11:55:58.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.110+0000 7f85abc76640 10 monclient: init 2026-02-17T11:55:58.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 10 monclient: _add_conns ranks=[3,1,4,2,5,0] 2026-02-17T11:55:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f85a415d220 0x7f85a415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 10 monclient(hunting): picked mon.noname-a con 0x7f85a415d220 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f85a4074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f85a40c92f0 0x7f85a4153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 10 monclient(hunting): picked mon.noname-b con 0x7f85a40c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a40c58a0 con 0x7f85a4074920 2026-02-17T11:55:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f85a40c55c0 con 0x7f85a415d220 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f85a40c7e20 con 0x7f85a40c92f0 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85abc76640 10 monclient(hunting): authenticate will time out at 1027.833300s 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.111+0000 7f85a99eb640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f85a415d220 0x7f85a415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85aa1ec640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f85a40c92f0 0x7f85a4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a99eb640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f85a415d220 0x7f85a415d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38034/0 (socket says 10.20.193.10:38034) 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a99eb640 1 -- 10.20.193.10:0/1642575740 learned_addr learned my addr 10.20.193.10:0/1642575740 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a99eb640 10 monclient(hunting): get_auth_request con 0x7f85a415d220 auth_method 0 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a99eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a99eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a99eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a91ea640 1 --1- 10.20.193.10:0/1642575740 >> v1:10.20.193.71:6789/0 conn(0x7f85a4074920 0x7f85a40c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:57932/0 (socket says 10.20.193.10:57932) 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85aa1ec640 10 monclient(hunting): get_auth_request con 0x7f85a40c92f0 auth_method 0 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85aa1ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85aa1ec640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85aa1ec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a99eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a99eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85a99eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85aa1ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85aa1ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.112+0000 7f85aa1ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.113+0000 7f85a99eb640 10 monclient(hunting): handle_auth_done global_id 4374 payload 274 2026-02-17T11:55:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.113+0000 7f85a99eb640 1 -- 10.20.193.10:0/1642575740 >> v2:10.20.193.71:3300/0 conn(0x7f85a40c92f0 msgr2=0x7f85a4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.113+0000 7f85a99eb640 1 --2- 10.20.193.10:0/1642575740 >> v2:10.20.193.71:3300/0 conn(0x7f85a40c92f0 0x7f85a4153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.113+0000 7f85a99eb640 1 -- 10.20.193.10:0/1642575740 >> v1:10.20.193.71:6789/0 conn(0x7f85a4074920 legacy=0x7f85a40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.113+0000 7f85a99eb640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.113+0000 7f85a99eb640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.113+0000 7f85a99eb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.113+0000 7f85a99eb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.113+0000 7f85a99eb640 1 -- 10.20.193.10:0/1642575740 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a40c8100 con 0x7f85a415d220 2026-02-17T11:55:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.114+0000 7f85a99eb640 1 --2- 10.20.193.10:0/1642575740 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a415d220 0x7f85a415d600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8594009970 tx=0x7f859402eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145a7c942fe856f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 1 -- 10.20.193.10:0/1642575740 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859403c070 con 0x7f85a415d220 2026-02-17T11:55:58.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 10 monclient: dump: 2026-02-17T11:55:58.126 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.126 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 1 -- 10.20.193.10:0/1642575740 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859402fbc0 con 0x7f85a415d220 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 5 monclient: authenticate success, global_id 4374 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 1 -- 10.20.193.10:0/1642575740 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594037440 con 0x7f85a415d220 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 4 set_mon_vals no callback set 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85a89e9640 10 monclient: dump: 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.128 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 10 monclient: shutdown 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 1 -- 10.20.193.10:0/1642575740 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a415d220 msgr2=0x7f85a415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 1 --2- 10.20.193.10:0/1642575740 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a415d220 0x7f85a415d600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8594009970 tx=0x7f859402eef0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 1 -- 10.20.193.10:0/1642575740 shutdown_connections 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 1 --2- 10.20.193.10:0/1642575740 >> v2:10.20.193.71:3300/0 conn(0x7f85a40c92f0 0x7f85a4153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 1 --2- 10.20.193.10:0/1642575740 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a415d220 0x7f85a415d600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 1 -- 10.20.193.10:0/1642575740 >> 10.20.193.10:0/1642575740 conn(0x7f85a40c9d80 msgr2=0x7f85a40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 1 -- 10.20.193.10:0/1642575740 shutdown_connections 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.116+0000 7f85abc76640 1 -- 10.20.193.10:0/1642575740 wait complete. 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient: monmap: 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.130 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 librados: starting msgr at 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 librados: starting objecter 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 Processor -- start 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 -- start start 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 librados: setting wanted keys 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 librados: calling monclient init 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient: init 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:58.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a4074920 0x7f85a4147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient(hunting): picked mon.noname-a con 0x7f85a4074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f85a40c92f0 0x7f85a40cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient(hunting): picked mon.noname-c con 0x7f85a40c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f85a415d220 0x7f85a40cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient(hunting): picked mon.noname-b con 0x7f85a415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4074d70 con 0x7f85a4074920 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85a40c86c0 con 0x7f85a415d220 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4153b90 con 0x7f85a40c92f0 2026-02-17T11:55:58.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.117+0000 7f85abc76640 10 monclient(hunting): authenticate will time out at 1027.839894s 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a4074920 0x7f85a4147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a4074920 0x7f85a4147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38044/0 (socket says 10.20.193.10:38044) 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 1 -- 10.20.193.10:0/1591788938 learned_addr learned my addr 10.20.193.10:0/1591788938 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 10 monclient(hunting): get_auth_request con 0x7f85a4074920 auth_method 0 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85aa1ec640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f85a415d220 0x7f85a40cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a91ea640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f85a40c92f0 0x7f85a40cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85aa1ec640 10 monclient(hunting): get_auth_request con 0x7f85a415d220 auth_method 0 2026-02-17T11:55:58.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85aa1ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85aa1ec640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85aa1ec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a91ea640 10 monclient(hunting): get_auth_request con 0x7f85a40c92f0 auth_method 0 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a91ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a91ea640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a91ea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a99eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a91ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a91ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85a91ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85aa1ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85aa1ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.118+0000 7f85aa1ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 10 monclient(hunting): handle_auth_done global_id 4377 payload 824 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 1 -- 10.20.193.10:0/1591788938 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f85a40c92f0 msgr2=0x7f85a40cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f85a40c92f0 0x7f85a40cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 1 -- 10.20.193.10:0/1591788938 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f85a415d220 msgr2=0x7f85a40cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f85a415d220 0x7f85a40cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.120+0000 7f85a99eb640 1 -- 10.20.193.10:0/1591788938 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a41f36e0 con 0x7f85a4074920 2026-02-17T11:55:58.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.121+0000 7f85a99eb640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a4074920 0x7f85a4147e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f859402f4a0 tx=0x7f85940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.121+0000 7f85927fc640 10 client.?.objecter ms_handle_connect 0x7f85a4074920 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.121+0000 7f85927fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 1 -- 10.20.193.10:0/1591788938 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859403c040 con 0x7f85a4074920 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 10 monclient: dump: 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.136 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 1 -- 10.20.193.10:0/1591788938 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8594042410 con 0x7f85a4074920 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85abc76640 5 monclient: authenticate success, global_id 4377 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85abc76640 10 monclient: _renew_subs 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85abc76640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a41f39c0 con 0x7f85a4074920 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 1 -- 10.20.193.10:0/1591788938 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940427e0 con 0x7f85a4074920 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85927fc640 10 monclient: dump: 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.138 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f8593fff640 4 set_mon_vals no callback set 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85abc76640 10 client.4377.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85abc76640 10 monclient: _renew_subs 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85abc76640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a41f3f80 con 0x7f85a4074920 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.122+0000 7f85abc76640 1 librados: init done 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.123+0000 7f85abc76640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.123+0000 7f85abc76640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.123+0000 7f85abc76640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.123+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a4153f70 con 0x7f85a4074920 2026-02-17T11:55:58.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.226+0000 7f85927fc640 1 -- 10.20.193.10:0/1591788938 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f8594042980 con 0x7f85a4074920 2026-02-17T11:55:58.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.227+0000 7f85927fc640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8574078e50 0x7f857407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.227+0000 7f85a91ea640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8574078e50 0x7f857407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.227+0000 7f85a91ea640 10 monclient: get_auth_request con 0x7f8574078e50 auth_method 0 2026-02-17T11:55:58.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.227+0000 7f85927fc640 10 client.4377.objecter ms_handle_connect 0x7f8574078e50 2026-02-17T11:55:58.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.227+0000 7f85a91ea640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8574078e50 0x7f857407b310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85a40cd260 tx=0x7f8598007f40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.234+0000 7f85927fc640 1 -- 10.20.193.10:0/1591788938 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f8594083650 con 0x7f85a4074920 2026-02-17T11:55:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.234+0000 7f85927fc640 10 client.4377.objecter ms_dispatch2 0x7f85a4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.234+0000 7f85927fc640 3 client.4377.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.234+0000 7f85927fc640 3 client.4377.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.234+0000 7f85927fc640 20 client.4377.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.234+0000 7f85927fc640 1 -- 10.20.193.10:0/1591788938 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8594087610 con 0x7f85a4074920 2026-02-17T11:55:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.234+0000 7f85927fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.234+0000 7f85927fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:58.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.316+0000 7f85abc76640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:58.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.316+0000 7f85abc76640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:58.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.316+0000 7f85abc76640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.316+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85a40c9b60 con 0x7f85a4074920 2026-02-17T11:55:58.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.366+0000 7f85927fc640 1 -- 10.20.193.10:0/1591788938 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+24652 (secure 0 0 0) 0x7f859408b910 con 0x7f85a4074920 2026-02-17T11:55:58.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.366+0000 7f85927fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:58.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.366+0000 7f85927fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:58.369 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:55:58.369 INFO:teuthology.orchestra.run.trial010.stdout:{"epoch":34,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:55:57.384412+0000","last_up_change":"2026-02-17T11:55:49.992320+0000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:55:41.943431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:55:53.205060+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6826","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6827","nonce":311345990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6828","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6829","nonce":311345990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6832","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6833","nonce":311345990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6830","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6831","nonce":311345990}]},"public_addr":"10.20.193.10:6827/311345990","cluster_addr":"10.20.193.10:6829/311345990","heartbeat_back_addr":"10.20.193.10:6833/311345990","heartbeat_front_addr":"10.20.193.10:6831/311345990","state":["exists","up"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6808","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6809","nonce":168831009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6810","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6811","nonce":168831009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6814","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6815","nonce":168831009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6812","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6813","nonce":168831009}]},"public_addr":"10.20.193.71:6809/168831009","cluster_addr":"10.20.193.71:6811/168831009","heartbeat_back_addr":"10.20.193.71:6815/168831009","heartbeat_front_addr":"10.20.193.71:6813/168831009","state":["exists","up"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6817","nonce":4180566480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6819","nonce":4180566480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6823","nonce":4180566480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6821","nonce":4180566480}]},"public_addr":"10.20.193.153:6817/4180566480","cluster_addr":"10.20.193.153:6819/4180566480","heartbeat_back_addr":"10.20.193.153:6823/4180566480","heartbeat_front_addr":"10.20.193.153:6821/4180566480","state":["exists","up"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6816","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6817","nonce":2117394394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6818","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6819","nonce":2117394394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6822","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6823","nonce":2117394394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6820","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6821","nonce":2117394394}]},"public_addr":"10.20.193.174:6817/2117394394","cluster_addr":"10.20.193.174:6819/2117394394","heartbeat_back_addr":"10.20.193.174:6823/2117394394","heartbeat_front_addr":"10.20.193.174:6821/2117394394","state":["exists","up"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6810","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6811","nonce":4049638616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6812","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6813","nonce":4049638616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6816","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6817","nonce":4049638616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6814","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6815","nonce":4049638616}]},"public_addr":"10.20.193.10:6811/4049638616","cluster_addr":"10.20.193.10:6813/4049638616","heartbeat_back_addr":"10.20.193.10:6817/4049638616","heartbeat_front_addr":"10.20.193.10:6815/4049638616","state":["exists","up"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6816","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6817","nonce":1474787626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6818","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6819","nonce":1474787626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6822","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6823","nonce":1474787626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6820","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6821","nonce":1474787626}]},"public_addr":"10.20.193.71:6817/1474787626","cluster_addr":"10.20.193.71:6819/1474787626","heartbeat_back_addr":"10.20.193.71:6823/1474787626","heartbeat_front_addr":"10.20.193.71:6821/1474787626","state":["exists","up"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6824","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6825","nonce":3203696878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6826","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6827","nonce":3203696878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6830","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6831","nonce":3203696878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6828","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6829","nonce":3203696878}]},"public_addr":"10.20.193.153:6825/3203696878","cluster_addr":"10.20.193.153:6827/3203696878","heartbeat_back_addr":"10.20.193.153:6831/3203696878","heartbeat_front_addr":"10.20.193.153:6829/3203696878","state":["exists","up"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6808","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6809","nonce":561251262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6810","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6811","nonce":561251262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6814","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6815","nonce":561251262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6812","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6813","nonce":561251262}]},"public_addr":"10.20.193.174:6809/561251262","cluster_addr":"10.20.193.174:6811/561251262","heartbeat_back_addr":"10.20.193.174:6815/561251262","heartbeat_front_addr":"10.20.193.174:6813/561251262","state":["exists","up"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6818","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6819","nonce":1997295941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6820","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6821","nonce":1997295941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6824","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6825","nonce":1997295941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6822","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6823","nonce":1997295941}]},"public_addr":"10.20.193.10:6819/1997295941","cluster_addr":"10.20.193.10:6821/1997295941","heartbeat_back_addr":"10.20.193.10:6825/1997295941","heartbeat_front_addr":"10.20.193.10:6823/1997295941","state":["exists","up"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6800","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6801","nonce":1369683666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6802","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6803","nonce":1369683666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6806","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6807","nonce":1369683666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6804","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6805","nonce":1369683666}]},"public_addr":"10.20.193.71:6801/1369683666","cluster_addr":"10.20.193.71:6803/1369683666","heartbeat_back_addr":"10.20.193.71:6807/1369683666","heartbeat_front_addr":"10.20.193.71:6805/1369683666","state":["exists","up"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6800","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6801","nonce":22479275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6802","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6803","nonce":22479275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6806","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6807","nonce":22479275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6804","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6805","nonce":22479275}]},"public_addr":"10.20.193.153:6801/22479275","cluster_addr":"10.20.193.153:6803/22479275","heartbeat_back_addr":"10.20.193.153:6807/22479275","heartbeat_front_addr":"10.20.193.153:6805/22479275","state":["exists","up"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6800","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6801","nonce":4034633078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6802","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6803","nonce":4034633078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6806","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6807","nonce":4034633078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6804","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6805","nonce":4034633078}]},"public_addr":"10.20.193.174:6801/4034633078","cluster_addr":"10.20.193.174:6803/4034633078","heartbeat_back_addr":"10.20.193.174:6807/4034633078","heartbeat_front_addr":"10.20.193.174:6805/4034633078","state":["exists","up"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6802","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6803","nonce":2920105256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6804","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6805","nonce":2920105256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6808","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6809","nonce":2920105256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6806","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6807","nonce":2920105256}]},"public_addr":"10.20.193.10:6803/2920105256","cluster_addr":"10.20.193.10:6805/2920105256","heartbeat_back_addr":"10.20.193.10:6809/2920105256","heartbeat_front_addr":"10.20.193.10:6807/2920105256","state":["exists","up"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6824","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6825","nonce":1119039635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6826","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6827","nonce":1119039635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6830","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6831","nonce":1119039635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6828","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6829","nonce":1119039635}]},"public_addr":"10.20.193.71:6825/1119039635","cluster_addr":"10.20.193.71:6827/1119039635","heartbeat_back_addr":"10.20.193.71:6831/1119039635","heartbeat_front_addr":"10.20.193.71:6829/1119039635","state":["exists","up"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6808","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6809","nonce":3794015163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6810","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6811","nonce":3794015163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6814","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6815","nonce":3794015163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6812","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6813","nonce":3794015163}]},"public_addr":"10.20.193.153:6809/3794015163","cluster_addr":"10.20.193.153:6811/3794015163","heartbeat_back_addr":"10.20.193.153:6815/3794015163","heartbeat_front_addr":"10.20.193.153:6813/3794015163","state":["exists","up"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6824","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6825","nonce":3564494722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6826","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6827","nonce":3564494722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6830","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6831","nonce":3564494722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6828","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6829","nonce":3564494722}]},"public_addr":"10.20.193.174:6825/3564494722","cluster_addr":"10.20.193.174:6827/3564494722","heartbeat_back_addr":"10.20.193.174:6831/3564494722","heartbeat_front_addr":"10.20.193.174:6829/3564494722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.360736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.381048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.960607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:42.224431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.663427+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.986296+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.607032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.107139+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:38.853441+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.425353+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.674962+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.372465+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.295380+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.299793+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.045566+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:42.253940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:55:58.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 10 librados: watch_flush enter 2026-02-17T11:55:58.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 10 librados: watch_flush exit 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 20 client.4377.objecter shutdown clearing up homeless session... 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 10 client.4377.objecter successfully canceled tick 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8574078e50 msgr2=0x7f857407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8574078e50 0x7f857407b310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85a40cd260 tx=0x7f8598007f40 comp rx=0 tx=0).stop 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 10 monclient: shutdown 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a4074920 msgr2=0x7f85a4147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a4074920 0x7f85a4147e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f859402f4a0 tx=0x7f85940047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 shutdown_connections 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8574078e50 0x7f857407b310 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f85a415d220 0x7f85a40cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f85a40c92f0 0x7f85a40cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 --2- 10.20.193.10:0/1591788938 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f85a4074920 0x7f85a4147e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 >> 10.20.193.10:0/1591788938 conn(0x7f85a40c9d80 msgr2=0x7f85a4148aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 shutdown_connections 2026-02-17T11:55:58.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 -- 10.20.193.10:0/1591788938 wait complete. 2026-02-17T11:55:58.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.368+0000 7f85abc76640 1 librados: shutdown 2026-02-17T11:55:58.379 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T11:55:58.379 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.445+0000 7f5fb8aca640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.445+0000 7f5fb8aca640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.445+0000 7f5fb8aca640 10 monclient: monmap: 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.446809+0000 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.446809+0000 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.447 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.448 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.448 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.448 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.448 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.448 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 1 Processor -- start 2026-02-17T11:55:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 1 -- start start 2026-02-17T11:55:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient: init 2026-02-17T11:55:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient: _add_conns ranks=[2,4,3,1,5,0] 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5fb41502f0 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5fb41506d0 0x7f5fb40c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient(hunting): picked mon.noname-b con 0x7f5fb41506d0 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f5fb40c8eb0 0x7f5fb415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient(hunting): picked mon.noname-a con 0x7f5fb40c8eb0 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb40c5380 con 0x7f5fb41502f0 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f5fb4074e80 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5fb40c5660 con 0x7f5fb41506d0 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.446+0000 7f5fb8aca640 10 monclient(hunting): authenticate will time out at 1028.168870s 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb2575640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f5fb41502f0 0x7f5fb4074770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55186/0 (socket says 10.20.193.10:55186) 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb2575640 1 -- 10.20.193.10:0/1312533006 learned_addr learned my addr 10.20.193.10:0/1312533006 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb1d74640 1 --2- 10.20.193.10:0/1312533006 >> v2:10.20.193.71:3300/0 conn(0x7f5fb41506d0 0x7f5fb40c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb1d74640 10 monclient(hunting): get_auth_request con 0x7f5fb41506d0 auth_method 0 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.447+0000 7f5fb1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.449+0000 7f5fb1d74640 10 monclient(hunting): handle_auth_done global_id 4429 payload 274 2026-02-17T11:55:58.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.449+0000 7f5fb1d74640 1 -- 10.20.193.10:0/1312533006 >> v2:10.20.193.10:3300/0 conn(0x7f5fb40c8eb0 msgr2=0x7f5fb415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.449+0000 7f5fb1d74640 1 --2- 10.20.193.10:0/1312533006 >> v2:10.20.193.10:3300/0 conn(0x7f5fb40c8eb0 0x7f5fb415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.449+0000 7f5fb1d74640 1 -- 10.20.193.10:0/1312533006 >> v1:10.20.193.153:6789/0 conn(0x7f5fb41502f0 legacy=0x7f5fb4074770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.449+0000 7f5fb1d74640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.449+0000 7f5fb1d74640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.455 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.449+0000 7f5fb1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.449+0000 7f5fb1d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.449+0000 7f5fb1d74640 1 -- 10.20.193.10:0/1312533006 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb40c7e90 con 0x7f5fb41506d0 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.450+0000 7f5fb1d74640 1 --2- 10.20.193.10:0/1312533006 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb41506d0 0x7f5fb40c8970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40709e0 tx=0x7f5f9c02ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44fecdbad4ef34c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 1 -- 10.20.193.10:0/1312533006 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c03c070 con 0x7f5fb41506d0 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 10 monclient: dump: 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.456 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 1 -- 10.20.193.10:0/1312533006 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9c02faf0 con 0x7f5fb41506d0 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 1 -- 10.20.193.10:0/1312533006 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c037440 con 0x7f5fb41506d0 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 5 monclient: authenticate success, global_id 4429 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 4 set_mon_vals no callback set 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb1573640 10 monclient: dump: 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.458 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 10 monclient: shutdown 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1312533006 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb41506d0 msgr2=0x7f5fb40c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 1 --2- 10.20.193.10:0/1312533006 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb41506d0 0x7f5fb40c8970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40709e0 tx=0x7f5f9c02ede0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1312533006 shutdown_connections 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 1 --2- 10.20.193.10:0/1312533006 >> v2:10.20.193.10:3300/0 conn(0x7f5fb40c8eb0 0x7f5fb415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 1 --2- 10.20.193.10:0/1312533006 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb41506d0 0x7f5fb40c8970 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1312533006 >> 10.20.193.10:0/1312533006 conn(0x7f5fb40c9d80 msgr2=0x7f5fb40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1312533006 shutdown_connections 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.452+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1312533006 wait complete. 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient: monmap: 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.460 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 librados: starting msgr at 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 librados: starting objecter 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 Processor -- start 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 -- start start 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 librados: setting wanted keys 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 librados: calling monclient init 2026-02-17T11:55:58.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient: init 2026-02-17T11:55:58.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:58.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb40c8eb0 0x7f5fb41f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient(hunting): picked mon.noname-b con 0x7f5fb40c8eb0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5fb41502f0 0x7f5fb406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient(hunting): picked mon.noname-a con 0x7f5fb41502f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5fb41506d0 0x7f5fb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.466 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient(hunting): picked mon.noname-c con 0x7f5fb41506d0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb40c92d0 con 0x7f5fb41502f0 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb40c8450 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb415d580 con 0x7f5fb41506d0 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.453+0000 7f5fb8aca640 10 monclient(hunting): authenticate will time out at 1028.175839s 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2d76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5fb41506d0 0x7f5fb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb40c8eb0 0x7f5fb41f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb40c8eb0 0x7f5fb41f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:46832/0 (socket says 10.20.193.10:46832) 2026-02-17T11:55:58.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 1 -- 10.20.193.10:0/1338804692 learned_addr learned my addr 10.20.193.10:0/1338804692 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 10 monclient(hunting): get_auth_request con 0x7f5fb40c8eb0 auth_method 0 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2d76640 10 monclient(hunting): get_auth_request con 0x7f5fb41506d0 auth_method 0 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.454+0000 7f5fb2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 10 monclient(hunting): handle_auth_done global_id 4432 payload 824 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 1 -- 10.20.193.10:0/1338804692 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5fb41506d0 msgr2=0x7f5fb406edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5fb41506d0 0x7f5fb406edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 1 -- 10.20.193.10:0/1338804692 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5fb41502f0 msgr2=0x7f5fb406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5fb41502f0 0x7f5fb406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2575640 1 -- 10.20.193.10:0/1338804692 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb415be90 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.455+0000 7f5fb2d76640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5fb41506d0 0x7f5fb406edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:55:58.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.456+0000 7f5fb2575640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb40c8eb0 0x7f5fb41f3dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c700 tx=0x7f5fa800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.456+0000 7f5f9affd640 10 client.?.objecter ms_handle_connect 0x7f5fb40c8eb0 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.456+0000 7f5f9affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 1 -- 10.20.193.10:0/1338804692 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8017070 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 10 monclient: dump: 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.470 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 1 -- 10.20.193.10:0/1338804692 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa8005bb0 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb8aca640 5 monclient: authenticate success, global_id 4432 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb8aca640 10 monclient: _renew_subs 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb8aca640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb415c130 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 1 -- 10.20.193.10:0/1338804692 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8007070 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb0d72640 4 set_mon_vals no callback set 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5f9affd640 10 monclient: dump: 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.472 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb8aca640 10 client.4432.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb8aca640 10 monclient: _renew_subs 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb8aca640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb415c6f0 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.458+0000 7f5fb8aca640 1 librados: init done 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.459+0000 7f5fb8aca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.459+0000 7f5fb8aca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.459+0000 7f5fb8aca640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.459+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb415d960 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.471+0000 7f5f9affd640 1 -- 10.20.193.10:0/1338804692 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5fa8024080 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.472+0000 7f5f9affd640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f80078e30 0x7f5f8007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.472+0000 7f5fb1d74640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f80078e30 0x7f5f8007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.472+0000 7f5fb1d74640 10 monclient: get_auth_request con 0x7f5f80078e30 auth_method 0 2026-02-17T11:55:58.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.472+0000 7f5f9affd640 10 client.4432.objecter ms_handle_connect 0x7f5f80078e30 2026-02-17T11:55:58.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.472+0000 7f5fb1d74640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f80078e30 0x7f5f8007b2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c039000 tx=0x7f5f9c031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.473+0000 7f5f9affd640 1 -- 10.20.193.10:0/1338804692 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f5fa805d560 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.473+0000 7f5f9affd640 10 client.4432.objecter ms_dispatch2 0x7f5fb4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.473+0000 7f5f9affd640 3 client.4432.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.473+0000 7f5f9affd640 3 client.4432.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.473+0000 7f5f9affd640 20 client.4432.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.573+0000 7f5f9affd640 1 -- 10.20.193.10:0/1338804692 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5fa8061520 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.573+0000 7f5f9affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.573+0000 7f5f9affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:58.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.655+0000 7f5fb8aca640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:58.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.655+0000 7f5fb8aca640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:58.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.655+0000 7f5fb8aca640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.655+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fb4157470 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5f9affd640 1 -- 10.20.193.10:0/1338804692 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+24652 (secure 0 0 0) 0x7f5fa8065820 con 0x7f5fb40c8eb0 2026-02-17T11:55:58.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5f9affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:55:58.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5f9affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:58.711 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:55:58.711 INFO:teuthology.orchestra.run.trial010.stdout:{"epoch":34,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:55:57.384412+0000","last_up_change":"2026-02-17T11:55:49.992320+0000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:55:41.943431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:55:53.205060+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6826","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6827","nonce":311345990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6828","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6829","nonce":311345990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6832","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6833","nonce":311345990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6830","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6831","nonce":311345990}]},"public_addr":"10.20.193.10:6827/311345990","cluster_addr":"10.20.193.10:6829/311345990","heartbeat_back_addr":"10.20.193.10:6833/311345990","heartbeat_front_addr":"10.20.193.10:6831/311345990","state":["exists","up"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6808","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6809","nonce":168831009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6810","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6811","nonce":168831009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6814","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6815","nonce":168831009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6812","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6813","nonce":168831009}]},"public_addr":"10.20.193.71:6809/168831009","cluster_addr":"10.20.193.71:6811/168831009","heartbeat_back_addr":"10.20.193.71:6815/168831009","heartbeat_front_addr":"10.20.193.71:6813/168831009","state":["exists","up"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6817","nonce":4180566480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6819","nonce":4180566480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6823","nonce":4180566480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6821","nonce":4180566480}]},"public_addr":"10.20.193.153:6817/4180566480","cluster_addr":"10.20.193.153:6819/4180566480","heartbeat_back_addr":"10.20.193.153:6823/4180566480","heartbeat_front_addr":"10.20.193.153:6821/4180566480","state":["exists","up"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6816","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6817","nonce":2117394394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6818","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6819","nonce":2117394394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6822","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6823","nonce":2117394394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6820","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6821","nonce":2117394394}]},"public_addr":"10.20.193.174:6817/2117394394","cluster_addr":"10.20.193.174:6819/2117394394","heartbeat_back_addr":"10.20.193.174:6823/2117394394","heartbeat_front_addr":"10.20.193.174:6821/2117394394","state":["exists","up"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6810","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6811","nonce":4049638616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6812","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6813","nonce":4049638616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6816","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6817","nonce":4049638616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6814","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6815","nonce":4049638616}]},"public_addr":"10.20.193.10:6811/4049638616","cluster_addr":"10.20.193.10:6813/4049638616","heartbeat_back_addr":"10.20.193.10:6817/4049638616","heartbeat_front_addr":"10.20.193.10:6815/4049638616","state":["exists","up"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6816","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6817","nonce":1474787626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6818","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6819","nonce":1474787626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6822","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6823","nonce":1474787626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6820","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6821","nonce":1474787626}]},"public_addr":"10.20.193.71:6817/1474787626","cluster_addr":"10.20.193.71:6819/1474787626","heartbeat_back_addr":"10.20.193.71:6823/1474787626","heartbeat_front_addr":"10.20.193.71:6821/1474787626","state":["exists","up"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6824","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6825","nonce":3203696878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6826","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6827","nonce":3203696878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6830","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6831","nonce":3203696878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6828","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6829","nonce":3203696878}]},"public_addr":"10.20.193.153:6825/3203696878","cluster_addr":"10.20.193.153:6827/3203696878","heartbeat_back_addr":"10.20.193.153:6831/3203696878","heartbeat_front_addr":"10.20.193.153:6829/3203696878","state":["exists","up"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6808","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6809","nonce":561251262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6810","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6811","nonce":561251262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6814","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6815","nonce":561251262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6812","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6813","nonce":561251262}]},"public_addr":"10.20.193.174:6809/561251262","cluster_addr":"10.20.193.174:6811/561251262","heartbeat_back_addr":"10.20.193.174:6815/561251262","heartbeat_front_addr":"10.20.193.174:6813/561251262","state":["exists","up"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6818","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6819","nonce":1997295941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6820","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6821","nonce":1997295941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6824","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6825","nonce":1997295941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6822","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6823","nonce":1997295941}]},"public_addr":"10.20.193.10:6819/1997295941","cluster_addr":"10.20.193.10:6821/1997295941","heartbeat_back_addr":"10.20.193.10:6825/1997295941","heartbeat_front_addr":"10.20.193.10:6823/1997295941","state":["exists","up"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6800","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6801","nonce":1369683666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6802","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6803","nonce":1369683666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6806","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6807","nonce":1369683666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6804","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6805","nonce":1369683666}]},"public_addr":"10.20.193.71:6801/1369683666","cluster_addr":"10.20.193.71:6803/1369683666","heartbeat_back_addr":"10.20.193.71:6807/1369683666","heartbeat_front_addr":"10.20.193.71:6805/1369683666","state":["exists","up"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6800","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6801","nonce":22479275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6802","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6803","nonce":22479275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6806","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6807","nonce":22479275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6804","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6805","nonce":22479275}]},"public_addr":"10.20.193.153:6801/22479275","cluster_addr":"10.20.193.153:6803/22479275","heartbeat_back_addr":"10.20.193.153:6807/22479275","heartbeat_front_addr":"10.20.193.153:6805/22479275","state":["exists","up"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6800","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6801","nonce":4034633078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6802","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6803","nonce":4034633078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6806","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6807","nonce":4034633078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6804","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6805","nonce":4034633078}]},"public_addr":"10.20.193.174:6801/4034633078","cluster_addr":"10.20.193.174:6803/4034633078","heartbeat_back_addr":"10.20.193.174:6807/4034633078","heartbeat_front_addr":"10.20.193.174:6805/4034633078","state":["exists","up"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6802","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6803","nonce":2920105256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6804","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6805","nonce":2920105256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6808","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6809","nonce":2920105256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6806","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6807","nonce":2920105256}]},"public_addr":"10.20.193.10:6803/2920105256","cluster_addr":"10.20.193.10:6805/2920105256","heartbeat_back_addr":"10.20.193.10:6809/2920105256","heartbeat_front_addr":"10.20.193.10:6807/2920105256","state":["exists","up"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6824","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6825","nonce":1119039635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6826","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6827","nonce":1119039635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6830","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6831","nonce":1119039635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6828","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6829","nonce":1119039635}]},"public_addr":"10.20.193.71:6825/1119039635","cluster_addr":"10.20.193.71:6827/1119039635","heartbeat_back_addr":"10.20.193.71:6831/1119039635","heartbeat_front_addr":"10.20.193.71:6829/1119039635","state":["exists","up"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6808","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6809","nonce":3794015163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6810","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6811","nonce":3794015163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6814","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6815","nonce":3794015163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6812","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6813","nonce":3794015163}]},"public_addr":"10.20.193.153:6809/3794015163","cluster_addr":"10.20.193.153:6811/3794015163","heartbeat_back_addr":"10.20.193.153:6815/3794015163","heartbeat_front_addr":"10.20.193.153:6813/3794015163","state":["exists","up"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6824","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6825","nonce":3564494722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6826","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6827","nonce":3564494722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6830","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6831","nonce":3564494722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6828","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6829","nonce":3564494722}]},"public_addr":"10.20.193.174:6825/3564494722","cluster_addr":"10.20.193.174:6827/3564494722","heartbeat_back_addr":"10.20.193.174:6831/3564494722","heartbeat_front_addr":"10.20.193.174:6829/3564494722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.360736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.381048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.960607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:42.224431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.663427+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.986296+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.607032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.107139+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:38.853441+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.425353+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.674962+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.372465+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.295380+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.299793+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.045566+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:42.253940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:55:58.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 10 librados: watch_flush enter 2026-02-17T11:55:58.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 10 librados: watch_flush exit 2026-02-17T11:55:58.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 20 client.4432.objecter shutdown clearing up homeless session... 2026-02-17T11:55:58.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 10 client.4432.objecter successfully canceled tick 2026-02-17T11:55:58.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f80078e30 msgr2=0x7f5f8007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f80078e30 0x7f5f8007b2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c039000 tx=0x7f5f9c031000 comp rx=0 tx=0).stop 2026-02-17T11:55:58.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 10 monclient: shutdown 2026-02-17T11:55:58.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb40c8eb0 msgr2=0x7f5fb41f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb40c8eb0 0x7f5fb41f3dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c700 tx=0x7f5fa800cbd0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 shutdown_connections 2026-02-17T11:55:58.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f80078e30 0x7f5f8007b2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5fb41506d0 0x7f5fb406edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5fb41502f0 0x7f5fb406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 --2- 10.20.193.10:0/1338804692 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5fb40c8eb0 0x7f5fb41f3dd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 >> 10.20.193.10:0/1338804692 conn(0x7f5fb40c9d80 msgr2=0x7f5fb414f540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 shutdown_connections 2026-02-17T11:55:58.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.709+0000 7f5fb8aca640 1 -- 10.20.193.10:0/1338804692 wait complete. 2026-02-17T11:55:58.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.710+0000 7f5fb8aca640 1 librados: shutdown 2026-02-17T11:55:58.724 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:55:58.725 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:55:58.725 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:55:58.726 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:55:58.727 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-17T11:55:58.727 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-17T11:55:58.728 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-17T11:55:58.728 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-17T11:55:58.729 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-17T11:55:58.730 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-17T11:55:58.730 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-17T11:55:58.731 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-17T11:55:58.732 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-17T11:55:58.732 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-17T11:55:58.733 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-17T11:55:58.733 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.813+0000 7f2a44a2c640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.813+0000 7f2a44a2c640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.813+0000 7f2a44a2c640 10 monclient: monmap: 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.814859+0000 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.814859+0000 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.815 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.816 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.816 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.816 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.816 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.816 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.816 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.814+0000 7f2a44a2c640 1 Processor -- start 2026-02-17T11:55:58.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.814+0000 7f2a44a2c640 1 -- start start 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.814+0000 7f2a44a2c640 10 monclient: init 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.814+0000 7f2a44a2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.814+0000 7f2a44a2c640 10 monclient: _add_conns ranks=[2,5,3,4,1,0] 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2a40156200 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f2a4006c8d0 0x7f2a400cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 10 monclient(hunting): picked mon.noname-c con 0x7f2a4006c8d0 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f2a4006e150 0x7f2a400cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 10 monclient(hunting): picked mon.noname-a con 0x7f2a4006e150 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a4015cec0 con 0x7f2a40156200 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f2a4006f4d0 con 0x7f2a4006e150 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2a40070050 con 0x7f2a4006c8d0 2026-02-17T11:55:58.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a44a2c640 10 monclient(hunting): authenticate will time out at 1028.537215s 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3dd74640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f2a4006c8d0 0x7f2a400cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3ed76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f2a4006e150 0x7f2a400cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3e575640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f2a40156200 0x7f2a400704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55194/0 (socket says 10.20.193.10:55194) 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3e575640 1 -- 10.20.193.10:0/1682315403 learned_addr learned my addr 10.20.193.10:0/1682315403 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3ed76640 10 monclient(hunting): get_auth_request con 0x7f2a4006e150 auth_method 0 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3dd74640 10 monclient(hunting): get_auth_request con 0x7f2a4006c8d0 auth_method 0 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.815+0000 7f2a3dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7fd84c03f640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7fd84c03f640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7fd84c03f640 10 monclient: monmap: 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.817529+0000 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.817529+0000 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.820 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.821 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.821 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.821 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.821 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.821 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7f2a3ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7f2a3ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7f2a3ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7f2a3dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7f2a3dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7f2a3dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7fd84c03f640 1 Processor -- start 2026-02-17T11:55:58.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7fbd62187640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7fbd62187640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7fbd62187640 10 monclient: monmap: 2026-02-17T11:55:58.822 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.822 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.822 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.817996+0000 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.817996+0000 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7fd84c03f640 1 -- start start 2026-02-17T11:55:58.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.816+0000 7fd84c03f640 10 monclient: init 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fbd62187640 1 Processor -- start 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fc11af61640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fc11af61640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fc11af61640 10 monclient: monmap: 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.818483+0000 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.818483+0000 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.824 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.825 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.825 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.825 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.825 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.825 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fbd62187640 1 -- start start 2026-02-17T11:55:58.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fbd62187640 10 monclient: init 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 10 monclient: _add_conns ranks=[2,1,4,0,5,3] 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd844155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd844074cd0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fd844156260 0x7fd844166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 10 monclient(hunting): picked mon.noname-b con 0x7fd844156260 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd844073520 con 0x7fd844074cd0 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7f2a3ed76640 10 monclient(hunting): handle_auth_done global_id 4380 payload 274 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7f2a3ed76640 1 -- 10.20.193.10:0/1682315403 >> v2:10.20.193.153:3300/0 conn(0x7f2a4006c8d0 msgr2=0x7f2a400cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7f2a3ed76640 1 --2- 10.20.193.10:0/1682315403 >> v2:10.20.193.153:3300/0 conn(0x7f2a4006c8d0 0x7f2a400cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7f2a3ed76640 1 -- 10.20.193.10:0/1682315403 >> v1:10.20.193.153:6789/0 conn(0x7f2a40156200 legacy=0x7f2a400704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7f2a3ed76640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7f2a3ed76640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7f2a3ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7f2a3ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7f2a3ed76640 1 -- 10.20.193.10:0/1682315403 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4006f720 con 0x7f2a4006e150 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd844073800 con 0x7fd844155e80 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd8440cd840 con 0x7fd844156260 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fd84c03f640 10 monclient(hunting): authenticate will time out at 1028.539642s 2026-02-17T11:55:58.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.817+0000 7fc11af61640 1 Processor -- start 2026-02-17T11:55:58.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd84a5b5640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fd844156260 0x7fd844166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fbd62187640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fbd62187640 10 monclient: _add_conns ranks=[3,1,2,0,5,4] 2026-02-17T11:55:58.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fbd62187640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fbd5c155e80 0x7fbd5c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fbd62187640 10 monclient(hunting): picked mon.noname-a con 0x7fbd5c155e80 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fbd62187640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbd5c156260 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fbd62187640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbd5c0cd2d0 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd8495b3640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fd844074cd0 0x7fd8440ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:57938/0 (socket says 10.20.193.10:57938) 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd8495b3640 1 -- 10.20.193.10:0/1979605265 learned_addr learned my addr 10.20.193.10:0/1979605265 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd84a5b5640 10 monclient(hunting): get_auth_request con 0x7fd844156260 auth_method 0 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd84a5b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd84a5b5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd84a5b5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7f14da2a0640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7f14da2a0640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7f14da2a0640 10 monclient: monmap: 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.829 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.820018+0000 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.820018+0000 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fc11af61640 1 -- start start 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fc11af61640 10 monclient: init 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd84a5b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd84a5b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.818+0000 7fd84a5b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fbd62187640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd5c073520 con 0x7fbd5c156260 2026-02-17T11:55:58.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fbd62187640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd5c073800 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fbd62187640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fbd62187640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fbd5c0cd840 con 0x7fbd5c155e80 2026-02-17T11:55:58.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fbd62187640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fbd62187640 10 monclient(hunting): authenticate will time out at 1028.541076s 2026-02-17T11:55:58.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7f2a3ed76640 1 --2- 10.20.193.10:0/1682315403 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a4006e150 0x7f2a400cae60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009d90 tx=0x7f2a3002f340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fbf67d57f7cbda server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7f14da2a0640 1 Processor -- start 2026-02-17T11:55:58.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient: _add_conns ranks=[4,5,3,0,1,2] 2026-02-17T11:55:58.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fc114155e80 0x7fc1140745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient(hunting): picked mon.noname-b con 0x7fc114155e80 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc114156260 0x7fc114074b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient(hunting): picked mon.noname-c con 0x7fc114156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:58.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc1140ccbc0 0x7fc1140ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient(hunting): picked mon.noname-a con 0x7fc1140ccbc0 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fc1140cd840 con 0x7fc1140ccbc0 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc114073520 con 0x7fc114155e80 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc114073800 con 0x7fc114156260 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fc11af61640 10 monclient(hunting): authenticate will time out at 1028.541378s 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7fbd5b7fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fbd5c155e80 0x7fbd5c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7f14da2a0640 1 -- start start 2026-02-17T11:55:58.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.819+0000 7f14da2a0640 10 monclient: init 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fbd5bfff640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fbd5c0cd2d0 0x7fbd5c15f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55212/0 (socket says 10.20.193.10:55212) 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fbd5bfff640 1 -- 10.20.193.10:0/128976955 learned_addr learned my addr 10.20.193.10:0/128976955 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 10 monclient: _add_conns ranks=[0,1,4,3,2,5] 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f14d4163970 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f14d4163d50 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f14d415a240 0x7f14d416aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 10 monclient(hunting): picked mon.noname-b con 0x7f14d415a240 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d40c7db0 con 0x7f14d4163970 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d4070ea0 con 0x7f14d4163d50 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f14d415a650 con 0x7f14d415a240 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f6fdd898640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f6fdd898640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f6fdd898640 10 monclient: monmap: 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.821399+0000 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.821399+0000 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.835 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f14da2a0640 10 monclient(hunting): authenticate will time out at 1028.542212s 2026-02-17T11:55:58.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fbd5b7fe640 10 monclient(hunting): get_auth_request con 0x7fbd5c155e80 auth_method 0 2026-02-17T11:55:58.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fbd5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fbd5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fbd5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fbd5b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fbd5b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fbd5b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fc1194d7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc1140ccbc0 0x7fc1140ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fc1194d7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc1140ccbc0 0x7fc1140ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38102/0 (socket says 10.20.193.10:38102) 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fc1194d7640 1 -- 10.20.193.10:0/3386701984 learned_addr learned my addr 10.20.193.10:0/3386701984 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fc1194d7640 10 monclient(hunting): get_auth_request con 0x7fc1140ccbc0 auth_method 0 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fc1194d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fc1194d7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fc1194d7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fd84a5b5640 10 monclient(hunting): handle_auth_done global_id 4435 payload 274 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f6fdd898640 1 Processor -- start 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fd84a5b5640 1 -- 10.20.193.10:0/1979605265 >> v1:10.20.193.153:6789/0 conn(0x7fd844155e80 legacy=0x7fd8440745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fd84a5b5640 1 -- 10.20.193.10:0/1979605265 >> v1:10.20.193.71:6789/0 conn(0x7fd844074cd0 legacy=0x7fd8440ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fd84a5b5640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fd84a5b5640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fd84a5b5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fd84a5b5640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7fd84a5b5640 1 -- 10.20.193.10:0/1979605265 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd844073ae0 con 0x7fd844156260 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f6fdd898640 1 -- start start 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.820+0000 7f6fdd898640 10 monclient: init 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 10 monclient: _add_conns ranks=[1,4,0,2,5,3] 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6fd8155e80 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6fd8074cd0 0x7f6fd80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 10 monclient(hunting): picked mon.noname-b con 0x7f6fd8074cd0 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6fd8156260 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd8073520 con 0x7f6fd8156260 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd8073800 con 0x7f6fd8155e80 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6fd80cd840 con 0x7f6fd8074cd0 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f6fdd898640 10 monclient(hunting): authenticate will time out at 1028.543626s 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f53a61fb640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f53a61fb640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.821+0000 7f53a61fb640 10 monclient: monmap: 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.822941+0000 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.822941+0000 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7fbd5b7fe640 10 monclient(hunting): handle_auth_done global_id 4383 payload 274 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7fbd5b7fe640 1 -- 10.20.193.10:0/128976955 >> v1:10.20.193.153:6789/0 conn(0x7fbd5c0cd2d0 legacy=0x7fbd5c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7fbd5b7fe640 1 -- 10.20.193.10:0/128976955 >> v1:10.20.193.71:6789/0 conn(0x7fbd5c156260 legacy=0x7fbd5c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7fbd5b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7fbd5b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7fbd5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7fbd5b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7fbd5b7fe640 1 -- 10.20.193.10:0/128976955 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c073ae0 con 0x7fbd5c155e80 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f53a61fb640 1 Processor -- start 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f68b0d1b640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f53a61fb640 1 -- start start 2026-02-17T11:55:58.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f68b0d1b640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f53a61fb640 10 monclient: init 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f68b0d1b640 10 monclient: monmap: 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.823435+0000 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.823435+0000 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7fc10bfff640 1 --2- 10.20.193.10:0/3386701984 >> v2:10.20.193.153:3300/0 conn(0x7fc114156260 0x7fc114074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f68b0d1b640 1 Processor -- start 2026-02-17T11:55:58.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f53a61fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f53a61fb640 10 monclient: _add_conns ranks=[4,1,0,2,3,5] 2026-02-17T11:55:58.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f53a61fb640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f53a0155e80 0x7f53a00745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f68b0d1b640 1 -- start start 2026-02-17T11:55:58.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f53a61fb640 10 monclient(hunting): picked mon.noname-b con 0x7f53a0155e80 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f53a61fb640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f53a0156260 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f68b0d1b640 10 monclient: init 2026-02-17T11:55:58.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.822+0000 7f53a61fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f53a00cd2d0 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:58.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7fc1194d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7fc1194d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7fc1194d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f53a61fb640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a0073520 con 0x7f53a00cd2d0 2026-02-17T11:55:58.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f53a61fb640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a0073800 con 0x7f53a0156260 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f53a61fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f53a61fb640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f53a00cd840 con 0x7f53a0155e80 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f53a61fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f53a61fb640 10 monclient(hunting): authenticate will time out at 1028.545136s 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 10 monclient: _add_conns ranks=[2,4,3,5,0,1] 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f68ac155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f68ac074cd0 0x7f68ac0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 10 monclient(hunting): picked mon.noname-b con 0x7f68ac074cd0 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f68ac156260 0x7f68ac0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 10 monclient(hunting): picked mon.noname-a con 0x7f68ac156260 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68ac073520 con 0x7f68ac155e80 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f68ac0cd840 con 0x7f68ac156260 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f68ac073800 con 0x7f68ac074cd0 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68b0d1b640 10 monclient(hunting): authenticate will time out at 1028.545544s 2026-02-17T11:55:58.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f14d8816640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f14d415a240 0x7f14d416aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7fc10bfff640 10 monclient(hunting): get_auth_request con 0x7fc114156260 auth_method 0 2026-02-17T11:55:58.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7fc10bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7fc10bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7fc10bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68aa575640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f68ac155e80 0x7f68ac0745c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55222/0 (socket says 10.20.193.10:55222) 2026-02-17T11:55:58.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.823+0000 7f68aa575640 1 -- 10.20.193.10:0/1491654010 learned_addr learned my addr 10.20.193.10:0/1491654010 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:58.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f14d8816640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f14d415a240 0x7f14d416aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:46864/0 (socket says 10.20.193.10:46864) 2026-02-17T11:55:58.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f14d8816640 1 -- 10.20.193.10:0/1893311061 learned_addr learned my addr 10.20.193.10:0/1893311061 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f14d8816640 10 monclient(hunting): get_auth_request con 0x7f14d415a240 auth_method 0 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f14d8816640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f14d8816640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f14d8816640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7fbd5b7fe640 1 --2- 10.20.193.10:0/128976955 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbd5c155e80 0x7fbd5c0745c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd480098a0 tx=0x7fbd4802ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f5ba68756bb6f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f6fd67fc640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6fd8074cd0 0x7f6fd80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7fc10bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7fc10bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7fc10bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f14d8816640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f14d8816640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f14d8816640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f6fd67fc640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6fd8074cd0 0x7f6fd80ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:46868/0 (socket says 10.20.193.10:46868) 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f6fd67fc640 1 -- 10.20.193.10:0/1460706680 learned_addr learned my addr 10.20.193.10:0/1460706680 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f6fd67fc640 10 monclient(hunting): get_auth_request con 0x7f6fd8074cd0 auth_method 0 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f6fd67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f6fd67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.824+0000 7f6fd67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 10 monclient(hunting): handle_auth_done global_id 4424 payload 274 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 1 -- 10.20.193.10:0/3386701984 >> v2:10.20.193.71:3300/0 conn(0x7fc114155e80 msgr2=0x7fc1140745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 1 --2- 10.20.193.10:0/3386701984 >> v2:10.20.193.71:3300/0 conn(0x7fc114155e80 0x7fc1140745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 1 -- 10.20.193.10:0/3386701984 >> v2:10.20.193.10:3300/0 conn(0x7fc1140ccbc0 msgr2=0x7fc1140ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 1 --2- 10.20.193.10:0/3386701984 >> v2:10.20.193.10:3300/0 conn(0x7fc1140ccbc0 0x7fc1140ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7fc10bfff640 1 -- 10.20.193.10:0/3386701984 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc114073ae0 con 0x7fc114156260 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f14d8816640 10 monclient(hunting): handle_auth_done global_id 4441 payload 274 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f14d8816640 1 -- 10.20.193.10:0/1893311061 >> v1:10.20.193.71:6789/0 conn(0x7f14d4163d50 legacy=0x7f14d4159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f14d8816640 1 -- 10.20.193.10:0/1893311061 >> v1:10.20.193.10:6789/0 conn(0x7f14d4163970 legacy=0x7f14d40c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f14d8816640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f14d8816640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f14d8816640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f14d8816640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f14d8816640 1 -- 10.20.193.10:0/1893311061 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d40c8050 con 0x7f14d415a240 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f6fd67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f6fd67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.825+0000 7f6fd67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24749282 0 0) 0x7f68ac073520 con 0x7f68ac155e80 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f68a9573640 10 monclient(hunting): _negotiate 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f68a9573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f68a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f68a9573640 10 monclient(hunting): my global_id is 4427 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6898003620 con 0x7f68ac155e80 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f70d13e5640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f70d13e5640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f70d13e5640 10 monclient: monmap: 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.827800+0000 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.827800+0000 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.849 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 1 -- 10.20.193.10:0/128976955 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4803c070 con 0x7fbd5c155e80 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 10 monclient: dump: 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 1 -- 10.20.193.10:0/128976955 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4802fad0 con 0x7fbd5c155e80 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 1 -- 10.20.193.10:0/128976955 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48037440 con 0x7fbd5c155e80 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd62187640 5 monclient: authenticate success, global_id 4383 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd62187640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd62187640 4 set_mon_vals no callback set 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7fbd5a7fc640 10 monclient: dump: 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f6fd67fc640 10 monclient(hunting): handle_auth_done global_id 4444 payload 274 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f6fd67fc640 1 -- 10.20.193.10:0/1460706680 >> v1:10.20.193.71:6789/0 conn(0x7f6fd8155e80 legacy=0x7f6fd80745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f6fd67fc640 1 -- 10.20.193.10:0/1460706680 >> v1:10.20.193.10:6789/0 conn(0x7f6fd8156260 legacy=0x7f6fd815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f6fd67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f6fd67fc640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f6fd67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f6fd67fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.826+0000 7f6fd67fc640 1 -- 10.20.193.10:0/1460706680 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd8073ae0 con 0x7f6fd8074cd0 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fc10bfff640 1 --2- 10.20.193.10:0/3386701984 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc114156260 0x7fc114074b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc11406cfa0 tx=0x7fc0fc02edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51ef3c571b0950ca server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 1 Processor -- start 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 1 -- start start 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 10 monclient: init 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 1 -- 10.20.193.10:0/1682315403 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3003c070 con 0x7f2a4006e150 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 10 monclient: dump: 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.852 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 1 -- 10.20.193.10:0/1682315403 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a30037640 con 0x7f2a4006e150 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 1 -- 10.20.193.10:0/1682315403 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30037a10 con 0x7f2a4006e150 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a3d573640 10 monclient: dump: 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.853 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a44a2c640 5 monclient: authenticate success, global_id 4380 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a44a2c640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a44a2c640 4 set_mon_vals no callback set 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fbd62187640 10 monclient: shutdown 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fbd62187640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fbd62187640 1 -- 10.20.193.10:0/128976955 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbd5c155e80 msgr2=0x7fbd5c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fbd62187640 1 --2- 10.20.193.10:0/128976955 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbd5c155e80 0x7fbd5c0745c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd480098a0 tx=0x7fbd4802ee10 comp rx=0 tx=0).stop 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fbd62187640 1 -- 10.20.193.10:0/128976955 shutdown_connections 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fbd62187640 1 --2- 10.20.193.10:0/128976955 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbd5c155e80 0x7fbd5c0745c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fbd62187640 1 -- 10.20.193.10:0/128976955 >> 10.20.193.10:0/128976955 conn(0x7fbd5c0ce2b0 msgr2=0x7fbd5c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 10 monclient: _add_conns ranks=[1,4,2,3,0,5] 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f70cc15a2e0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f70cc0c9b70 0x7f70cc1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 10 monclient(hunting): picked mon.noname-b con 0x7f70cc0c9b70 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fbd62187640 1 -- 10.20.193.10:0/128976955 shutdown_connections 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f70cc0cd470 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70cc164530 con 0x7f70cc15a2e0 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70cc0ccbf0 con 0x7f70cc0cd470 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f70cc1642f0 con 0x7f70cc0c9b70 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f70d13e5640 10 monclient(hunting): authenticate will time out at 1028.549835s 2026-02-17T11:55:58.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7fbd62187640 1 -- 10.20.193.10:0/128976955 wait complete. 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f641a9ce640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f641a9ce640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f641a9ce640 10 monclient: monmap: 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.829163+0000 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.829163+0000 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a44a2c640 10 monclient: shutdown 2026-02-17T11:55:58.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a44a2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a44a2c640 1 -- 10.20.193.10:0/1682315403 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a4006e150 msgr2=0x7f2a400cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.827+0000 7f2a44a2c640 1 --2- 10.20.193.10:0/1682315403 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a4006e150 0x7f2a400cae60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009d90 tx=0x7f2a3002f340 comp rx=0 tx=0).stop 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 -- 10.20.193.10:0/1682315403 shutdown_connections 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 --2- 10.20.193.10:0/1682315403 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a4006e150 0x7f2a400cae60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 --2- 10.20.193.10:0/1682315403 >> v2:10.20.193.153:3300/0 conn(0x7f2a4006c8d0 0x7f2a400cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 -- 10.20.193.10:0/1682315403 >> 10.20.193.10:0/1682315403 conn(0x7f2a400cbf50 msgr2=0x7f2a400cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 -- 10.20.193.10:0/1682315403 shutdown_connections 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 -- 10.20.193.10:0/1682315403 wait complete. 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7fbd62187640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7fbd62187640 10 monclient: monmap: 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.857 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f641a9ce640 1 Processor -- start 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f641a9ce640 1 -- start start 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f14d8816640 1 --2- 10.20.193.10:0/1893311061 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14d415a240 0x7f14d416aa90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009e50 tx=0x7f14c802f260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b023b987324a0f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 10 monclient: monmap: 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.858 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f641a9ce640 10 monclient: init 2026-02-17T11:55:58.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 <== mon.2 v1:10.20.193.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3865665270 0 0) 0x7f6898003620 con 0x7f68ac155e80 2026-02-17T11:55:58.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7fbd62187640 1 librados: starting msgr at 2026-02-17T11:55:58.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7fbd62187640 1 librados: starting objecter 2026-02-17T11:55:58.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 >> v2:10.20.193.71:3300/0 conn(0x7f68ac074cd0 msgr2=0x7f68ac0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 librados: starting msgr at 2026-02-17T11:55:58.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 librados: starting objecter 2026-02-17T11:55:58.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 Processor -- start 2026-02-17T11:55:58.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 --2- 10.20.193.10:0/1491654010 >> v2:10.20.193.71:3300/0 conn(0x7f68ac074cd0 0x7f68ac0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7fbd62187640 1 Processor -- start 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 >> v2:10.20.193.10:3300/0 conn(0x7f68ac156260 msgr2=0x7f68ac0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7fbd62187640 1 -- start start 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7fbd62187640 1 librados: setting wanted keys 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7fbd62187640 1 librados: calling monclient init 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7fbd62187640 10 monclient: init 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 -- start start 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 librados: setting wanted keys 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 1 librados: calling monclient init 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f2a44a2c640 10 monclient: init 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2a4006c8d0 0x7f2a4014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient(hunting): picked mon.noname-b con 0x7f2a4006c8d0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a4006e150 0x7f2a4014b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient(hunting): picked mon.noname-c con 0x7f2a4006e150 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a40156200 0x7f2a4015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient(hunting): picked mon.noname-a con 0x7f2a40156200 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4006e8a0 con 0x7f2a40156200 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4006fce0 con 0x7f2a4006c8d0 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4015cb40 con 0x7f2a4006e150 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f2a44a2c640 10 monclient(hunting): authenticate will time out at 1028.551375s 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f6fd67fc640 1 --2- 10.20.193.10:0/1460706680 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6fd8074cd0 0x7f6fd80ccbc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009970 tx=0x7f6fc002eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4011f509b5dd03 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 --2- 10.20.193.10:0/1491654010 >> v2:10.20.193.10:3300/0 conn(0x7f68ac156260 0x7f68ac0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.153:6789/0 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 --> v1:10.20.193.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac073ae0 con 0x7f68ac155e80 2026-02-17T11:55:58.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 <== mon.2 v1:10.20.193.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f68a0002f00 con 0x7f68ac155e80 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient: dump: 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] but i'm connected to v1:10.20.193.153:6789/0, reconnecting 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 >> v1:10.20.193.153:6789/0 conn(0x7f68ac155e80 legacy=0x7f68ac0745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 --2- 10.20.193.10:0/1491654010 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6898003bf0 0x7f6898004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient(hunting): picked mon.b con 0x7f6898003bf0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 --2- 10.20.193.10:0/1491654010 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 0x7f6898004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient(hunting): picked mon.c con 0x7f6898004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 --2- 10.20.193.10:0/1491654010 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f68980124c0 0x7f68980148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient(hunting): picked mon.a con 0x7f68980124c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac0cd840 con 0x7f68980124c0 2026-02-17T11:55:58.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac073800 con 0x7f6898003bf0 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6898014f50 con 0x7f6898004900 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.828+0000 7f68a9573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbd5c0cd2d0 0x7fbd5c1f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient(hunting): picked mon.noname-c con 0x7fbd5c0cd2d0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbd5c155e80 0x7fbd5c13e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient(hunting): picked mon.noname-b con 0x7fbd5c155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbd5c156260 0x7fbd5c1f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient(hunting): picked mon.noname-a con 0x7fbd5c156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c0c4870 con 0x7fbd5c156260 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c0740a0 con 0x7fbd5c155e80 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c0c49f0 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7fbd62187640 10 monclient(hunting): authenticate will time out at 1028.551489s 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 10 monclient: _add_conns ranks=[1,4,5,3,2,0] 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6414155e80 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6414074cd0 0x7f64140ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 10 monclient(hunting): picked mon.noname-b con 0x7f6414074cd0 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6414156260 0x7f64140cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 10 monclient(hunting): picked mon.noname-c con 0x7f6414156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6414073520 con 0x7f6414155e80 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f64140cd840 con 0x7f6414074cd0 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6414073800 con 0x7f6414156260 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f641a9ce640 10 monclient(hunting): authenticate will time out at 1028.551406s 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f539ffff640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f53a00cd2d0 0x7f53a015f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:42086/0 (socket says 10.20.193.10:42086) 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.829+0000 7f539ffff640 1 -- 10.20.193.10:0/2702160109 learned_addr learned my addr 10.20.193.10:0/2702160109 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7f92b1fc1640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7f92b1fc1640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7f92b1fc1640 10 monclient: monmap: 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.831347+0000 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.831347+0000 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7f70cb7fe640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f70cc0cd470 0x7f70cc163be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55228/0 (socket says 10.20.193.10:55228) 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7f70cb7fe640 1 -- 10.20.193.10:0/2709079030 learned_addr learned my addr 10.20.193.10:0/2709079030 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 1 -- 10.20.193.10:0/3386701984 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc03c070 con 0x7fc114156260 2026-02-17T11:55:58.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 10 monclient: dump: 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 1 -- 10.20.193.10:0/3386701984 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0fc02fa80 con 0x7fc114156260 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 1 -- 10.20.193.10:0/3386701984 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc02fe50 con 0x7fc114156260 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc10b7fe640 10 monclient: dump: 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.866 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc11af61640 5 monclient: authenticate success, global_id 4424 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc11af61640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc11af61640 4 set_mon_vals no callback set 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7f92b1fc1640 1 Processor -- start 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7f92b1fc1640 1 -- start start 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7f92b1fc1640 10 monclient: init 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc11af61640 10 monclient: shutdown 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc11af61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc11af61640 1 -- 10.20.193.10:0/3386701984 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc114156260 msgr2=0x7fc114074b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.830+0000 7fc11af61640 1 --2- 10.20.193.10:0/3386701984 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc114156260 0x7fc114074b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc11406cfa0 tx=0x7fc0fc02edc0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 -- 10.20.193.10:0/3386701984 shutdown_connections 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 --2- 10.20.193.10:0/3386701984 >> v2:10.20.193.10:3300/0 conn(0x7fc1140ccbc0 0x7fc1140ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 --2- 10.20.193.10:0/3386701984 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc114156260 0x7fc114074b00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f539f7fe640 1 --2- 10.20.193.10:0/2702160109 >> v2:10.20.193.71:3300/0 conn(0x7f53a0155e80 0x7f53a00745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 --2- 10.20.193.10:0/3386701984 >> v2:10.20.193.71:3300/0 conn(0x7fc114155e80 0x7fc1140745c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 -- 10.20.193.10:0/3386701984 >> 10.20.193.10:0/3386701984 conn(0x7fc1140ce2b0 msgr2=0x7fc1140ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f27870f1640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f27870f1640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f27870f1640 10 monclient: monmap: 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.832279+0000 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.832279+0000 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 -- 10.20.193.10:0/3386701984 shutdown_connections 2026-02-17T11:55:58.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 -- 10.20.193.10:0/3386701984 wait complete. 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient: _add_conns ranks=[4,3,5,0,2,1] 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f92ac155e80 0x7f92ac0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient(hunting): picked mon.noname-b con 0x7f92ac155e80 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f92ac156260 0x7f92ac074b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient(hunting): picked mon.noname-a con 0x7f92ac156260 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f92ac0ccbc0 0x7f92ac0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient(hunting): picked mon.noname-c con 0x7f92ac0ccbc0 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f92ac0cd840 con 0x7f92ac156260 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f92ac073520 con 0x7f92ac155e80 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f92ac073800 con 0x7f92ac0ccbc0 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f92b1fc1640 10 monclient(hunting): authenticate will time out at 1028.553457s 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 10 monclient: monmap: 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.869 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 librados: starting msgr at 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 librados: starting objecter 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f539f7fe640 10 monclient(hunting): get_auth_request con 0x7f53a0155e80 auth_method 0 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f539f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f539f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f539f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 Processor -- start 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f27870f1640 1 Processor -- start 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7f68a9d74640 1 --2- 10.20.193.10:0/1491654010 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 0x7f6898004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 -- start start 2026-02-17T11:55:58.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 librados: setting wanted keys 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 1 -- start start 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient: init 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 1 librados: calling monclient init 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.831+0000 7fc11af61640 10 monclient: init 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f68a9d74640 10 monclient(hunting): get_auth_request con 0x7f6898004900 auth_method 0 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f68a9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f68a9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f68a9d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f539f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f539f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f539f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f95857a9640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f95857a9640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f95857a9640 10 monclient: monmap: 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.833644+0000 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.833644+0000 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1140ccbc0 0x7fc114157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient(hunting): picked mon.noname-c con 0x7fc1140ccbc0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc114155e80 0x7fc114158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient(hunting): picked mon.noname-b con 0x7fc114155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc114156260 0x7fc1141ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient(hunting): picked mon.noname-a con 0x7fc114156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc1140cd520 con 0x7fc114156260 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1140740a0 con 0x7fc114155e80 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc1140c4870 con 0x7fc1140ccbc0 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7fc11af61640 10 monclient(hunting): authenticate will time out at 1028.554476s 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient: _add_conns ranks=[2,3,5,1,0,4] 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2780155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f2780074cd0 0x7f27800ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient(hunting): picked mon.noname-a con 0x7f2780074cd0 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f2780156260 0x7f27800cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient(hunting): picked mon.noname-c con 0x7f2780156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2780073520 con 0x7f2780155e80 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f27800cd840 con 0x7f2780074cd0 2026-02-17T11:55:58.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2780073800 con 0x7f2780156260 2026-02-17T11:55:58.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f27870f1640 10 monclient(hunting): authenticate will time out at 1028.554686s 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f95857a9640 1 Processor -- start 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f95857a9640 1 -- start start 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.832+0000 7f95857a9640 10 monclient: init 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f68a9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f68a9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f68a9d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f70c9ffb640 1 -- 10.20.193.10:0/2709079030 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015348242 0 0) 0x7f70cc0ccbf0 con 0x7f70cc0cd470 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f70c9ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f70c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f70c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f70c9ffb640 10 monclient(hunting): my global_id is 4430 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f70c9ffb640 1 -- 10.20.193.10:0/2709079030 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70b8003620 con 0x7f70cc0cd470 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7fbd5b7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbd5c0cd2d0 0x7fbd5c1f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 10 monclient: _add_conns ranks=[5,4,1,0,3,2] 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f9580155d60 0x7f95800ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 10 monclient(hunting): picked mon.noname-c con 0x7f9580155d60 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f958006f560 0x7f958015c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f9238161640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f9238161640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 10 monclient(hunting): picked mon.noname-b con 0x7f958006f560 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f9238161640 10 monclient: monmap: 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.834733+0000 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.834733+0000 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.877 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f958015d5b0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958015cda0 con 0x7f958015d5b0 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f958006fa90 con 0x7f958006f560 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f958006fd70 con 0x7f9580155d60 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f95857a9640 10 monclient(hunting): authenticate will time out at 1028.555551s 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f9238161640 1 Processor -- start 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f9238161640 1 -- start start 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.833+0000 7f9238161640 10 monclient: init 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f62b8cfc640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f62b8cfc640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f62b8cfc640 10 monclient: monmap: 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.835372+0000 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.835372+0000 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.878 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 10 monclient: _add_conns ranks=[4,3,2,0,1,5] 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9230155e80 0x7f92300745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 10 monclient(hunting): picked mon.noname-b con 0x7f9230155e80 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f9230156260 0x7f9230074b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 10 monclient(hunting): picked mon.noname-a con 0x7f9230156260 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f92300ccbc0 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9230073520 con 0x7f92300ccbc0 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f92300cd840 con 0x7f9230156260 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9230073800 con 0x7f9230155e80 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f9238161640 10 monclient(hunting): authenticate will time out at 1028.556528s 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f62b8cfc640 1 Processor -- start 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f539f7fe640 10 monclient(hunting): handle_auth_done global_id 4447 payload 274 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f539f7fe640 1 -- 10.20.193.10:0/2702160109 >> v1:10.20.193.71:6789/0 conn(0x7f53a0156260 legacy=0x7f53a00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f539f7fe640 1 -- 10.20.193.10:0/2702160109 >> v1:10.20.193.10:6789/0 conn(0x7f53a00cd2d0 legacy=0x7f53a015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f539f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f539f7fe640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f539f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f539f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f539f7fe640 1 -- 10.20.193.10:0/2702160109 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a0073ae0 con 0x7f53a0155e80 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 10 monclient(hunting): handle_auth_done global_id 4427 payload 293 2026-02-17T11:55:58.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 1 -- 10.20.193.10:0/1491654010 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6898003bf0 msgr2=0x7f6898004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 1 --2- 10.20.193.10:0/1491654010 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6898003bf0 0x7f6898004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 1 -- 10.20.193.10:0/1491654010 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f68980124c0 msgr2=0x7f68980148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 1 --2- 10.20.193.10:0/1491654010 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f68980124c0 0x7f68980148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 1 monclient: found mon.c 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 1 -- 10.20.193.10:0/1491654010 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6898003620 con 0x7f6898004900 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68a9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68aad76640 1 -- 10.20.193.10:0/1491654010 reap_dead start 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68b0d1b640 5 monclient: authenticate success, global_id 4427 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f68b0d1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f62b8cfc640 1 -- start start 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7f62b8cfc640 10 monclient: init 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7fbd5b7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbd5c0cd2d0 0x7fbd5c1f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35472/0 (socket says 10.20.193.10:35472) 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7fbd5b7fe640 1 -- 10.20.193.10:0/1454944431 learned_addr learned my addr 10.20.193.10:0/1454944431 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7fbd5b7fe640 10 monclient(hunting): get_auth_request con 0x7fbd5c0cd2d0 auth_method 0 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7fbd5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7fbd5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.834+0000 7fbd5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 10 monclient: _add_conns ranks=[4,0,5,3,2,1] 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f62b4155d70 0x7f62b4068e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 10 monclient(hunting): picked mon.noname-b con 0x7f62b4155d70 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f62b406e2d0 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f62b40c9f90 0x7f62b415f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 10 monclient(hunting): picked mon.noname-c con 0x7f62b40c9f90 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b4156150 con 0x7f62b406e2d0 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f62b40693a0 con 0x7f62b4155d70 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f62b406ecd0 con 0x7f62b40c9f90 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f62b8cfc640 10 monclient(hunting): authenticate will time out at 1028.557235s 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7fbd5b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7fbd5b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7fbd5b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f6418f44640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6414156260 0x7f64140cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f2a3ed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a40156200 0x7f2a4015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f92bf175640 10 monclient: get_monmap_and_config 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f92bf175640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f92bf175640 10 monclient: monmap: 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:58.837161+0000 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:58.837161+0000 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.835+0000 7f539f7fe640 1 --2- 10.20.193.10:0/2702160109 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53a0155e80 0x7f53a00745c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f538c0098a0 tx=0x7f538c02ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35a7731a3278df8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f92bf175640 1 Processor -- start 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f2a3ed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a40156200 0x7f2a4015b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38128/0 (socket says 10.20.193.10:38128) 2026-02-17T11:55:58.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f2a3ed76640 1 -- 10.20.193.10:0/3401292489 learned_addr learned my addr 10.20.193.10:0/3401292489 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f2a3ed76640 10 monclient(hunting): get_auth_request con 0x7f2a40156200 auth_method 0 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f2a3ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f2a3ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f2a3ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f92bf175640 1 -- start start 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f92bf175640 10 monclient: init 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 1 -- 10.20.193.10:0/1460706680 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc003c070 con 0x7f6fd8074cd0 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 10 monclient: dump: 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 1 -- 10.20.193.10:0/1460706680 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc002fb60 con 0x7f6fd8074cd0 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 1 -- 10.20.193.10:0/1460706680 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0037440 con 0x7f6fd8074cd0 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fd5ffb640 10 monclient: dump: 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.883 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f92bf175640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f92bf175640 10 monclient: _add_conns ranks=[1,2,3,0,4,5] 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fdd898640 5 monclient: authenticate success, global_id 4444 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.836+0000 7f6fdd898640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 4 set_mon_vals no callback set 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f92b8155e80 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f92b8074cd0 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f92b8156260 0x7f92b8166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 10 monclient(hunting): handle_auth_done global_id 4433 payload 824 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 1 -- 10.20.193.10:0/1454944431 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbd5c155e80 msgr2=0x7fbd5c13e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbd5c155e80 0x7fbd5c13e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 1 -- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbd5c156260 msgr2=0x7fbd5c1f7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbd5c156260 0x7fbd5c1f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fbd5b7fe640 1 -- 10.20.193.10:0/1454944431 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c140530 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f68a9d74640 1 --2- 10.20.193.10:0/1491654010 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 0x7f6898004d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6894009980 tx=0x7f689402ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da59782ce6634ee server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 10 monclient: shutdown 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 1 -- 10.20.193.10:0/1460706680 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6fd8074cd0 msgr2=0x7f6fd80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 1 --2- 10.20.193.10:0/1460706680 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6fd8074cd0 0x7f6fd80ccbc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009970 tx=0x7f6fc002eef0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 10 monclient(hunting): picked mon.noname-a con 0x7f92b8156260 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b8073520 con 0x7f92b8155e80 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b8073800 con 0x7f92b8074cd0 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f92b80cd840 con 0x7f92b8156260 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f92bf175640 10 monclient(hunting): authenticate will time out at 1028.559139s 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 1 -- 10.20.193.10:0/1460706680 shutdown_connections 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 1 --2- 10.20.193.10:0/1460706680 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6fd8074cd0 0x7f6fd80ccbc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 1 -- 10.20.193.10:0/1460706680 >> 10.20.193.10:0/1460706680 conn(0x7f6fd80ce2b0 msgr2=0x7f6fd80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 1 -- 10.20.193.10:0/1460706680 shutdown_connections 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f64137fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6414074cd0 0x7f64140ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6fdd898640 1 -- 10.20.193.10:0/1460706680 wait complete. 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6418f44640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6414156260 0x7f64140cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35464/0 (socket says 10.20.193.10:35464) 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6418f44640 1 -- 10.20.193.10:0/2989363302 learned_addr learned my addr 10.20.193.10:0/2989363302 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6418f44640 10 monclient(hunting): get_auth_request con 0x7f6414156260 auth_method 0 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6418f44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6418f44640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f6418f44640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 1 -- 10.20.193.10:0/1893311061 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c802fc80 con 0x7f14d415a240 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 10 monclient: dump: 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7fc1194d7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc114156260 0x7fc1141ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 1 -- 10.20.193.10:0/1893311061 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c802fe20 con 0x7f14d415a240 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 1 -- 10.20.193.10:0/1893311061 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c8037610 con 0x7f14d415a240 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14d2ffd640 10 monclient: dump: 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14da2a0640 5 monclient: authenticate success, global_id 4441 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14da2a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.837+0000 7f14da2a0640 4 set_mon_vals no callback set 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7fc1194d7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc114156260 0x7fc1141ef8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38168/0 (socket says 10.20.193.10:38168) 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7fc1194d7640 1 -- 10.20.193.10:0/521462811 learned_addr learned my addr 10.20.193.10:0/521462811 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7fc1194d7640 10 monclient(hunting): get_auth_request con 0x7fc114156260 auth_method 0 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7fc1194d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7fc1194d7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7fc1194d7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient: monmap: 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.887 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f64137fe640 10 monclient(hunting): get_auth_request con 0x7f6414074cd0 auth_method 0 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f64137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f64137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f64137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f2a3ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f2a3ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f2a3ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f14da2a0640 10 monclient: shutdown 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 librados: starting msgr at 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 librados: starting objecter 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 Processor -- start 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 -- start start 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 librados: setting wanted keys 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 librados: calling monclient init 2026-02-17T11:55:58.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient: init 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f14da2a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f14da2a0640 1 -- 10.20.193.10:0/1893311061 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14d415a240 msgr2=0x7f14d416aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f14da2a0640 1 --2- 10.20.193.10:0/1893311061 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14d415a240 0x7f14d416aa90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009e50 tx=0x7f14c802f260 comp rx=0 tx=0).stop 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f14da2a0640 1 -- 10.20.193.10:0/1893311061 shutdown_connections 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f14da2a0640 1 --2- 10.20.193.10:0/1893311061 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14d415a240 0x7f14d416aa90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f14da2a0640 1 -- 10.20.193.10:0/1893311061 >> 10.20.193.10:0/1893311061 conn(0x7f14d40c9d80 msgr2=0x7f14d40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f92ab7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f92ac155e80 0x7f92ac0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f14da2a0640 1 -- 10.20.193.10:0/1893311061 shutdown_connections 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6418f44640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6418f44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f14da2a0640 1 -- 10.20.193.10:0/1893311061 wait complete. 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6418f44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6fd8074cd0 0x7f6fd80c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient(hunting): picked mon.noname-c con 0x7f6fd8074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6fd8155e80 0x7f6fd81e95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient(hunting): picked mon.noname-a con 0x7f6fd8155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6fd8156260 0x7f6fd80c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient(hunting): picked mon.noname-b con 0x7f6fd8156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7fbd5b7fe640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbd5c0cd2d0 0x7fbd5c1f5360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd480099d0 tx=0x7fbd480047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd80c4870 con 0x7f6fd8155e80 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7fbd37fff640 10 client.?.objecter ms_handle_connect 0x7fbd5c0cd2d0 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7fbd37fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd80740a0 con 0x7f6fd8156260 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd80c49f0 con 0x7f6fd8074cd0 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f6fdd898640 10 monclient(hunting): authenticate will time out at 1028.560873s 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f64137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f64137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.838+0000 7f64137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7fc1194d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7fc1194d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7fc1194d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7fc118cd6640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1140ccbc0 0x7fc114157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 10 monclient: monmap: 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 1 librados: starting msgr at 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 1 librados: starting objecter 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 1 Processor -- start 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 1 -- start start 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 1 librados: setting wanted keys 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 1 librados: calling monclient init 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 10 monclient: init 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f92ab7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f92ac155e80 0x7f92ac0745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:46928/0 (socket says 10.20.193.10:46928) 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f92ab7fe640 1 -- 10.20.193.10:0/1053702397 learned_addr learned my addr 10.20.193.10:0/1053702397 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f92ab7fe640 10 monclient(hunting): get_auth_request con 0x7f92ac155e80 auth_method 0 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f92ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f92ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f92ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.839+0000 7f14da2a0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f14d415a240 0x7f14d40c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 10 monclient(hunting): picked mon.noname-a con 0x7f14d415a240 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14d4163970 0x7f14d40c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 10 monclient(hunting): picked mon.noname-b con 0x7f14d4163970 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14d4163d50 0x7f14d41616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 10 monclient(hunting): picked mon.noname-c con 0x7f14d4163d50 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f14d40c88f0 con 0x7f14d415a240 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f14d40c8610 con 0x7f14d4163970 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f14d40c8bd0 con 0x7f14d4163d50 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f14da2a0640 10 monclient(hunting): authenticate will time out at 1028.562162s 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f64137fe640 10 monclient(hunting): handle_auth_done global_id 4450 payload 274 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f64137fe640 1 -- 10.20.193.10:0/2989363302 >> v2:10.20.193.153:3300/0 conn(0x7f6414156260 msgr2=0x7f64140cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f64137fe640 1 --2- 10.20.193.10:0/2989363302 >> v2:10.20.193.153:3300/0 conn(0x7f6414156260 0x7f64140cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f64137fe640 1 -- 10.20.193.10:0/2989363302 >> v1:10.20.193.71:6789/0 conn(0x7f6414155e80 legacy=0x7f64140745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f64137fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f64137fe640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f64137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f64137fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f64137fe640 1 -- 10.20.193.10:0/2989363302 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6414073ae0 con 0x7f6414074cd0 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 10 monclient(hunting): handle_auth_done global_id 4395 payload 824 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 1 -- 10.20.193.10:0/521462811 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1140ccbc0 msgr2=0x7fc114157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1140ccbc0 0x7fc114157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 1 -- 10.20.193.10:0/521462811 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc114155e80 msgr2=0x7fc114158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc114155e80 0x7fc114158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7fc1194d7640 1 -- 10.20.193.10:0/521462811 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1141f0500 con 0x7fc114156260 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f92ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f92ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.840+0000 7f92ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f2a3dd74640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a4006e150 0x7f2a4014b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f2a3dd74640 10 monclient(hunting): get_auth_request con 0x7f2a4006e150 auth_method 0 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f2a3dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f2a3dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f2a3dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 10 monclient(hunting): handle_auth_done global_id 4453 payload 274 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 1 -- 10.20.193.10:0/1053702397 >> v2:10.20.193.153:3300/0 conn(0x7f92ac0ccbc0 msgr2=0x7f92ac0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 1 --2- 10.20.193.10:0/1053702397 >> v2:10.20.193.153:3300/0 conn(0x7f92ac0ccbc0 0x7f92ac0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 1 -- 10.20.193.10:0/1053702397 >> v2:10.20.193.10:3300/0 conn(0x7f92ac156260 msgr2=0x7f92ac074b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 1 --2- 10.20.193.10:0/1053702397 >> v2:10.20.193.10:3300/0 conn(0x7f92ac156260 0x7f92ac074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.841+0000 7f92ab7fe640 1 -- 10.20.193.10:0/1053702397 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ac073ae0 con 0x7f92ac155e80 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 10 monclient(hunting): handle_auth_done global_id 4392 payload 824 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 1 -- 10.20.193.10:0/3401292489 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a4006e150 msgr2=0x7f2a4014b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a4006e150 0x7f2a4014b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 1 -- 10.20.193.10:0/3401292489 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2a4006c8d0 msgr2=0x7f2a4014dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2a4006c8d0 0x7f2a4014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2a3ed76640 1 -- 10.20.193.10:0/3401292489 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4015c0b0 con 0x7f2a40156200 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f64137fe640 1 --2- 10.20.193.10:0/2989363302 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414074cd0 0x7f64140ccbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f641408f350 tx=0x7f640402ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ecb2b177dfd43e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2784e66640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f2780155e80 0x7f27800745c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55244/0 (socket says 10.20.193.10:55244) 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2784e66640 1 -- 10.20.193.10:0/2067084973 learned_addr learned my addr 10.20.193.10:0/2067084973 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.842+0000 7f2785667640 1 --2- 10.20.193.10:0/2067084973 >> v2:10.20.193.153:3300/0 conn(0x7f2780156260 0x7f27800cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.843+0000 7fd84a5b5640 1 --2- 10.20.193.10:0/1979605265 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd844156260 0x7fd844166710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd840009d90 tx=0x7fd84002f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9ae5af164f3b08e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.843+0000 7f2785667640 10 monclient(hunting): get_auth_request con 0x7f2780156260 auth_method 0 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.843+0000 7f2785667640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.843+0000 7fc1194d7640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc114156260 0x7fc1141ef8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc11000efc0 tx=0x7fc11000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.843+0000 7f2785667640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.843+0000 7f2785667640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.843+0000 7fc1097fa640 10 client.?.objecter ms_handle_connect 0x7fc114156260 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.843+0000 7fc1097fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.843+0000 7f92ab7fe640 1 --2- 10.20.193.10:0/1053702397 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac155e80 0x7f92ac0745c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92ac06cfa0 tx=0x7f929802ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbd5b8efc96d654d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.844+0000 7f957effd640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f9580155d60 0x7f95800ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f2785667640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f2785667640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f2785667640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f957effd640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f9580155d60 0x7f95800ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35510/0 (socket says 10.20.193.10:35510) 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f957effd640 1 -- 10.20.193.10:0/3762908829 learned_addr learned my addr 10.20.193.10:0/3762908829 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f957effd640 10 monclient(hunting): get_auth_request con 0x7f9580155d60 auth_method 0 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f957effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f957effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f957effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f92bd6eb640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f92b8156260 0x7f92b8166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f92bd6eb640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f92b8156260 0x7f92b8166710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38174/0 (socket says 10.20.193.10:38174) 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f92bd6eb640 1 -- 10.20.193.10:0/2005569912 learned_addr learned my addr 10.20.193.10:0/2005569912 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f92bd6eb640 10 monclient(hunting): get_auth_request con 0x7f92b8156260 auth_method 0 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f92bd6eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f92bd6eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f92bd6eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f2a3ed76640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a40156200 0x7f2a4015b700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009d90 tx=0x7f2a30004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f2a26ffd640 10 client.?.objecter ms_handle_connect 0x7f2a40156200 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.845+0000 7f2a26ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f92bd6eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f92bd6eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f92bd6eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f2785667640 10 monclient(hunting): handle_auth_done global_id 4439 payload 274 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f2785667640 1 -- 10.20.193.10:0/2067084973 >> v2:10.20.193.10:3300/0 conn(0x7f2780074cd0 msgr2=0x7f27800ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f2785667640 1 --2- 10.20.193.10:0/2067084973 >> v2:10.20.193.10:3300/0 conn(0x7f2780074cd0 0x7f27800ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f2785667640 1 -- 10.20.193.10:0/2067084973 >> v1:10.20.193.153:6789/0 conn(0x7f2780155e80 legacy=0x7f27800745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f2785667640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f2785667640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f2785667640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f2785667640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f2785667640 1 -- 10.20.193.10:0/2067084973 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2780073ae0 con 0x7f2780156260 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f957effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f957effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f957effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.846+0000 7f92356d5640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f9230156260 0x7f9230074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92356d5640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f9230156260 0x7f9230074b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38172/0 (socket says 10.20.193.10:38172) 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92356d5640 1 -- 10.20.193.10:0/2022927321 learned_addr learned my addr 10.20.193.10:0/2022927321 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92356d5640 10 monclient(hunting): get_auth_request con 0x7f9230156260 auth_method 0 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92356d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92356d5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92356d5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92bd6eb640 10 monclient(hunting): handle_auth_done global_id 4398 payload 274 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92bd6eb640 1 -- 10.20.193.10:0/2005569912 >> v1:10.20.193.153:6789/0 conn(0x7f92b8074cd0 legacy=0x7f92b80ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92bd6eb640 1 -- 10.20.193.10:0/2005569912 >> v1:10.20.193.71:6789/0 conn(0x7f92b8155e80 legacy=0x7f92b80745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92bd6eb640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92bd6eb640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92bd6eb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92bd6eb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.847+0000 7f92bd6eb640 1 -- 10.20.193.10:0/2005569912 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b8073ae0 con 0x7f92b8156260 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f957effd640 10 monclient(hunting): handle_auth_done global_id 4445 payload 274 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f957effd640 1 -- 10.20.193.10:0/3762908829 >> v2:10.20.193.71:3300/0 conn(0x7f958006f560 msgr2=0x7f958015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f957effd640 1 --2- 10.20.193.10:0/3762908829 >> v2:10.20.193.71:3300/0 conn(0x7f958006f560 0x7f958015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f957effd640 1 -- 10.20.193.10:0/3762908829 >> v1:10.20.193.71:6789/0 conn(0x7f958015d5b0 legacy=0x7f958015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f957effd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f957effd640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f957effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f957effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f957effd640 1 -- 10.20.193.10:0/3762908829 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9580070050 con 0x7f9580155d60 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f70ca7fc640 1 --2- 10.20.193.10:0/2709079030 >> v2:10.20.193.71:3300/0 conn(0x7f70cc0c9b70 0x7f70cc1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.848+0000 7f2785667640 1 --2- 10.20.193.10:0/2067084973 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780156260 0x7f27800cd100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f278008f350 tx=0x7f277c02f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c4e5e03e8c4f07f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f70ca7fc640 10 monclient(hunting): get_auth_request con 0x7f70cc0c9b70 auth_method 0 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f70ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f70ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f70ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f92356d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f92356d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f92356d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f70ca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f70ca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f70ca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.849+0000 7f62b2575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f62b4155d70 0x7f62b4068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f62b2575640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f62b4155d70 0x7f62b4068e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:46954/0 (socket says 10.20.193.10:46954) 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f62b2575640 1 -- 10.20.193.10:0/968095310 learned_addr learned my addr 10.20.193.10:0/968095310 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f62b2575640 10 monclient(hunting): get_auth_request con 0x7f62b4155d70 auth_method 0 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f62b2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f62b2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f62b2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f957effd640 1 --2- 10.20.193.10:0/3762908829 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 0x7f95800ccb40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9580074710 tx=0x7f957402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e756314dfa2c3f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f92356d5640 10 monclient(hunting): handle_auth_done global_id 4401 payload 274 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f92356d5640 1 -- 10.20.193.10:0/2022927321 >> v2:10.20.193.71:3300/0 conn(0x7f9230155e80 msgr2=0x7f92300745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f92356d5640 1 --2- 10.20.193.10:0/2022927321 >> v2:10.20.193.71:3300/0 conn(0x7f9230155e80 0x7f92300745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f92356d5640 1 -- 10.20.193.10:0/2022927321 >> v1:10.20.193.153:6789/0 conn(0x7f92300ccbc0 legacy=0x7f92300ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f92356d5640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f92356d5640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f92356d5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f92356d5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.850+0000 7f92356d5640 1 -- 10.20.193.10:0/2022927321 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9230073ae0 con 0x7f9230156260 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f70ca7fc640 10 monclient(hunting): handle_auth_done global_id 4456 payload 274 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f70ca7fc640 1 -- 10.20.193.10:0/2709079030 >> v1:10.20.193.153:6789/0 conn(0x7f70cc0cd470 legacy=0x7f70cc163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f70ca7fc640 1 -- 10.20.193.10:0/2709079030 >> v1:10.20.193.71:6789/0 conn(0x7f70cc15a2e0 legacy=0x7f70cc0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f70ca7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f70ca7fc640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f70ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f70ca7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f70ca7fc640 1 -- 10.20.193.10:0/2709079030 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc0cced0 con 0x7f70cc0c9b70 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f62b2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f62b2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f62b2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.851+0000 7f92bd6eb640 1 --2- 10.20.193.10:0/2005569912 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92b8156260 0x7f92b8166710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009e50 tx=0x7f92b402f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d453851e1ed7d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6fd8155e80 0x7f6fd81e95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6fd8155e80 0x7f6fd81e95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38180/0 (socket says 10.20.193.10:38180) 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 1 -- 10.20.193.10:0/1248961327 learned_addr learned my addr 10.20.193.10:0/1248961327 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 10 monclient(hunting): get_auth_request con 0x7f6fd8155e80 auth_method 0 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f6fd67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f14d3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f14d415a240 0x7f14d40c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f62b2575640 10 monclient(hunting): handle_auth_done global_id 4459 payload 274 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f62b2575640 1 -- 10.20.193.10:0/968095310 >> v2:10.20.193.153:3300/0 conn(0x7f62b40c9f90 msgr2=0x7f62b415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f62b2575640 1 --2- 10.20.193.10:0/968095310 >> v2:10.20.193.153:3300/0 conn(0x7f62b40c9f90 0x7f62b415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f62b2575640 1 -- 10.20.193.10:0/968095310 >> v1:10.20.193.10:6789/0 conn(0x7f62b406e2d0 legacy=0x7f62b40c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f62b2575640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f62b2575640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f62b2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f62b2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.852+0000 7f62b2575640 1 -- 10.20.193.10:0/968095310 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b406efb0 con 0x7f62b4155d70 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689403c070 con 0x7f6898004900 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 10 monclient: dump: 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689402f770 con 0x7f6898004900 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68b0d1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 1 -- 10.20.193.10:0/1491654010 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894009550 con 0x7f6898004900 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68a9573640 10 monclient: dump: 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68b0d1b640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68b0d1b640 4 set_mon_vals no callback set 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f70ca7fc640 1 --2- 10.20.193.10:0/2709079030 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f70cc0c9b70 0x7f70cc1636a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009890 tx=0x7f70b402ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8429120db81e7382 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68b0d1b640 10 monclient: shutdown 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68b0d1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.853+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1491654010 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 msgr2=0x7f6898004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 --2- 10.20.193.10:0/1491654010 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 0x7f6898004d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6894009980 tx=0x7f689402ed10 comp rx=0 tx=0).stop 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1491654010 shutdown_connections 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 --2- 10.20.193.10:0/1491654010 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 0x7f6898004d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1491654010 >> 10.20.193.10:0/1491654010 conn(0x7f68ac0ce2b0 msgr2=0x7f68ac0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1491654010 shutdown_connections 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1491654010 wait complete. 2026-02-17T11:55:58.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 10 monclient(hunting): handle_auth_done global_id 4404 payload 824 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 1 -- 10.20.193.10:0/1248961327 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6fd8074cd0 msgr2=0x7f6fd80c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6fd8074cd0 0x7f6fd80c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 1 -- 10.20.193.10:0/1248961327 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6fd8156260 msgr2=0x7f6fd80c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6fd8156260 0x7f6fd80c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f6fd67fc640 1 -- 10.20.193.10:0/1248961327 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd80c80a0 con 0x7f6fd8155e80 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 10 monclient: monmap: 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 librados: starting msgr at 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 librados: starting objecter 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 Processor -- start 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 -- start start 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 librados: setting wanted keys 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 1 librados: calling monclient init 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.854+0000 7f68b0d1b640 10 monclient: init 2026-02-17T11:55:58.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f62b2575640 1 --2- 10.20.193.10:0/968095310 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b4155d70 0x7f62b4068e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f62b4072110 tx=0x7f62a802efe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4344cb1a25d24f1d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 0x7f68ac1472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient(hunting): picked mon.noname-c con 0x7f6898004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f68ac147820 0x7f68ac15e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient(hunting): picked mon.noname-b con 0x7f68ac147820 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f68ac15ed70 0x7f68ac144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient(hunting): picked mon.noname-a con 0x7f68ac15ed70 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac0c4870 con 0x7f68ac15ed70 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac0740a0 con 0x7f68ac147820 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac0c49f0 con 0x7f6898004900 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f68b0d1b640 10 monclient(hunting): authenticate will time out at 1028.577394s 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f14d3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f14d415a240 0x7f14d40c4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38188/0 (socket says 10.20.193.10:38188) 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f14d3fff640 1 -- 10.20.193.10:0/3587228391 learned_addr learned my addr 10.20.193.10:0/3587228391 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f14d3fff640 10 monclient(hunting): get_auth_request con 0x7f14d415a240 auth_method 0 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f14d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f14d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f14d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7f14d8816640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14d4163d50 0x7f14d41616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 1 -- 10.20.193.10:0/1454944431 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48047020 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 10 monclient: dump: 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 1 -- 10.20.193.10:0/1454944431 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd48042750 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd37fff640 1 -- 10.20.193.10:0/1454944431 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4803c040 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd62187640 5 monclient: authenticate success, global_id 4433 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd62187640 10 monclient: _renew_subs 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd59ffb640 4 set_mon_vals no callback set 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd62187640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.855+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5c140810 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd37fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd37fff640 10 monclient: dump: 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.905 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 1 -- 10.20.193.10:0/3401292489 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30047070 con 0x7f2a40156200 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 10 monclient: dump: 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 1 -- 10.20.193.10:0/3401292489 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a30003a90 con 0x7f2a40156200 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 1 -- 10.20.193.10:0/3401292489 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3003c040 con 0x7f2a40156200 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a26ffd640 10 monclient: dump: 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 5 monclient: authenticate success, global_id 4392 2026-02-17T11:55:58.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a3cd72640 4 set_mon_vals no callback set 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 10 monclient: _renew_subs 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4014e100 con 0x7f2a40156200 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 10 client.4392.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 10 monclient: _renew_subs 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4014ce00 con 0x7f2a40156200 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 1 librados: init done 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 10 client.4433.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 10 monclient: _renew_subs 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5c140dd0 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 1 librados: init done 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f14d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f14d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f14d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f14d8816640 10 monclient(hunting): get_auth_request con 0x7f14d4163d50 auth_method 0 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f14d8816640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f14d8816640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f14d8816640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 10 client.4392.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 15 client.4392.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 20 client.4392.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 10 client.4392.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a4014f9d0 con 0x7f2a40156200 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 10 client.4433.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 15 client.4433.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 20 client.4433.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 10 client.4433.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd5c0ccbc0 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f6412ffd640 1 -- 10.20.193.10:0/2989363302 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640403c070 con 0x7f6414074cd0 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f6412ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f6412ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f6412ffd640 10 monclient: dump: 2026-02-17T11:55:58.908 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f6412ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.856+0000 7f6412ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f6412ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f6412ffd640 1 -- 10.20.193.10:0/2989363302 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f640402fa50 con 0x7f6414074cd0 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 5 monclient: authenticate success, global_id 4450 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f6412ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f6412ffd640 1 -- 10.20.193.10:0/2989363302 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640402fe20 con 0x7f6414074cd0 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 4 set_mon_vals no callback set 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f6412ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f6412ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f6412ffd640 10 monclient: dump: 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 10 monclient: shutdown 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 1 -- 10.20.193.10:0/2989363302 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414074cd0 msgr2=0x7f64140ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 1 --2- 10.20.193.10:0/2989363302 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414074cd0 0x7f64140ccbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f641408f350 tx=0x7f640402ede0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 1 -- 10.20.193.10:0/2989363302 shutdown_connections 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 1 --2- 10.20.193.10:0/2989363302 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414074cd0 0x7f64140ccbc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 1 --2- 10.20.193.10:0/2989363302 >> v2:10.20.193.153:3300/0 conn(0x7f6414156260 0x7f64140cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 1 -- 10.20.193.10:0/2989363302 >> 10.20.193.10:0/2989363302 conn(0x7f64140ce2b0 msgr2=0x7f64140ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 1 -- 10.20.193.10:0/2989363302 shutdown_connections 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 1 -- 10.20.193.10:0/2989363302 wait complete. 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.857+0000 7f641a9ce640 10 monclient: monmap: 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 librados: starting msgr at 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 librados: starting objecter 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 Processor -- start 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 10 monclient(hunting): handle_auth_done global_id 4407 payload 824 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 1 -- 10.20.193.10:0/3587228391 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14d4163d50 msgr2=0x7f14d41616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14d4163d50 0x7f14d41616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 1 -- 10.20.193.10:0/3587228391 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14d4163970 msgr2=0x7f14d40c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14d4163970 0x7f14d40c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 1 monclient: found mon.noname-a 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f14d3fff640 1 -- 10.20.193.10:0/3587228391 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d414b8a0 con 0x7f14d415a240 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f6fd67fc640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6fd8155e80 0x7f6fd81e95c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0002410 tx=0x7f6fc00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f6faffff640 10 client.?.objecter ms_handle_connect 0x7f6fd8155e80 2026-02-17T11:55:58.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f6faffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 -- start start 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 librados: setting wanted keys 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 librados: calling monclient init 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient: init 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6414074cd0 0x7f6414156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient(hunting): picked mon.noname-c con 0x7f6414074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414155e80 0x7f6414147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient(hunting): picked mon.noname-b con 0x7f6414155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6414156260 0x7f6414158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient(hunting): picked mon.noname-a con 0x7f6414156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f64140c4870 con 0x7f6414156260 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64140740a0 con 0x7f6414155e80 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64140c49f0 con 0x7f6414074cd0 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.858+0000 7f641a9ce640 10 monclient(hunting): authenticate will time out at 1028.580761s 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 1 -- 10.20.193.10:0/2702160109 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c03c070 con 0x7f53a0155e80 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 10 monclient: dump: 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 1 -- 10.20.193.10:0/2702160109 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538c02fad0 con 0x7f53a0155e80 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 1 -- 10.20.193.10:0/2702160109 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c037440 con 0x7f53a0155e80 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 5 monclient: authenticate success, global_id 4447 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 4 set_mon_vals no callback set 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f539e7fc640 10 monclient: dump: 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 10 monclient: shutdown 2026-02-17T11:55:58.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 1 -- 10.20.193.10:0/2702160109 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53a0155e80 msgr2=0x7f53a00745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 1 --2- 10.20.193.10:0/2702160109 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53a0155e80 0x7f53a00745c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f538c0098a0 tx=0x7f538c02ee10 comp rx=0 tx=0).stop 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 1 -- 10.20.193.10:0/2702160109 shutdown_connections 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 1 --2- 10.20.193.10:0/2702160109 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53a0155e80 0x7f53a00745c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 1 -- 10.20.193.10:0/2702160109 >> 10.20.193.10:0/2702160109 conn(0x7f53a00ce2b0 msgr2=0x7f53a00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 1 -- 10.20.193.10:0/2702160109 shutdown_connections 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.860+0000 7f53a61fb640 1 -- 10.20.193.10:0/2702160109 wait complete. 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient: monmap: 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 librados: starting msgr at 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 librados: starting objecter 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 Processor -- start 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 -- start start 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 librados: setting wanted keys 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 librados: calling monclient init 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient: init 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53a00cd2d0 0x7f53a01e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient(hunting): picked mon.noname-c con 0x7f53a00cd2d0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53a0155e80 0x7f53a00c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient(hunting): picked mon.noname-b con 0x7f53a0155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f53a0156260 0x7f53a00c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient(hunting): picked mon.noname-a con 0x7f53a0156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f53a00c4870 con 0x7f53a0156260 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f53a00740a0 con 0x7f53a0155e80 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f53a00c49f0 con 0x7f53a00cd2d0 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.861+0000 7f53a61fb640 10 monclient(hunting): authenticate will time out at 1028.583963s 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 1 -- 10.20.193.10:0/1053702397 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929803c070 con 0x7f92ac155e80 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 10 monclient: dump: 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 1 -- 10.20.193.10:0/1053702397 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929802fb50 con 0x7f92ac155e80 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 1 -- 10.20.193.10:0/1053702397 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298037440 con 0x7f92ac155e80 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92b1fc1640 5 monclient: authenticate success, global_id 4453 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92b1fc1640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92b1fc1640 4 set_mon_vals no callback set 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.862+0000 7f92aa7fc640 10 monclient: dump: 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.914 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 10 monclient: shutdown 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 1 -- 10.20.193.10:0/1053702397 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac155e80 msgr2=0x7f92ac0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 1 --2- 10.20.193.10:0/1053702397 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac155e80 0x7f92ac0745c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92ac06cfa0 tx=0x7f929802ee90 comp rx=0 tx=0).stop 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 1 -- 10.20.193.10:0/968095310 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a803c070 con 0x7f62b4155d70 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 10 monclient: dump: 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 1 -- 10.20.193.10:0/968095310 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a802fc50 con 0x7f62b4155d70 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 1 -- 10.20.193.10:0/968095310 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8037460 con 0x7f62b4155d70 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b1573640 10 monclient: dump: 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.915 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 5 monclient: authenticate success, global_id 4459 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 1 -- 10.20.193.10:0/1053702397 shutdown_connections 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 1 --2- 10.20.193.10:0/1053702397 >> v2:10.20.193.153:3300/0 conn(0x7f92ac0ccbc0 0x7f92ac0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 1 --2- 10.20.193.10:0/1053702397 >> v2:10.20.193.10:3300/0 conn(0x7f92ac156260 0x7f92ac074b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 1 --2- 10.20.193.10:0/1053702397 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac155e80 0x7f92ac0745c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 1 -- 10.20.193.10:0/1053702397 >> 10.20.193.10:0/1053702397 conn(0x7f92ac0ce2b0 msgr2=0x7f92ac0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 4 set_mon_vals no callback set 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 1 -- 10.20.193.10:0/1053702397 shutdown_connections 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 1 -- 10.20.193.10:0/1053702397 wait complete. 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 1 -- 10.20.193.10:0/2067084973 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c03c070 con 0x7f2780156260 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 10 monclient: dump: 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.916 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 1 -- 10.20.193.10:0/2067084973 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c037440 con 0x7f2780156260 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 1 -- 10.20.193.10:0/2067084973 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c037810 con 0x7f2780156260 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27870f1640 5 monclient: authenticate success, global_id 4439 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27870f1640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27870f1640 4 set_mon_vals no callback set 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27777fe640 10 monclient: dump: 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 10 monclient: shutdown 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 1 -- 10.20.193.10:0/968095310 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b4155d70 msgr2=0x7f62b4068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 1 --2- 10.20.193.10:0/968095310 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b4155d70 0x7f62b4068e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f62b4072110 tx=0x7f62a802efe0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 1 -- 10.20.193.10:0/968095310 shutdown_connections 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 1 --2- 10.20.193.10:0/968095310 >> v2:10.20.193.153:3300/0 conn(0x7f62b40c9f90 0x7f62b415f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 1 --2- 10.20.193.10:0/968095310 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b4155d70 0x7f62b4068e60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 1 -- 10.20.193.10:0/968095310 >> 10.20.193.10:0/968095310 conn(0x7f62b4074090 msgr2=0x7f62b40744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 1 -- 10.20.193.10:0/1979605265 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84003c070 con 0x7fd844156260 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 10 monclient: dump: 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 1 -- 10.20.193.10:0/1979605265 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd840037440 con 0x7fd844156260 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 1 -- 10.20.193.10:0/1979605265 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840037810 con 0x7fd844156260 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd848db2640 10 monclient: dump: 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.918 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd84c03f640 5 monclient: authenticate success, global_id 4435 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd84c03f640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7fd84c03f640 4 set_mon_vals no callback set 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 1 -- 10.20.193.10:0/968095310 shutdown_connections 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f62b8cfc640 1 -- 10.20.193.10:0/968095310 wait complete. 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27870f1640 10 monclient: shutdown 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f92b1fc1640 10 monclient: monmap: 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.919 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27870f1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27870f1640 1 -- 10.20.193.10:0/2067084973 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780156260 msgr2=0x7f27800cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.863+0000 7f27870f1640 1 --2- 10.20.193.10:0/2067084973 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780156260 0x7f27800cd100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f278008f350 tx=0x7f277c02f1c0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f27870f1640 1 -- 10.20.193.10:0/2067084973 shutdown_connections 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f27870f1640 1 --2- 10.20.193.10:0/2067084973 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780156260 0x7f27800cd100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f27870f1640 1 --2- 10.20.193.10:0/2067084973 >> v2:10.20.193.10:3300/0 conn(0x7f2780074cd0 0x7f27800ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f27870f1640 1 -- 10.20.193.10:0/2067084973 >> 10.20.193.10:0/2067084973 conn(0x7f27800ce2b0 msgr2=0x7f27800ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f92b1fc1640 1 librados: starting msgr at 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f92b1fc1640 1 librados: starting objecter 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f27870f1640 1 -- 10.20.193.10:0/2067084973 shutdown_connections 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f27870f1640 1 -- 10.20.193.10:0/2067084973 wait complete. 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f62b8cfc640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f92b1fc1640 1 Processor -- start 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7fd84c03f640 10 monclient: shutdown 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7fd84c03f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7fd84c03f640 1 -- 10.20.193.10:0/1979605265 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd844156260 msgr2=0x7fd844166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7fd84c03f640 1 --2- 10.20.193.10:0/1979605265 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd844156260 0x7fd844166710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd840009d90 tx=0x7fd84002f230 comp rx=0 tx=0).stop 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f62b8cfc640 10 monclient: monmap: 2026-02-17T11:55:58.920 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f92b1fc1640 1 -- start start 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f92b1fc1640 1 librados: setting wanted keys 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f92b1fc1640 1 librados: calling monclient init 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f92b1fc1640 10 monclient: init 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f68aa575640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 0x7f68ac1472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f62b8cfc640 1 librados: starting msgr at 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f62b8cfc640 1 librados: starting objecter 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f27870f1640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f27870f1640 10 monclient: monmap: 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.921 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f62b8cfc640 1 Processor -- start 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f62b8cfc640 1 -- start start 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f62b8cfc640 1 librados: setting wanted keys 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f62b8cfc640 1 librados: calling monclient init 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.864+0000 7f62b8cfc640 10 monclient: init 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7fd84c03f640 1 -- 10.20.193.10:0/1979605265 shutdown_connections 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7fd84c03f640 1 --2- 10.20.193.10:0/1979605265 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd844156260 0x7fd844166710 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f68a9d74640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f68ac147820 0x7f68ac15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7fd84c03f640 1 -- 10.20.193.10:0/1979605265 >> 10.20.193.10:0/1979605265 conn(0x7fd8440ce2b0 msgr2=0x7fd8440ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92ac0ccbc0 0x7f92ac145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7fd84c03f640 1 -- 10.20.193.10:0/1979605265 shutdown_connections 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient(hunting): picked mon.noname-a con 0x7f92ac0ccbc0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7fd84c03f640 1 -- 10.20.193.10:0/1979605265 wait complete. 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 librados: starting msgr at 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 librados: starting objecter 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f92ac155e80 0x7f92ac1f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 Processor -- start 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient(hunting): picked mon.noname-c con 0x7f92ac155e80 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac156260 0x7f92ac1f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient(hunting): picked mon.noname-b con 0x7f92ac156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 -- start start 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 librados: setting wanted keys 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 librados: calling monclient init 2026-02-17T11:55:58.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient: init 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac0cd520 con 0x7f92ac0ccbc0 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac0740a0 con 0x7f92ac156260 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac0c4870 con 0x7f92ac155e80 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f92b1fc1640 10 monclient(hunting): authenticate will time out at 1028.587287s 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f68a9d74640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f68ac147820 0x7f68ac15e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:46996/0 (socket says 10.20.193.10:46996) 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f68a9d74640 1 -- 10.20.193.10:0/1064042678 learned_addr learned my addr 10.20.193.10:0/1064042678 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f68a9d74640 10 monclient(hunting): get_auth_request con 0x7f68ac147820 auth_method 0 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f68a9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f68a9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f68a9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f64137fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414155e80 0x7f6414147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b406e2d0 0x7f62b414be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient(hunting): picked mon.noname-b con 0x7f62b406e2d0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f62b40c9f90 0x7f62b40bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7fd84c03f640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7fd84c03f640 10 monclient: monmap: 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient(hunting): picked mon.noname-a con 0x7f62b40c9f90 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f62b4155d70 0x7f62b40c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780074cd0 0x7f27801f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient(hunting): picked mon.noname-c con 0x7f2780074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2780155e80 0x7f27801f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient(hunting): picked mon.noname-b con 0x7f2780155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2780156260 0x7f2780157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient(hunting): picked mon.noname-a con 0x7f2780156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f27800c4870 con 0x7f2780156260 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27800740a0 con 0x7f2780155e80 2026-02-17T11:55:58.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f27800c49f0 con 0x7f2780074cd0 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f27870f1640 10 monclient(hunting): authenticate will time out at 1028.587783s 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient(hunting): picked mon.noname-c con 0x7f62b4155d70 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f62b40c9360 con 0x7f62b40c9f90 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62b40c9080 con 0x7f62b406e2d0 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f62b406f290 con 0x7f62b4155d70 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7f62b8cfc640 10 monclient(hunting): authenticate will time out at 1028.587905s 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7fd84c03f640 1 librados: starting msgr at 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.865+0000 7fd84c03f640 1 librados: starting objecter 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 1 Processor -- start 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 1 -- start start 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7f68a9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7f68a9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7f68a9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 1 librados: setting wanted keys 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 1 librados: calling monclient init 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 10 monclient: init 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7f64137fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414155e80 0x7f6414147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47004/0 (socket says 10.20.193.10:47004) 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7f64137fe640 1 -- 10.20.193.10:0/3027232958 learned_addr learned my addr 10.20.193.10:0/3027232958 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7f64137fe640 10 monclient(hunting): get_auth_request con 0x7f6414155e80 auth_method 0 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7f64137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7f64137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7f64137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd844074cd0 0x7fd8441f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 10 monclient(hunting): picked mon.noname-a con 0x7fd844074cd0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd844155e80 0x7fd844140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 10 monclient(hunting): picked mon.noname-b con 0x7fd844155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.866+0000 7fd84c03f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd844156260 0x7fd8441f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.867+0000 7fd84c03f640 10 monclient(hunting): picked mon.noname-c con 0x7fd844156260 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.867+0000 7fd84c03f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.867+0000 7fd84c03f640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fd8440c4870 con 0x7fd844074cd0 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.867+0000 7fd84c03f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.867+0000 7fd84c03f640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd8440740a0 con 0x7fd844155e80 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.867+0000 7fd84c03f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.867+0000 7fd84c03f640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd8440c49f0 con 0x7fd844156260 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.867+0000 7fd84c03f640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.867+0000 7fd84c03f640 10 monclient(hunting): authenticate will time out at 1028.589265s 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 10 monclient(hunting): handle_auth_done global_id 4462 payload 824 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 1 -- 10.20.193.10:0/1064042678 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 msgr2=0x7f68ac1472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6898004900 0x7f68ac1472e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 1 -- 10.20.193.10:0/1064042678 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f68ac15ed70 msgr2=0x7f68ac144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f68ac15ed70 0x7f68ac144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f68a9d74640 1 -- 10.20.193.10:0/1064042678 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac15f1f0 con 0x7f68ac147820 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f64137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f64137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.868+0000 7f64137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 1 -- 10.20.193.10:0/2709079030 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b403c070 con 0x7f70cc0c9b70 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 10 monclient: dump: 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 1 -- 10.20.193.10:0/2709079030 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b402fb50 con 0x7f70cc0c9b70 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 1 -- 10.20.193.10:0/2709079030 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4037440 con 0x7f70cc0c9b70 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70c9ffb640 10 monclient: dump: 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 5 monclient: authenticate success, global_id 4456 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 4 set_mon_vals no callback set 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f68a9d74640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f68ac147820 0x7f68ac15e830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f689402ed50 tx=0x7f68940048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f6892ffd640 10 client.?.objecter ms_handle_connect 0x7f68ac147820 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f6892ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 10 monclient: shutdown 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 1 -- 10.20.193.10:0/2709079030 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f70cc0c9b70 msgr2=0x7f70cc1636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 1 --2- 10.20.193.10:0/2709079030 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f70cc0c9b70 0x7f70cc1636a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009890 tx=0x7f70b402ee90 comp rx=0 tx=0).stop 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 1 -- 10.20.193.10:0/2709079030 shutdown_connections 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 1 --2- 10.20.193.10:0/2709079030 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f70cc0c9b70 0x7f70cc1636a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 1 -- 10.20.193.10:0/2709079030 >> 10.20.193.10:0/2709079030 conn(0x7f70cc073070 msgr2=0x7f70cc073480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 1 -- 10.20.193.10:0/2709079030 shutdown_connections 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.869+0000 7f70d13e5640 1 -- 10.20.193.10:0/2709079030 wait complete. 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.870+0000 7f70d13e5640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.870+0000 7f70d13e5640 10 monclient: monmap: 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.930 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.870+0000 7f70d13e5640 1 librados: starting msgr at 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.870+0000 7f70d13e5640 1 librados: starting objecter 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.870+0000 7f70d13e5640 1 Processor -- start 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.870+0000 7f70d13e5640 1 -- start start 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.870+0000 7f70d13e5640 1 librados: setting wanted keys 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.870+0000 7f70d13e5640 1 librados: calling monclient init 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.870+0000 7f70d13e5640 10 monclient: init 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f70cc0c9b70 0x7f70cc1fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient(hunting): picked mon.noname-c con 0x7f70cc0c9b70 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f70cc0cd470 0x7f70cc1eea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient(hunting): picked mon.noname-a con 0x7f70cc0cd470 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f70cc15a2e0 0x7f70cc14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient(hunting): picked mon.noname-b con 0x7f70cc15a2e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc0c8f40 con 0x7f70cc0cd470 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc0c8c60 con 0x7f70cc15a2e0 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc08f8b0 con 0x7f70cc0c9b70 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f70d13e5640 10 monclient(hunting): authenticate will time out at 1028.593238s 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 10 monclient(hunting): handle_auth_done global_id 4465 payload 824 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 1 -- 10.20.193.10:0/3027232958 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6414074cd0 msgr2=0x7f6414156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6414074cd0 0x7f6414156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 1 -- 10.20.193.10:0/3027232958 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6414156260 msgr2=0x7f6414158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6414156260 0x7f6414158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7f64137fe640 1 -- 10.20.193.10:0/3027232958 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6414147b90 con 0x7f6414155e80 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.871+0000 7fbd37fff640 1 -- 10.20.193.10:0/1454944431 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fbd48042b40 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.872+0000 7fbd37fff640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbd2c078e80 0x7fbd2c07b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.872+0000 7fbd5affd640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbd2c078e80 0x7fbd2c07b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.872+0000 7fbd5affd640 10 monclient: get_auth_request con 0x7fbd2c078e80 auth_method 0 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.872+0000 7f2a26ffd640 1 -- 10.20.193.10:0/3401292489 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f2a30035670 con 0x7f2a40156200 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.872+0000 7fbd5affd640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbd2c078e80 0x7fbd2c07b340 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0cafe0 tx=0x7fbd4c006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.872+0000 7fbd37fff640 10 client.4433.objecter ms_handle_connect 0x7fbd2c078e80 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.872+0000 7f2a26ffd640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a0c078e50 0x7f2a0c07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f2a3e575640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a0c078e50 0x7f2a0c07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f2a3e575640 10 monclient: get_auth_request con 0x7f2a0c078e50 auth_method 0 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f2a26ffd640 10 client.4392.objecter ms_handle_connect 0x7f2a0c078e50 2026-02-17T11:55:58.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f2a3e575640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a0c078e50 0x7f2a0c07b310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a34007fd0 tx=0x7f2a34007b20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 1 -- 10.20.193.10:0/1454944431 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fbd48042e60 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 10 client.4433.objecter ms_dispatch2 0x7fbd5c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 3 client.4433.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 3 client.4433.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 10 client.4433.objecter checking command 1 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fbd2c0813c0 0x7fbd2c083800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 20 client.4433.objecter _get_session s=0x7fbd2c080cf0 osd=4 3 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 20 client.4433.objecter put_session s=0x7fbd2c080cf0 osd=4 3 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 15 client.4433.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 20 client.4433.objecter _get_session s=0x7fbd2c080cf0 osd=4 3 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 20 client.4433.objecter get_session s=0x7fbd2c080cf0 osd=4 3 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 15 client.4433.objecter _session_command_op_assign 4 1 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 20 client.4433.objecter put_session s=0x7fbd2c080cf0 osd=4 4 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 10 client.4433.objecter _send_command 1 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 1 -- 10.20.193.10:0/1454944431 --> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd48039ec0 con 0x7fbd2c0813c0 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 20 client.4433.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 1 -- 10.20.193.10:0/3762908829 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957403c070 con 0x7f9580155d60 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 10 monclient: dump: 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f62b2575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b406e2d0 0x7f62b414be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f95857a9640 5 monclient: authenticate success, global_id 4445 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f95857a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 1 -- 10.20.193.10:0/3762908829 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957402fb40 con 0x7f9580155d60 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 1 -- 10.20.193.10:0/1454944431 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbd48083e40 con 0x7fbd5c0cd2d0 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7fbd37fff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 1 -- 10.20.193.10:0/3762908829 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574037440 con 0x7f9580155d60 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f957dffb640 10 monclient: dump: 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f95857a9640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f95857a9640 4 set_mon_vals no callback set 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f64137fe640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414155e80 0x7f6414147650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6404009130 tx=0x7f64040047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.873+0000 7f6410ff9640 10 client.?.objecter ms_handle_connect 0x7f6414155e80 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f6410ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f92abfff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac156260 0x7f92ac1f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 10 monclient: shutdown 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7fbd5bfff640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fbd2c0813c0 0x7fbd2c083800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 1 -- 10.20.193.10:0/3762908829 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 msgr2=0x7f95800ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 1 --2- 10.20.193.10:0/3762908829 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 0x7f95800ccb40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9580074710 tx=0x7f957402eed0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 1 -- 10.20.193.10:0/3762908829 shutdown_connections 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 1 --2- 10.20.193.10:0/3762908829 >> v2:10.20.193.71:3300/0 conn(0x7f958006f560 0x7f958015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 1 --2- 10.20.193.10:0/3762908829 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 0x7f95800ccb40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 1 -- 10.20.193.10:0/3762908829 >> 10.20.193.10:0/3762908829 conn(0x7f95800cc020 msgr2=0x7f95800cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 1 -- 10.20.193.10:0/3762908829 shutdown_connections 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 1 -- 10.20.193.10:0/3762908829 wait complete. 2026-02-17T11:55:58.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7fbd5bfff640 10 monclient: get_auth_request con 0x7fbd2c0813c0 auth_method 0 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f62b2575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b406e2d0 0x7f62b414be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47020/0 (socket says 10.20.193.10:47020) 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f62b2575640 1 -- 10.20.193.10:0/1729113869 learned_addr learned my addr 10.20.193.10:0/1729113869 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f62b2575640 10 monclient(hunting): get_auth_request con 0x7f62b406e2d0 auth_method 0 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f62b2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f62b2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f62b2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f92abfff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac156260 0x7f92ac1f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47016/0 (socket says 10.20.193.10:47016) 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f92abfff640 1 -- 10.20.193.10:0/860503007 learned_addr learned my addr 10.20.193.10:0/860503007 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f92abfff640 10 monclient(hunting): get_auth_request con 0x7f92ac156260 auth_method 0 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f92abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f92abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f92abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f95857a9640 10 monclient: monmap: 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.874+0000 7f539effd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53a0155e80 0x7f53a00c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 librados: starting msgr at 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 librados: starting objecter 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 Processor -- start 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 -- start start 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 librados: setting wanted keys 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 librados: calling monclient init 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient: init 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f62b2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f539f7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53a00cd2d0 0x7f53a01e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f62b2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f62b2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 1 -- 10.20.193.10:0/3401292489 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f2a30083e90 con 0x7f2a40156200 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 10 client.4392.objecter ms_dispatch2 0x7f2a40000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f92abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f92abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 3 client.4392.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 3 client.4392.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f92abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 10 client.4392.objecter checking command 1 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f2a0c081390 0x7f2a0c0837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 20 client.4392.objecter _get_session s=0x7f2a0c080cc0 osd=2 3 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f539f7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53a00cd2d0 0x7f53a01e9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35570/0 (socket says 10.20.193.10:35570) 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f539f7fe640 1 -- 10.20.193.10:0/965146319 learned_addr learned my addr 10.20.193.10:0/965146319 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f539f7fe640 10 monclient(hunting): get_auth_request con 0x7f53a00cd2d0 auth_method 0 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f539f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f539f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f539f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 20 client.4392.objecter put_session s=0x7f2a0c080cc0 osd=2 3 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 15 client.4392.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f958006f560 0x7f958014df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient(hunting): picked mon.noname-b con 0x7f958006f560 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 0x7f95800ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient(hunting): picked mon.noname-c con 0x7f9580155d60 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f958015d5b0 0x7f95800ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient(hunting): picked mon.noname-a con 0x7f958015d5b0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f95800708f0 con 0x7f958015d5b0 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9580070610 con 0x7f958006f560 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95800cbd10 con 0x7f9580155d60 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 20 client.4392.objecter _get_session s=0x7f2a0c080cc0 osd=2 3 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 20 client.4392.objecter get_session s=0x7f2a0c080cc0 osd=2 3 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 15 client.4392.objecter _session_command_op_assign 2 1 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 20 client.4392.objecter put_session s=0x7f2a0c080cc0 osd=2 4 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 10 client.4392.objecter _send_command 1 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 1 -- 10.20.193.10:0/3401292489 --> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a0c083ea0 con 0x7f2a0c081390 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 20 client.4392.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 1 -- 10.20.193.10:0/3401292489 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2a30084250 con 0x7f2a40156200 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2a26ffd640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f95857a9640 10 monclient(hunting): authenticate will time out at 1028.597643s 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f14d3fff640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f14d415a240 0x7f14d40c4c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b5a0 tx=0x7f14c000ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f14d0ff9640 10 client.?.objecter ms_handle_connect 0x7f14d415a240 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f14d0ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.875+0000 7f2784e66640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780074cd0 0x7f27801f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2784e66640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780074cd0 0x7f27801f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35596/0 (socket says 10.20.193.10:35596) 2026-02-17T11:55:58.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2784e66640 1 -- 10.20.193.10:0/3638045022 learned_addr learned my addr 10.20.193.10:0/3638045022 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2a3dd74640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f2a0c081390 0x7f2a0c0837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2784e66640 10 monclient(hunting): get_auth_request con 0x7f2780074cd0 auth_method 0 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f539effd640 10 monclient(hunting): get_auth_request con 0x7f53a0155e80 auth_method 0 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f539effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f539effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f539effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2784e66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2784e66640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2784e66640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f539f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f539f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f539f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2a3dd74640 10 monclient: get_auth_request con 0x7f2a0c081390 auth_method 0 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f92356d5640 1 --2- 10.20.193.10:0/2022927321 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9230156260 0x7f9230074b00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f923006cfa0 tx=0x7f922402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf962faedbd3bb02 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7fbd37fff640 10 client.4433.objecter ms_handle_connect 0x7fbd2c0813c0 2026-02-17T11:55:58.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7fbd5bfff640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fbd2c0813c0 0x7fbd2c083800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2784e66640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2784e66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.876+0000 7f2784e66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 10 monclient(hunting): handle_auth_done global_id 4468 payload 824 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 1 -- 10.20.193.10:0/1729113869 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f62b4155d70 msgr2=0x7f62b40c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f62b4155d70 0x7f62b40c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 1 -- 10.20.193.10:0/1729113869 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f62b40c9f90 msgr2=0x7f62b40bfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f62b40c9f90 0x7f62b40bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.877+0000 7f62b2575640 1 -- 10.20.193.10:0/1729113869 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b414c3a0 con 0x7f62b406e2d0 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2a26ffd640 10 client.4392.objecter ms_handle_connect 0x7f2a0c081390 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2a3dd74640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f2a0c081390 0x7f2a0c0837d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 10 monclient(hunting): handle_auth_done global_id 4457 payload 824 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 1 -- 10.20.193.10:0/3638045022 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2780155e80 msgr2=0x7f27801f74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2780155e80 0x7f27801f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 1 -- 10.20.193.10:0/3638045022 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2780156260 msgr2=0x7f2780157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2780156260 0x7f2780157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.878+0000 7f2784e66640 1 -- 10.20.193.10:0/3638045022 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27800ca0b0 con 0x7f2780074cd0 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 10 monclient(hunting): handle_auth_done global_id 4471 payload 824 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 1 -- 10.20.193.10:0/860503007 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f92ac155e80 msgr2=0x7f92ac1f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f92ac155e80 0x7f92ac1f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 1 -- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92ac0ccbc0 msgr2=0x7f92ac145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92ac0ccbc0 0x7f92ac145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f539effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f539effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f539effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7f92abfff640 1 -- 10.20.193.10:0/860503007 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ac0c6690 con 0x7f92ac156260 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7fc1097fa640 1 -- 10.20.193.10:0/521462811 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11000cd30 con 0x7fc114156260 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7fc1097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7fc1097fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.879+0000 7fc1097fa640 10 monclient: dump: 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc1097fa640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc1097fa640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc1097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc1097fa640 1 -- 10.20.193.10:0/521462811 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc110003a90 con 0x7fc114156260 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc1097fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc1097fa640 1 -- 10.20.193.10:0/521462811 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110003e60 con 0x7fc114156260 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 5 monclient: authenticate success, global_id 4395 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc1097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc1097fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc10affd640 4 set_mon_vals no callback set 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc1097fa640 10 monclient: dump: 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 10 monclient: _renew_subs 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1140c8c60 con 0x7fc114156260 2026-02-17T11:55:58.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 10 client.4395.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 10 monclient: _renew_subs 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1140c9220 con 0x7fc114156260 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 1 librados: init done 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 10 monclient(hunting): handle_auth_done global_id 4454 payload 824 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 1 -- 10.20.193.10:0/965146319 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53a0155e80 msgr2=0x7f53a00c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f53a0155e80 0x7f53a00c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 1 -- 10.20.193.10:0/965146319 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f53a0156260 msgr2=0x7f53a00c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f53a0156260 0x7f53a00c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7f539f7fe640 1 -- 10.20.193.10:0/965146319 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a00c6ea0 con 0x7f53a00cd2d0 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 10 client.4395.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 15 client.4395.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 20 client.4395.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 10 client.4395.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.880+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1141f07e0 con 0x7fc114156260 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.881+0000 7f2784e66640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780074cd0 0x7f27801f5170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f277000c760 tx=0x7f277000cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.881+0000 7f27757fa640 10 client.?.objecter ms_handle_connect 0x7f2780074cd0 2026-02-17T11:55:58.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.881+0000 7f27757fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 1 -- 10.20.193.10:0/2005569912 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b402fd00 con 0x7f92b8156260 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 10 monclient: dump: 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 1 -- 10.20.193.10:0/2005569912 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b40373f0 con 0x7f92b8156260 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 1 -- 10.20.193.10:0/2005569912 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b40377c0 con 0x7f92b8156260 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92af7fe640 10 monclient: dump: 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92bf175640 5 monclient: authenticate success, global_id 4398 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92bf175640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f92bf175640 4 set_mon_vals no callback set 2026-02-17T11:55:58.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f539f7fe640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53a00cd2d0 0x7f53a01e9aa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f538c009130 tx=0x7f538c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f70caffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f70cc0c9b70 0x7f70cc1fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f537bfff640 10 client.?.objecter ms_handle_connect 0x7f53a00cd2d0 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f537bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 1 -- 10.20.193.10:0/1064042678 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894047020 con 0x7f68ac147820 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 10 monclient: dump: 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 1 -- 10.20.193.10:0/1064042678 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689403d040 con 0x7f68ac147820 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 1 -- 10.20.193.10:0/1064042678 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689403c050 con 0x7f68ac147820 2026-02-17T11:55:58.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f68b0d1b640 5 monclient: authenticate success, global_id 4462 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f68a8d72640 4 set_mon_vals no callback set 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f6892ffd640 10 monclient: dump: 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f68b0d1b640 10 monclient: _renew_subs 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f68b0d1b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.882+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ac1efd70 con 0x7f68ac147820 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 10 monclient: _renew_subs 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ac1f0330 con 0x7f68ac147820 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 1 -- 10.20.193.10:0/3587228391 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0012070 con 0x7f14d415a240 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 1 librados: init done 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 10 monclient: dump: 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.947 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 1 -- 10.20.193.10:0/3587228391 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c00044a0 con 0x7f14d415a240 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 1 -- 10.20.193.10:0/3587228391 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c00029c0 con 0x7f14d415a240 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 5 monclient: authenticate success, global_id 4407 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 10 monclient: _renew_subs 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d27fc640 4 set_mon_vals no callback set 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d40cc2a0 con 0x7f14d415a240 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 10 monclient: shutdown 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 1 -- 10.20.193.10:0/2005569912 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92b8156260 msgr2=0x7f92b8166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 1 --2- 10.20.193.10:0/2005569912 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92b8156260 0x7f92b8166710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009e50 tx=0x7f92b402f2a0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 1 -- 10.20.193.10:0/2005569912 shutdown_connections 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 1 --2- 10.20.193.10:0/2005569912 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92b8156260 0x7f92b8166710 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 1 -- 10.20.193.10:0/2005569912 >> 10.20.193.10:0/2005569912 conn(0x7f92b80ce2b0 msgr2=0x7f92b80ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 10 client.4407.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92abfff640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac156260 0x7f92ac1f5be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b970 tx=0x7f92a000be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f9287fff640 10 client.?.objecter ms_handle_connect 0x7f92ac156260 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f9287fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 1 -- 10.20.193.10:0/2005569912 shutdown_connections 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14d0ff9640 10 monclient: dump: 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 10 monclient: _renew_subs 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d40cc860 con 0x7f14d415a240 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 1 librados: init done 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f957e7fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 0x7f95800ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 10 client.4462.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 15 client.4462.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 20 client.4462.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68ac0745c0 con 0x7f68ac147820 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 1 -- 10.20.193.10:0/2005569912 wait complete. 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 10 monclient: monmap: 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f70caffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f70cc0c9b70 0x7f70cc1fc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35622/0 (socket says 10.20.193.10:35622) 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f70caffd640 1 -- 10.20.193.10:0/7085713 learned_addr learned my addr 10.20.193.10:0/7085713 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f70caffd640 10 monclient(hunting): get_auth_request con 0x7f70cc0c9b70 auth_method 0 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f70caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f70caffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f70caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 10 client.4407.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 1 librados: starting msgr at 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f92bf175640 1 librados: starting objecter 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 15 client.4407.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 20 client.4407.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 Processor -- start 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 -- start start 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 librados: setting wanted keys 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 librados: calling monclient init 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient: init 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 10 client.4407.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.883+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14d40c6e10 con 0x7f14d415a240 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f957e7fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 0x7f95800ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35636/0 (socket says 10.20.193.10:35636) 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f957e7fc640 1 -- 10.20.193.10:0/80305228 learned_addr learned my addr 10.20.193.10:0/80305228 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f957e7fc640 10 monclient(hunting): get_auth_request con 0x7f9580155d60 auth_method 0 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f957e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f957e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f957e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92b8074cd0 0x7f92b80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient(hunting): picked mon.noname-b con 0x7f92b8074cd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f92b8155e80 0x7f92b80cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient(hunting): picked mon.noname-c con 0x7f92b8155e80 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92b8156260 0x7f92b8154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient(hunting): picked mon.noname-a con 0x7f92b8156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f92b80c4870 con 0x7f92b8156260 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92b80740a0 con 0x7f92b8074cd0 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92b80c49f0 con 0x7f92b8155e80 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f92bf175640 10 monclient(hunting): authenticate will time out at 1028.606516s 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f70caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f70caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f70caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 1 -- 10.20.193.10:0/1248961327 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0046070 con 0x7f6fd8155e80 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 10 monclient: dump: 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.952 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 1 -- 10.20.193.10:0/1248961327 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc0041890 con 0x7f6fd8155e80 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 1 -- 10.20.193.10:0/1248961327 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc003c040 con 0x7f6fd8155e80 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fdd898640 5 monclient: authenticate success, global_id 4404 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fd57fa640 4 set_mon_vals no callback set 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6faffff640 10 monclient: dump: 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fdd898640 10 monclient: _renew_subs 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fdd898640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd80c8380 con 0x7f6fd8155e80 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fdd898640 10 client.4404.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fdd898640 10 monclient: _renew_subs 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fdd898640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd81f5610 con 0x7f6fd8155e80 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f6fdd898640 1 librados: init done 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f957e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f957e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.884+0000 7f957e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f62b2575640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b406e2d0 0x7f62b414be60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f62a8002410 tx=0x7f62a80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f629affd640 10 client.?.objecter ms_handle_connect 0x7f62b406e2d0 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f629affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f6fdd898640 10 client.4404.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f6fdd898640 15 client.4404.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f6fdd898640 20 client.4404.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f6fdd898640 10 client.4404.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f6fdd898640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fd80745c0 con 0x7f6fd8155e80 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 1 -- 10.20.193.10:0/2022927321 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922403c070 con 0x7f9230156260 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 10 monclient: dump: 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.954 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 1 -- 10.20.193.10:0/2022927321 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922402fb40 con 0x7f9230156260 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9238161640 5 monclient: authenticate success, global_id 4401 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9238161640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 1 -- 10.20.193.10:0/2022927321 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9224037440 con 0x7f9230156260 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9238161640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9238161640 4 set_mon_vals no callback set 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9234ed4640 10 monclient: dump: 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f70ca7fc640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f70cc0cd470 0x7f70cc1eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9238161640 10 monclient: shutdown 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.885+0000 7f9238161640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 -- 10.20.193.10:0/2022927321 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9230156260 msgr2=0x7f9230074b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 --2- 10.20.193.10:0/2022927321 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9230156260 0x7f9230074b00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f923006cfa0 tx=0x7f922402eed0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 -- 10.20.193.10:0/2022927321 shutdown_connections 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 --2- 10.20.193.10:0/2022927321 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9230156260 0x7f9230074b00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 --2- 10.20.193.10:0/2022927321 >> v2:10.20.193.71:3300/0 conn(0x7f9230155e80 0x7f92300745c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 -- 10.20.193.10:0/2022927321 >> 10.20.193.10:0/2022927321 conn(0x7f92300ce2b0 msgr2=0x7f92300ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f70ca7fc640 10 monclient(hunting): get_auth_request con 0x7f70cc0cd470 auth_method 0 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f70ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f70ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f70ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 -- 10.20.193.10:0/2022927321 shutdown_connections 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 -- 10.20.193.10:0/2022927321 wait complete. 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f70ca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f70ca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f70ca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 10 monclient: build_initial_monmap 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 10 monclient(hunting): handle_auth_done global_id 4463 payload 824 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 10 monclient: monmap: 2026-02-17T11:55:58.956 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 1 -- 10.20.193.10:0/80305228 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f958006f560 msgr2=0x7f958014df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f958006f560 0x7f958014df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 1 -- 10.20.193.10:0/80305228 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f958015d5b0 msgr2=0x7f95800ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f958015d5b0 0x7f95800ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f957e7fc640 1 -- 10.20.193.10:0/80305228 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95801f86e0 con 0x7f9580155d60 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 librados: starting msgr at 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 librados: starting objecter 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 Processor -- start 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 -- start start 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 librados: setting wanted keys 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 1 librados: calling monclient init 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7f9238161640 10 monclient: init 2026-02-17T11:55:58.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.886+0000 7fd84a5b5640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd844156260 0x7fd8441f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 1 -- 10.20.193.10:0/3027232958 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640403c040 con 0x7f6414155e80 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 10 monclient: dump: 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 1 -- 10.20.193.10:0/3027232958 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6404042630 con 0x7f6414155e80 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 1 -- 10.20.193.10:0/3027232958 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404042a20 con 0x7f6414155e80 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f6410ff9640 10 monclient: dump: 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.958 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f64127fc640 4 set_mon_vals no callback set 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 5 monclient: authenticate success, global_id 4465 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 10 monclient: _renew_subs 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64141e85d0 con 0x7f6414155e80 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 10 monclient: _renew_subs 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64141e8b90 con 0x7f6414155e80 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 1 librados: init done 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92300ccbc0 0x7f92301f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient(hunting): picked mon.noname-b con 0x7f92300ccbc0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9230155e80 0x7f92301f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient(hunting): picked mon.noname-a con 0x7f9230155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9230156260 0x7f92300c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient(hunting): picked mon.noname-c con 0x7f9230156260 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f92300c4870 con 0x7f9230155e80 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92300740a0 con 0x7f92300ccbc0 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92300c49f0 con 0x7f9230156260 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f9238161640 10 monclient(hunting): authenticate will time out at 1028.609428s 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 10 client.4465.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 15 client.4465.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 20 client.4465.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.887+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64141e8380 con 0x7f6414155e80 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 10 monclient(hunting): handle_auth_done global_id 4460 payload 824 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 1 -- 10.20.193.10:0/7085713 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f70cc15a2e0 msgr2=0x7f70cc14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f70cc15a2e0 0x7f70cc14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 1 -- 10.20.193.10:0/7085713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f70cc0cd470 msgr2=0x7f70cc1eea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f70cc0cd470 0x7f70cc1eea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f70caffd640 1 -- 10.20.193.10:0/7085713 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc1f9100 con 0x7f70cc0c9b70 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 1 -- 10.20.193.10:0/1729113869 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8044070 con 0x7f62b406e2d0 2026-02-17T11:55:58.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 10 monclient: dump: 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 1 -- 10.20.193.10:0/1729113869 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a8040410 con 0x7f62b406e2d0 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f62b0d72640 4 set_mon_vals no callback set 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 1 -- 10.20.193.10:0/1729113869 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a803c040 con 0x7f62b406e2d0 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f62b8cfc640 5 monclient: authenticate success, global_id 4468 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f62b8cfc640 10 monclient: _renew_subs 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f62b8cfc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b40bea50 con 0x7f62b406e2d0 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f629affd640 10 monclient: dump: 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f62b8cfc640 10 client.4468.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f62b8cfc640 10 monclient: _renew_subs 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f62b8cfc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.888+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b40bf010 con 0x7f62b406e2d0 2026-02-17T11:55:58.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7f62b8cfc640 1 librados: init done 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7fd8495b3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd844155e80 0x7fd844140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7fd849db4640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd844074cd0 0x7fd8441f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7f62b8cfc640 10 client.4468.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7f62b8cfc640 15 client.4468.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7f62b8cfc640 20 client.4468.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7f62b8cfc640 10 client.4468.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7f62b8cfc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f62b40be800 con 0x7f62b406e2d0 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7fd84a5b5640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd844156260 0x7fd8441f3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35618/0 (socket says 10.20.193.10:35618) 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7fd84a5b5640 1 -- 10.20.193.10:0/1744815795 learned_addr learned my addr 10.20.193.10:0/1744815795 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7fd84a5b5640 10 monclient(hunting): get_auth_request con 0x7fd844156260 auth_method 0 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7fd84a5b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7fd84a5b5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.889+0000 7fd84a5b5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.890+0000 7fd84a5b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.890+0000 7fd84a5b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.890+0000 7fd84a5b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.891+0000 7f957e7fc640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 0x7f95800ce640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f956800b530 tx=0x7f956800ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.891+0000 7f955f7fe640 10 client.?.objecter ms_handle_connect 0x7f9580155d60 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.891+0000 7f955f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 10 monclient(hunting): handle_auth_done global_id 4466 payload 824 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 1 -- 10.20.193.10:0/1744815795 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd844155e80 msgr2=0x7fd844140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd844155e80 0x7fd844140de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 1 -- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd844074cd0 msgr2=0x7fd8441f7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd844074cd0 0x7fd8441f7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7fd84a5b5640 1 -- 10.20.193.10:0/1744815795 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd844141320 con 0x7fd844156260 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7f70caffd640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f70cc0c9b70 0x7f70cc1fc3b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70c000b570 tx=0x7f70c000ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7f70ab7fe640 10 client.?.objecter ms_handle_connect 0x7f70cc0c9b70 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.892+0000 7f70ab7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 1 -- 10.20.193.10:0/3638045022 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770017070 con 0x7f2780074cd0 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 10 monclient: dump: 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.963 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 1 -- 10.20.193.10:0/3638045022 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2770005b90 con 0x7f2780074cd0 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 1 -- 10.20.193.10:0/3638045022 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770007070 con 0x7f2780074cd0 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27870f1640 5 monclient: authenticate success, global_id 4457 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27870f1640 10 monclient: _renew_subs 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f2776ffd640 4 set_mon_vals no callback set 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27870f1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27800ca390 con 0x7f2780074cd0 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.896+0000 7f27757fa640 10 monclient: dump: 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 10 client.4457.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 10 monclient: _renew_subs 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27800ca950 con 0x7f2780074cd0 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 1 librados: init done 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7fd84a5b5640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd844156260 0x7fd8441f3f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd84003a040 tx=0x7fd840004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7fd8327fc640 10 client.?.objecter ms_handle_connect 0x7fd844156260 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7fd8327fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 10 client.4457.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 15 client.4457.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 20 client.4457.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 10 client.4457.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.897+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27801491b0 con 0x7f2780074cd0 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9235ed6640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92300ccbc0 0x7f92301f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 1 -- 10.20.193.10:0/860503007 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a000c790 con 0x7f92ac156260 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 10 monclient: dump: 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 1 -- 10.20.193.10:0/860503007 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a0010070 con 0x7f92ac156260 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 1 -- 10.20.193.10:0/860503007 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a000cb90 con 0x7f92ac156260 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.898+0000 7f9287fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9287fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9287fff640 10 monclient: dump: 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92a9ffb640 4 set_mon_vals no callback set 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 5 monclient: authenticate success, global_id 4471 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 10 monclient: _renew_subs 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ac0c6970 con 0x7f92ac156260 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 10 monclient: _renew_subs 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ac0c6f30 con 0x7f92ac156260 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 1 librados: init done 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9235ed6640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92300ccbc0 0x7f92301f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47084/0 (socket says 10.20.193.10:47084) 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9235ed6640 1 -- 10.20.193.10:0/3543626693 learned_addr learned my addr 10.20.193.10:0/3543626693 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9235ed6640 10 monclient(hunting): get_auth_request con 0x7f92300ccbc0 auth_method 0 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9235ed6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9235ed6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9235ed6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 10 client.4471.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 15 client.4471.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 20 client.4471.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92ac0c4f90 con 0x7f92ac156260 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9235ed6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9235ed6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.899+0000 7f9235ed6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 10 monclient(hunting): handle_auth_done global_id 4477 payload 824 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 1 -- 10.20.193.10:0/3543626693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9230156260 msgr2=0x7f92300c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9230156260 0x7f92300c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 1 -- 10.20.193.10:0/3543626693 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9230155e80 msgr2=0x7f92301f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9230155e80 0x7f92301f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 1 monclient: found mon.noname-b 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f9235ed6640 1 -- 10.20.193.10:0/3543626693 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92301f53a0 con 0x7f92300ccbc0 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.901+0000 7f92bceea640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92b8074cd0 0x7f92b80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.902+0000 7f92bceea640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92b8074cd0 0x7f92b80c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47070/0 (socket says 10.20.193.10:47070) 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.902+0000 7f92bceea640 1 -- 10.20.193.10:0/493418506 learned_addr learned my addr 10.20.193.10:0/493418506 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.902+0000 7f92bceea640 10 monclient(hunting): get_auth_request con 0x7f92b8074cd0 auth_method 0 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.902+0000 7f92bceea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.902+0000 7f92bceea640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.902+0000 7f92bceea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 1 -- 10.20.193.10:0/7085713 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0013020 con 0x7f70cc0c9b70 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 10 monclient: dump: 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 1 -- 10.20.193.10:0/7085713 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c00044a0 con 0x7f70cc0c9b70 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70c97fa640 4 set_mon_vals no callback set 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 5 monclient: authenticate success, global_id 4460 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 10 monclient: _renew_subs 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 1 -- 10.20.193.10:0/7085713 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c00029c0 con 0x7f70cc0c9b70 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70cc14d700 con 0x7f70cc0c9b70 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70ab7fe640 10 monclient: dump: 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 10 client.4460.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 10 monclient: _renew_subs 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70cc14dcc0 con 0x7f70cc0c9b70 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 1 librados: init done 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f2a26ffd640 1 -- 10.20.193.10:0/3401292489 <== osd.2 v2:10.20.193.153:6816/4180566480 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f2a0c083ea0 con 0x7f2a0c081390 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f2a26ffd640 10 client.4392.objecter ms_dispatch2 0x7f2a40000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f2a26ffd640 10 client.4392.objecter _finish_command 1 = system:0 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f2a26ffd640 20 client.4392.objecter put_session s=0x7f2a0c080cc0 osd=2 4 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f2a26ffd640 15 client.4392.objecter _session_command_op_remove 2 1 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 10 client.4460.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 15 client.4460.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 20 client.4460.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 10 client.4460.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70cc1f93e0 con 0x7f70cc0c9b70 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f955f7fe640 1 -- 10.20.193.10:0/80305228 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568013020 con 0x7f9580155d60 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f955f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f955f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f955f7fe640 10 monclient: dump: 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.969 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f955f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f955f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.903+0000 7f955f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 5 monclient: authenticate success, global_id 4463 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f955f7fe640 1 -- 10.20.193.10:0/80305228 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9568004480 con 0x7f9580155d60 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f955f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 10 monclient: _renew_subs 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f955f7fe640 1 -- 10.20.193.10:0/80305228 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568002920 con 0x7f9580155d60 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f92affff640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f92b8155e80 0x7f92b80cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95801f43e0 con 0x7f9580155d60 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f957d7fa640 4 set_mon_vals no callback set 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f955f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f955f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f955f7fe640 10 monclient: dump: 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 10 monclient: _renew_subs 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95801f49a0 con 0x7f9580155d60 2026-02-17T11:55:58.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 1 librados: init done 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f92affff640 10 monclient(hunting): get_auth_request con 0x7f92b8155e80 auth_method 0 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f92affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f92affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f92affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 1 -- 10.20.193.10:0/965146319 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c046020 con 0x7f53a00cd2d0 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 10 monclient: dump: 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 1 -- 10.20.193.10:0/965146319 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538c0426e0 con 0x7f53a00cd2d0 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 1 -- 10.20.193.10:0/965146319 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c03c040 con 0x7f53a00cd2d0 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f53a61fb640 5 monclient: authenticate success, global_id 4454 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f53a61fb640 10 monclient: _renew_subs 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f53a61fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f539dffb640 4 set_mon_vals no callback set 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a00c7180 con 0x7f53a00cd2d0 2026-02-17T11:55:58.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f537bfff640 10 monclient: dump: 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f53a61fb640 10 client.4454.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f53a61fb640 10 monclient: _renew_subs 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f53a61fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a00c7740 con 0x7f53a00cd2d0 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f53a61fb640 1 librados: init done 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 10 client.4463.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 15 client.4463.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 20 client.4463.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.904+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9580156140 con 0x7f9580155d60 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.905+0000 7f92affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.905+0000 7f92affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.905+0000 7f92affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.905+0000 7f53a61fb640 10 client.4454.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.905+0000 7f53a61fb640 15 client.4454.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.905+0000 7f53a61fb640 20 client.4454.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.905+0000 7f53a61fb640 10 client.4454.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.905+0000 7f53a61fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.905+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53a00c7980 con 0x7f53a00cd2d0 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.909+0000 7fc1097fa640 1 -- 10.20.193.10:0/521462811 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc110004030 con 0x7fc114156260 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.909+0000 7fc1097fa640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc0e4078e50 0x7fc0e407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.909+0000 7fc118cd6640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc0e4078e50 0x7fc0e407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7fc118cd6640 10 monclient: get_auth_request con 0x7fc0e4078e50 auth_method 0 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7fc118cd6640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc0e4078e50 0x7fc0e407b310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc10400a8b0 tx=0x7fc104008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7fc1097fa640 10 client.4395.objecter ms_handle_connect 0x7fc0e4078e50 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 10 client.4392.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 15 client.4392.objecter _session_command_op_assign -1 2 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 20 client.4392.objecter _get_session s=0x7f2a0c080cc0 osd=2 3 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 20 client.4392.objecter put_session s=0x7f2a0c080cc0 osd=2 3 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 20 client.4392.objecter _get_session s=0x7f2a0c080cc0 osd=2 3 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 15 client.4392.objecter _session_command_op_remove -1 2 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 20 client.4392.objecter get_session s=0x7f2a0c080cc0 osd=2 3 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 15 client.4392.objecter _session_command_op_assign 2 2 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f6410ff9640 1 -- 10.20.193.10:0/3027232958 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6404042bc0 con 0x7f6414155e80 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 20 client.4392.objecter put_session s=0x7f2a0c080cc0 osd=2 4 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 10 client.4392.objecter _send_command 2 2026-02-17T11:55:58.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 --> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2a401565e0 con 0x7f2a0c081390 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f6410ff9640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f63e4078e50 0x7f63e407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f6413fff640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f63e4078e50 0x7f63e407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f6413fff640 10 monclient: get_auth_request con 0x7f63e4078e50 auth_method 0 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f6413fff640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f63e4078e50 0x7f63e407b310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6400006fd0 tx=0x7f6400006d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.910+0000 7f6410ff9640 10 client.4465.objecter ms_handle_connect 0x7f63e4078e50 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 10 monclient(hunting): handle_auth_done global_id 4469 payload 824 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 1 -- 10.20.193.10:0/493418506 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92b8074cd0 msgr2=0x7f92b80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92b8074cd0 0x7f92b80c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 1 -- 10.20.193.10:0/493418506 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92b8156260 msgr2=0x7f92b8154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f92b8156260 0x7f92b8154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 1 monclient: found mon.noname-c 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.911+0000 7f92affff640 1 -- 10.20.193.10:0/493418506 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b80c9fc0 con 0x7f92b8155e80 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 1 -- 10.20.193.10:0/521462811 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fc11005ee90 con 0x7fc114156260 2026-02-17T11:55:58.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 10 client.4395.objecter ms_dispatch2 0x7fc114000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 3 client.4395.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 3 client.4395.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 10 client.4395.objecter checking command 1 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7fc0e4081390 0x7fc0e40837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 20 client.4395.objecter _get_session s=0x7fc0e4080cc0 osd=7 3 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 20 client.4395.objecter put_session s=0x7fc0e4080cc0 osd=7 3 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 15 client.4395.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 20 client.4395.objecter _get_session s=0x7fc0e4080cc0 osd=7 3 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 20 client.4395.objecter get_session s=0x7fc0e4080cc0 osd=7 3 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 15 client.4395.objecter _session_command_op_assign 7 1 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 20 client.4395.objecter put_session s=0x7fc0e4080cc0 osd=7 4 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 10 client.4395.objecter _send_command 1 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 1 -- 10.20.193.10:0/521462811 --> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc110013e50 con 0x7fc0e4081390 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 20 client.4395.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 1 -- 10.20.193.10:0/521462811 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc11005f250 con 0x7fc114156260 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc1097fa640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 1 -- 10.20.193.10:0/3027232958 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f640402f910 con 0x7f6414155e80 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 10 client.4465.objecter ms_dispatch2 0x7f6414000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 3 client.4465.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 3 client.4465.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 10 client.4465.objecter checking command 1 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f63e4081390 0x7f63e40837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 20 client.4465.objecter _get_session s=0x7f63e4080cc0 osd=3 3 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 20 client.4465.objecter put_session s=0x7f63e4080cc0 osd=3 3 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 15 client.4465.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 20 client.4465.objecter _get_session s=0x7f63e4080cc0 osd=3 3 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 20 client.4465.objecter get_session s=0x7f63e4080cc0 osd=3 3 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 15 client.4465.objecter _session_command_op_assign 3 1 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 20 client.4465.objecter put_session s=0x7f63e4080cc0 osd=3 4 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 10 client.4465.objecter _send_command 1 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 1 -- 10.20.193.10:0/3027232958 --> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63e4083ea0 con 0x7f63e4081390 2026-02-17T11:55:58.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7f6410ff9640 20 client.4465.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc10bfff640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7fc0e4081390 0x7fc0e40837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.912+0000 7fc10bfff640 10 monclient: get_auth_request con 0x7fc0e4081390 auth_method 0 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7f6410ff9640 1 -- 10.20.193.10:0/3027232958 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6404083c90 con 0x7f6414155e80 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7f6410ff9640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7f6418f44640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f63e4081390 0x7f63e40837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7f6418f44640 10 monclient: get_auth_request con 0x7f63e4081390 auth_method 0 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7f9235ed6640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92300ccbc0 0x7f92301f4470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f922000b780 tx=0x7f922000bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7f921e7fc640 10 client.?.objecter ms_handle_connect 0x7f92300ccbc0 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7f921e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7fbd37fff640 1 -- 10.20.193.10:0/1454944431 <== osd.4 v2:10.20.193.10:6810/4049638616 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fbd48039ec0 con 0x7fbd2c0813c0 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7fbd37fff640 10 client.4433.objecter ms_dispatch2 0x7fbd5c000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7fbd37fff640 10 client.4433.objecter _finish_command 1 = system:0 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7fbd37fff640 20 client.4433.objecter put_session s=0x7fbd2c080cf0 osd=4 4 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.913+0000 7fbd37fff640 15 client.4433.objecter _session_command_op_remove 4 1 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a26ffd640 1 -- 10.20.193.10:0/3401292489 <== osd.2 v2:10.20.193.153:6816/4180566480 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2a401565e0 con 0x7f2a0c081390 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a26ffd640 10 client.4392.objecter ms_dispatch2 0x7f2a40000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a26ffd640 10 client.4392.objecter _finish_command 2 = system:0 2026-02-17T11:55:58.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a26ffd640 20 client.4392.objecter put_session s=0x7f2a0c080cc0 osd=2 4 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a26ffd640 15 client.4392.objecter _session_command_op_remove 2 2 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 10 librados: watch_flush enter 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 10 librados: watch_flush exit 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 10 client.4392.objecter close_session for osd.2 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f2a0c081390 msgr2=0x7f2a0c0837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f2a0c081390 0x7f2a0c0837d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 20 client.4392.objecter put_session s=0x7f2a0c080cc0 osd=2 1 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 20 client.4392.objecter shutdown clearing up homeless session... 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 10 client.4392.objecter successfully canceled tick 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a0c078e50 msgr2=0x7f2a0c07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a0c078e50 0x7f2a0c07b310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a34007fd0 tx=0x7f2a34007b20 comp rx=0 tx=0).stop 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 10 monclient: shutdown 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a40156200 msgr2=0x7f2a4015b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 --2- 10.20.193.10:0/3401292489 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a40156200 0x7f2a4015b700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009d90 tx=0x7f2a30004b40 comp rx=0 tx=0).stop 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a3ed76640 1 -- 10.20.193.10:0/3401292489 reap_dead start 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 shutdown_connections 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 >> 10.20.193.10:0/3401292489 conn(0x7f2a400cbf50 msgr2=0x7f2a40152000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 shutdown_connections 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 -- 10.20.193.10:0/3401292489 wait complete. 2026-02-17T11:55:58.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.914+0000 7f2a44a2c640 1 librados: shutdown 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.915+0000 7fc1097fa640 10 client.4395.objecter ms_handle_connect 0x7fc0e4081390 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.915+0000 7fc10bfff640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7fc0e4081390 0x7fc0e40837d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.915+0000 7f6410ff9640 10 client.4465.objecter ms_handle_connect 0x7f63e4081390 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.915+0000 7f6418f44640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f63e4081390 0x7f63e40837d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.918+0000 7f27757fa640 1 -- 10.20.193.10:0/3638045022 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f2770007210 con 0x7f2780074cd0 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.919+0000 7f27757fa640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2758078e50 0x7f275807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.919+0000 7f2777fff640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2758078e50 0x7f275807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.919+0000 7f2777fff640 10 monclient: get_auth_request con 0x7f2758078e50 auth_method 0 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.919+0000 7f14d0ff9640 1 -- 10.20.193.10:0/3587228391 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f14c000d460 con 0x7f14d415a240 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.919+0000 7f2777fff640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2758078e50 0x7f275807b310 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27800ccc40 tx=0x7f2768006d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.919+0000 7f27757fa640 10 client.4457.objecter ms_handle_connect 0x7f2758078e50 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f14d0ff9640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f14a4078e80 0x7f14a407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 10 client.4433.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:58.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 15 client.4433.objecter _session_command_op_assign -1 2 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 20 client.4433.objecter _get_session s=0x7fbd2c080cf0 osd=4 3 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 20 client.4433.objecter put_session s=0x7fbd2c080cf0 osd=4 3 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 20 client.4433.objecter _get_session s=0x7fbd2c080cf0 osd=4 3 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 15 client.4433.objecter _session_command_op_remove -1 2 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 20 client.4433.objecter get_session s=0x7fbd2c080cf0 osd=4 3 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 15 client.4433.objecter _session_command_op_assign 4 2 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 20 client.4433.objecter put_session s=0x7fbd2c080cf0 osd=4 4 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 10 client.4433.objecter _send_command 2 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 1 -- 10.20.193.10:0/3638045022 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f277005d710 con 0x7f2780074cd0 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 10 client.4457.objecter ms_dispatch2 0x7f2780000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 --> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd5c1597b0 con 0x7fbd2c0813c0 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 3 client.4457.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 3 client.4457.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f14d37fe640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f14a4078e80 0x7f14a407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f14d37fe640 10 monclient: get_auth_request con 0x7f14a4078e80 auth_method 0 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 10 client.4457.objecter checking command 1 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7f27580813f0 0x7f2758083830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 20 client.4457.objecter _get_session s=0x7f2758080d20 osd=6 3 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 20 client.4457.objecter put_session s=0x7f2758080d20 osd=6 3 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 15 client.4457.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 20 client.4457.objecter _get_session s=0x7f2758080d20 osd=6 3 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 20 client.4457.objecter get_session s=0x7f2758080d20 osd=6 3 2026-02-17T11:55:58.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 15 client.4457.objecter _session_command_op_assign 6 1 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 20 client.4457.objecter put_session s=0x7f2758080d20 osd=6 4 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 10 client.4457.objecter _send_command 1 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 1 -- 10.20.193.10:0/3638045022 --> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2758083f00 con 0x7f27580813f0 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 20 client.4457.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f14d0ff9640 10 client.4407.objecter ms_handle_connect 0x7f14a4078e80 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f14d37fe640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f14a4078e80 0x7f14a407b340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f14c4006fd0 tx=0x7f14c4006d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 1 -- 10.20.193.10:0/1744815795 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84003c050 con 0x7fd844156260 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 10 monclient: dump: 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 1 -- 10.20.193.10:0/1744815795 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd840048070 con 0x7fd844156260 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 1 -- 10.20.193.10:0/1744815795 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840035e10 con 0x7fd844156260 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd84c03f640 5 monclient: authenticate success, global_id 4466 2026-02-17T11:55:58.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd84c03f640 10 monclient: _renew_subs 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd833fff640 4 set_mon_vals no callback set 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd84c03f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8441f4b10 con 0x7fd844156260 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd8327fc640 10 monclient: dump: 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 1 -- 10.20.193.10:0/3638045022 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f277005dad0 con 0x7f2780074cd0 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f27757fa640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd84c03f640 10 client.4466.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd84c03f640 10 monclient: _renew_subs 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd84c03f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd844153b20 con 0x7fd844156260 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7fd84c03f640 1 librados: init done 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.920+0000 7f2785667640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7f27580813f0 0x7f2758083830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7f2785667640 10 monclient: get_auth_request con 0x7f27580813f0 auth_method 0 2026-02-17T11:55:58.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7fd84c03f640 10 client.4466.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7fd84c03f640 15 client.4466.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7fd84c03f640 20 client.4466.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7fd84c03f640 10 client.4466.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7fd84c03f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:58.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8441f4df0 con 0x7fd844156260 2026-02-17T11:55:58.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7f6892ffd640 1 -- 10.20.193.10:0/1064042678 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6894054070 con 0x7f68ac147820 2026-02-17T11:55:58.982 INFO:teuthology.orchestra.run.trial010.stdout:98784247813 2026-02-17T11:55:58.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7f6892ffd640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6878078e50 0x7f687807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.983 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:55:58.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7f68aa575640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6878078e50 0x7f687807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.921+0000 7f68aa575640 10 monclient: get_auth_request con 0x7f6878078e50 auth_method 0 2026-02-17T11:55:58.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.922+0000 7f68aa575640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6878078e50 0x7f687807b310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68a0007b70 tx=0x7f68a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.922+0000 7f6892ffd640 10 client.4462.objecter ms_handle_connect 0x7f6878078e50 2026-02-17T11:55:58.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f27757fa640 10 client.4457.objecter ms_handle_connect 0x7f27580813f0 2026-02-17T11:55:58.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f2785667640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7f27580813f0 0x7f2758083830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 1 -- 10.20.193.10:0/3587228391 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f14c0004650 con 0x7f14d415a240 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 10 client.4407.objecter ms_dispatch2 0x7f14d4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 3 client.4407.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 3 client.4407.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 10 client.4407.objecter checking command 1 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 0x7f14a4083800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 20 client.4407.objecter _get_session s=0x7f14a4080cf0 osd=8 3 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 20 client.4407.objecter put_session s=0x7f14a4080cf0 osd=8 3 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 15 client.4407.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 20 client.4407.objecter _get_session s=0x7f14a4080cf0 osd=8 3 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 20 client.4407.objecter get_session s=0x7f14a4080cf0 osd=8 3 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 15 client.4407.objecter _session_command_op_assign 8 1 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 20 client.4407.objecter put_session s=0x7f14a4080cf0 osd=8 4 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 10 client.4407.objecter _send_command 1 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 1 -- 10.20.193.10:0/3587228391 --> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14c0018e50 con 0x7f14a40813c0 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 20 client.4407.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 1 -- 10.20.193.10:0/3587228391 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f14c005dec0 con 0x7f14d415a240 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d0ff9640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.923+0000 7f14d8816640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 0x7f14a4083800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f14d8816640 10 monclient: get_auth_request con 0x7f14a40813c0 auth_method 0 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 1 -- 10.20.193.10:0/1064042678 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f689402f630 con 0x7f68ac147820 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 10 client.4462.objecter ms_dispatch2 0x7f68ac000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 3 client.4462.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 3 client.4462.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 10 client.4462.objecter checking command 1 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f6878081390 0x7f68780837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 20 client.4462.objecter _get_session s=0x7f6878080cc0 osd=14 3 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 20 client.4462.objecter put_session s=0x7f6878080cc0 osd=14 3 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 15 client.4462.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 20 client.4462.objecter _get_session s=0x7f6878080cc0 osd=14 3 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 20 client.4462.objecter get_session s=0x7f6878080cc0 osd=14 3 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 15 client.4462.objecter _session_command_op_assign 14 1 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 20 client.4462.objecter put_session s=0x7f6878080cc0 osd=14 4 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 10 client.4462.objecter _send_command 1 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 1 -- 10.20.193.10:0/1064042678 --> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6878083ea0 con 0x7f6878081390 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f6892ffd640 20 client.4462.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f14d8816640 1 -- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 msgr2=0x7f14a4083800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f14d8816640 1 -- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 msgr2=0x7f14a4083800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f14d8816640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 0x7f14a4083800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.924+0000 7f14d8816640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 0x7f14a4083800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.925+0000 7f6892ffd640 1 -- 10.20.193.10:0/1064042678 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6894082dd0 con 0x7f68ac147820 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.925+0000 7f6892ffd640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7f68aad76640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f6878081390 0x7f68780837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd37fff640 1 -- 10.20.193.10:0/1454944431 <== osd.4 v2:10.20.193.10:6810/4049638616 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbd5c1597b0 con 0x7fbd2c0813c0 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd37fff640 10 client.4433.objecter ms_dispatch2 0x7fbd5c000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd37fff640 10 client.4433.objecter _finish_command 2 = system:0 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd37fff640 20 client.4433.objecter put_session s=0x7fbd2c080cf0 osd=4 4 2026-02-17T11:55:58.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd37fff640 15 client.4433.objecter _session_command_op_remove 4 2 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7f68aad76640 10 monclient: get_auth_request con 0x7f6878081390 auth_method 0 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 10 librados: watch_flush enter 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 10 librados: watch_flush exit 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 10 client.4433.objecter close_session for osd.4 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fbd2c0813c0 msgr2=0x7fbd2c083800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fbd2c0813c0 0x7fbd2c083800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 20 client.4433.objecter put_session s=0x7fbd2c080cf0 osd=4 1 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 20 client.4433.objecter shutdown clearing up homeless session... 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 10 client.4433.objecter successfully canceled tick 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbd2c078e80 msgr2=0x7fbd2c07b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbd2c078e80 0x7fbd2c07b340 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0cafe0 tx=0x7fbd4c006ca0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 10 monclient: shutdown 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbd5c0cd2d0 msgr2=0x7fbd5c1f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 --2- 10.20.193.10:0/1454944431 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbd5c0cd2d0 0x7fbd5c1f5360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd480099d0 tx=0x7fbd480047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd5bfff640 1 -- 10.20.193.10:0/1454944431 reap_dead start 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 shutdown_connections 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 >> 10.20.193.10:0/1454944431 conn(0x7fbd5c0ce2b0 msgr2=0x7fbd5c0d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 shutdown_connections 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 -- 10.20.193.10:0/1454944431 wait complete. 2026-02-17T11:55:58.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.926+0000 7fbd62187640 1 librados: shutdown 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.927+0000 7f955f7fe640 1 -- 10.20.193.10:0/80305228 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f956800f460 con 0x7f9580155d60 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.928+0000 7f955f7fe640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f954c078e50 0x7f954c07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.928+0000 7f957effd640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f954c078e50 0x7f954c07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.928+0000 7f957effd640 10 monclient: get_auth_request con 0x7f954c078e50 auth_method 0 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.928+0000 7f957effd640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f954c078e50 0x7f954c07b310 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f958006a200 tx=0x7f9574031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.928+0000 7f955f7fe640 10 client.4463.objecter ms_handle_connect 0x7f954c078e50 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f6892ffd640 10 client.4462.objecter ms_handle_connect 0x7f6878081390 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f68aad76640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f6878081390 0x7f68780837d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 1 -- 10.20.193.10:0/80305228 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f956800c250 con 0x7f9580155d60 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 10 client.4463.objecter ms_dispatch2 0x7f9580000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 3 client.4463.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 3 client.4463.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 10 client.4463.objecter checking command 1 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7f954c081390 0x7f954c0837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 20 client.4463.objecter _get_session s=0x7f954c080cc0 osd=5 3 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 20 client.4463.objecter put_session s=0x7f954c080cc0 osd=5 3 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 15 client.4463.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 20 client.4463.objecter _get_session s=0x7f954c080cc0 osd=5 3 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 20 client.4463.objecter get_session s=0x7f954c080cc0 osd=5 3 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 15 client.4463.objecter _session_command_op_assign 5 1 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 20 client.4463.objecter put_session s=0x7f954c080cc0 osd=5 4 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 10 client.4463.objecter _send_command 1 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 1 -- 10.20.193.10:0/80305228 --> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f954c083ea0 con 0x7f954c081390 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 20 client.4463.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f92affff640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f92b8155e80 0x7f92b80cc320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b550 tx=0x7f92a000ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f92ad7fa640 10 client.?.objecter ms_handle_connect 0x7f92b8155e80 2026-02-17T11:55:58.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f92ad7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:58.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 1 -- 10.20.193.10:0/80305228 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f956805e3e0 con 0x7f9580155d60 2026-02-17T11:55:58.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f955f7fe640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.929+0000 7f957f7fe640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7f954c081390 0x7f954c0837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.930+0000 7f957f7fe640 10 monclient: get_auth_request con 0x7f954c081390 auth_method 0 2026-02-17T11:55:58.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.931+0000 7f957f7fe640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7f954c081390 0x7f954c0837d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.931+0000 7f955f7fe640 10 client.4463.objecter ms_handle_connect 0x7f954c081390 2026-02-17T11:55:58.988 INFO:teuthology.orchestra.run.trial010.stdout:115964117000 2026-02-17T11:55:58.988 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.938+0000 7f9287fff640 1 -- 10.20.193.10:0/860503007 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f92a001d030 con 0x7f92ac156260 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.938+0000 7f9287fff640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f927c078e50 0x7f927c07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.938+0000 7f92ab7fe640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f927c078e50 0x7f927c07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.938+0000 7f92ab7fe640 10 monclient: get_auth_request con 0x7f927c078e50 auth_method 0 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.938+0000 7f92ab7fe640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f927c078e50 0x7f927c07b310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f92ac08f5e0 tx=0x7f9298031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.938+0000 7f9287fff640 10 client.4471.objecter ms_handle_connect 0x7f927c078e50 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.939+0000 7fc1097fa640 1 -- 10.20.193.10:0/521462811 <== osd.7 v2:10.20.193.174:6808/561251262 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc110013e50 con 0x7fc0e4081390 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.939+0000 7fc1097fa640 10 client.4395.objecter ms_dispatch2 0x7fc114000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.939+0000 7fc1097fa640 10 client.4395.objecter _finish_command 1 = system:0 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.939+0000 7fc1097fa640 20 client.4395.objecter put_session s=0x7fc0e4080cc0 osd=7 4 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.939+0000 7fc1097fa640 15 client.4395.objecter _session_command_op_remove 7 1 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.939+0000 7f6faffff640 1 -- 10.20.193.10:0/1248961327 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6fc0041c80 con 0x7f6fd8155e80 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.940+0000 7f6faffff640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6fa8078e50 0x7f6fa807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.940+0000 7f6fd6ffd640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6fa8078e50 0x7f6fa807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.940+0000 7f6fd6ffd640 10 monclient: get_auth_request con 0x7f6fa8078e50 auth_method 0 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.940+0000 7f6fd6ffd640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6fa8078e50 0x7f6fa807b310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc006fd0 tx=0x7f6fcc006d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.940+0000 7f6faffff640 10 client.4404.objecter ms_handle_connect 0x7f6fa8078e50 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 1 -- 10.20.193.10:0/860503007 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f92a001ddf0 con 0x7f92ac156260 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 10 client.4471.objecter ms_dispatch2 0x7f92ac000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 3 client.4471.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 3 client.4471.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 10 client.4471.objecter checking command 1 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7f927c081390 0x7f927c0837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 20 client.4471.objecter _get_session s=0x7f927c080cc0 osd=12 3 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 20 client.4471.objecter put_session s=0x7f927c080cc0 osd=12 3 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 15 client.4471.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 20 client.4471.objecter _get_session s=0x7f927c080cc0 osd=12 3 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 20 client.4471.objecter get_session s=0x7f927c080cc0 osd=12 3 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 15 client.4471.objecter _session_command_op_assign 12 1 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 20 client.4471.objecter put_session s=0x7f927c080cc0 osd=12 4 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 10 client.4471.objecter _send_command 1 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 1 -- 10.20.193.10:0/860503007 --> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f927c083ea0 con 0x7f927c081390 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f9287fff640 20 client.4471.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f92aaffd640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7f927c081390 0x7f927c0837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.941+0000 7f92aaffd640 10 monclient: get_auth_request con 0x7f927c081390 auth_method 0 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 1 -- 10.20.193.10:0/1248961327 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f6fc002fa40 con 0x7f6fd8155e80 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 10 client.4404.objecter ms_dispatch2 0x7f6fd8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 3 client.4404.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 3 client.4404.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 10 client.4404.objecter checking command 1 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7f6fa8081390 0x7f6fa80837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 20 client.4404.objecter _get_session s=0x7f6fa8080cc0 osd=11 3 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 20 client.4404.objecter put_session s=0x7f6fa8080cc0 osd=11 3 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 15 client.4404.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 20 client.4404.objecter _get_session s=0x7f6fa8080cc0 osd=11 3 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 20 client.4404.objecter get_session s=0x7f6fa8080cc0 osd=11 3 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 15 client.4404.objecter _session_command_op_assign 11 1 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 20 client.4404.objecter put_session s=0x7f6fa8080cc0 osd=11 4 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 10 client.4404.objecter _send_command 1 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 1 -- 10.20.193.10:0/1248961327 --> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fc0051ec0 con 0x7f6fa8081390 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.942+0000 7f6faffff640 20 client.4404.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.943+0000 7f6faffff640 1 -- 10.20.193.10:0/1248961327 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6fc0083e70 con 0x7f6fd8155e80 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.943+0000 7f6faffff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.943+0000 7f6fd77fe640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7f6fa8081390 0x7f6fa80837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.943+0000 7f6fd77fe640 10 monclient: get_auth_request con 0x7f6fa8081390 auth_method 0 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.943+0000 7f9287fff640 10 client.4471.objecter ms_handle_connect 0x7f927c081390 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.943+0000 7f92aaffd640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7f927c081390 0x7f927c0837d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.944+0000 7f9287fff640 1 -- 10.20.193.10:0/860503007 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f92a005dde0 con 0x7f92ac156260 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.944+0000 7f9287fff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.944+0000 7f921e7fc640 1 -- 10.20.193.10:0/3543626693 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220004480 con 0x7f92300ccbc0 2026-02-17T11:55:58.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 10 monclient: dump: 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 1 -- 10.20.193.10:0/3543626693 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9220010070 con 0x7f92300ccbc0 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 1 -- 10.20.193.10:0/3543626693 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220002920 con 0x7f92300ccbc0 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 5 monclient: authenticate success, global_id 4477 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921ffff640 4 set_mon_vals no callback set 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 10 monclient: _renew_subs 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923014cdf0 con 0x7f92300ccbc0 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f921e7fc640 10 monclient: dump: 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 10 client.4477.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 10 monclient: _renew_subs 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f923014d3b0 con 0x7f92300ccbc0 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 1 librados: init done 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 10 client.4477.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:58.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 15 client.4477.objecter _session_command_op_assign -1 1 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 20 client.4477.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 10 client.4477.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.945+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92300c8700 con 0x7f92300ccbc0 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7f6fd77fe640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7f6fa8081390 0x7f6fa80837d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7f6faffff640 10 client.4404.objecter ms_handle_connect 0x7f6fa8081390 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 10 client.4395.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 15 client.4395.objecter _session_command_op_assign -1 2 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 20 client.4395.objecter _get_session s=0x7fc0e4080cc0 osd=7 3 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 20 client.4395.objecter put_session s=0x7fc0e4080cc0 osd=7 3 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 20 client.4395.objecter _get_session s=0x7fc0e4080cc0 osd=7 3 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 15 client.4395.objecter _session_command_op_remove -1 2 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 20 client.4395.objecter get_session s=0x7fc0e4080cc0 osd=7 3 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 15 client.4395.objecter _session_command_op_assign 7 2 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 20 client.4395.objecter put_session s=0x7fc0e4080cc0 osd=7 4 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 10 client.4395.objecter _send_command 2 2026-02-17T11:55:58.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 --> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1140ccfe0 con 0x7fc0e4081390 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7f537bfff640 1 -- 10.20.193.10:0/965146319 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f538c03f030 con 0x7f53a00cd2d0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7f537bfff640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5370078e50 0x7f537007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7f539effd640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5370078e50 0x7f537007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.946+0000 7f539effd640 10 monclient: get_auth_request con 0x7f5370078e50 auth_method 0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.947+0000 7f537bfff640 10 client.4454.objecter ms_handle_connect 0x7f5370078e50 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.947+0000 7f539effd640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5370078e50 0x7f537007b310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f53a0159340 tx=0x7f5390009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 1 -- 10.20.193.10:0/965146319 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f538c0834a0 con 0x7f53a00cd2d0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 10 client.4454.objecter ms_dispatch2 0x7f53a0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 3 client.4454.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 3 client.4454.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 10 client.4454.objecter checking command 1 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f5370081390 0x7f53700837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 20 client.4454.objecter _get_session s=0x7f5370080cc0 osd=13 3 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 20 client.4454.objecter put_session s=0x7f5370080cc0 osd=13 3 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 15 client.4454.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 20 client.4454.objecter _get_session s=0x7f5370080cc0 osd=13 3 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 20 client.4454.objecter get_session s=0x7f5370080cc0 osd=13 3 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 15 client.4454.objecter _session_command_op_assign 13 1 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 20 client.4454.objecter put_session s=0x7f5370080cc0 osd=13 4 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 10 client.4454.objecter _send_command 1 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 1 -- 10.20.193.10:0/965146319 --> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f538c036ec0 con 0x7f5370081390 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 20 client.4454.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 1 -- 10.20.193.10:0/965146319 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f538c083860 con 0x7f53a00cd2d0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f537bfff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f6410ff9640 1 -- 10.20.193.10:0/3027232958 <== osd.3 v2:10.20.193.174:6816/2117394394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f63e4083ea0 con 0x7f63e4081390 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f6410ff9640 10 client.4465.objecter ms_dispatch2 0x7f6414000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f6410ff9640 10 client.4465.objecter _finish_command 1 = system:0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f6410ff9640 20 client.4465.objecter put_session s=0x7f63e4080cc0 osd=3 4 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f6410ff9640 15 client.4465.objecter _session_command_op_remove 3 1 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f539ffff640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f5370081390 0x7f53700837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.949+0000 7f539ffff640 10 monclient: get_auth_request con 0x7f5370081390 auth_method 0 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.952+0000 7f537bfff640 10 client.4454.objecter ms_handle_connect 0x7f5370081390 2026-02-17T11:55:58.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.952+0000 7f539ffff640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f5370081390 0x7f53700837d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.953+0000 7f629affd640 1 -- 10.20.193.10:0/1729113869 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f62a803f050 con 0x7f62b406e2d0 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.954+0000 7f629affd640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6280078e00 0x7f628007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.954+0000 7f62b1d74640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6280078e00 0x7f628007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.954+0000 7f62b1d74640 10 monclient: get_auth_request con 0x7f6280078e00 auth_method 0 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.954+0000 7f629affd640 10 client.4468.objecter ms_handle_connect 0x7f6280078e00 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.954+0000 7f62b1d74640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6280078e00 0x7f628007b2c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f62b41eeb30 tx=0x7f629c006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 10 client.4465.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 15 client.4465.objecter _session_command_op_assign -1 2 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 20 client.4465.objecter _get_session s=0x7f63e4080cc0 osd=3 3 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 20 client.4465.objecter put_session s=0x7f63e4080cc0 osd=3 3 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 20 client.4465.objecter _get_session s=0x7f63e4080cc0 osd=3 3 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 15 client.4465.objecter _session_command_op_remove -1 2 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 20 client.4465.objecter get_session s=0x7f63e4080cc0 osd=3 3 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fd8327fc640 1 -- 10.20.193.10:0/1744815795 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fd84004d460 con 0x7fd844156260 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 15 client.4465.objecter _session_command_op_assign 3 2 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 20 client.4465.objecter put_session s=0x7f63e4080cc0 osd=3 4 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 10 client.4465.objecter _send_command 2 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 --> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64140745c0 con 0x7f63e4081390 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc1097fa640 1 -- 10.20.193.10:0/521462811 <== osd.7 v2:10.20.193.174:6808/561251262 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc1140ccfe0 con 0x7fc0e4081390 2026-02-17T11:55:58.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc1097fa640 10 client.4395.objecter ms_dispatch2 0x7fc114000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc1097fa640 10 client.4395.objecter _finish_command 2 = system:0 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc1097fa640 20 client.4395.objecter put_session s=0x7fc0e4080cc0 osd=7 4 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc1097fa640 15 client.4395.objecter _session_command_op_remove 7 2 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 10 librados: watch_flush enter 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 10 librados: watch_flush exit 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 10 client.4395.objecter close_session for osd.7 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7fc0e4081390 msgr2=0x7fc0e40837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7fc0e4081390 0x7fc0e40837d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 20 client.4395.objecter put_session s=0x7fc0e4080cc0 osd=7 1 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 20 client.4395.objecter shutdown clearing up homeless session... 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 10 client.4395.objecter successfully canceled tick 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc0e4078e50 msgr2=0x7fc0e407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc0e4078e50 0x7fc0e407b310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc10400a8b0 tx=0x7fc104008040 comp rx=0 tx=0).stop 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 10 monclient: shutdown 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc114156260 msgr2=0x7fc1141ef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 1 --2- 10.20.193.10:0/521462811 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc114156260 0x7fc1141ef8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc11000efc0 tx=0x7fc11000c490 comp rx=0 tx=0).stop 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc1194d7640 1 -- 10.20.193.10:0/521462811 reap_dead start 2026-02-17T11:55:58.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fd8327fc640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd814078e50 0x7fd81407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 shutdown_connections 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 >> 10.20.193.10:0/521462811 conn(0x7fc1140ce2b0 msgr2=0x7fc114150c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.956+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 shutdown_connections 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.957+0000 7fc11af61640 1 -- 10.20.193.10:0/521462811 wait complete. 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.957+0000 7fd849db4640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd814078e50 0x7fd81407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.957+0000 7fd849db4640 10 monclient: get_auth_request con 0x7fd814078e50 auth_method 0 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.957+0000 7fc11af61640 1 librados: shutdown 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.957+0000 7fd849db4640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd814078e50 0x7fd81407b310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd834002770 tx=0x7fd834009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.957+0000 7fd8327fc640 10 client.4466.objecter ms_handle_connect 0x7fd814078e50 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 1 -- 10.20.193.10:0/1744815795 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fd8400027c0 con 0x7fd844156260 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 10 client.4466.objecter ms_dispatch2 0x7fd844000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 3 client.4466.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 3 client.4466.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 10 client.4466.objecter checking command 1 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7fd814081390 0x7fd8140837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 20 client.4466.objecter _get_session s=0x7fd814080cc0 osd=0 3 2026-02-17T11:55:58.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 20 client.4466.objecter put_session s=0x7fd814080cc0 osd=0 3 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 15 client.4466.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 20 client.4466.objecter _get_session s=0x7fd814080cc0 osd=0 3 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 20 client.4466.objecter get_session s=0x7fd814080cc0 osd=0 3 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 15 client.4466.objecter _session_command_op_assign 0 1 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 20 client.4466.objecter put_session s=0x7fd814080cc0 osd=0 4 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 10 client.4466.objecter _send_command 1 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 1 -- 10.20.193.10:0/1744815795 --> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8400038c0 con 0x7fd814081390 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 20 client.4466.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 1 -- 10.20.193.10:0/1744815795 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd8400849a0 con 0x7fd844156260 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8327fc640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.958+0000 7fd8495b3640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7fd814081390 0x7fd8140837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.959+0000 7fd8495b3640 10 monclient: get_auth_request con 0x7fd814081390 auth_method 0 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 1 -- 10.20.193.10:0/1729113869 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f62a80bc5b0 con 0x7f62b406e2d0 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 10 client.4468.objecter ms_dispatch2 0x7f62b4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 3 client.4468.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 3 client.4468.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 10 client.4468.objecter checking command 1 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7f6280081340 0x7f6280083780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 20 client.4468.objecter _get_session s=0x7f6280080c70 osd=10 3 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 20 client.4468.objecter put_session s=0x7f6280080c70 osd=10 3 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 15 client.4468.objecter _session_command_op_remove -1 1 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 20 client.4468.objecter _get_session s=0x7f6280080c70 osd=10 3 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 20 client.4468.objecter get_session s=0x7f6280080c70 osd=10 3 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 15 client.4468.objecter _session_command_op_assign 10 1 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 20 client.4468.objecter put_session s=0x7f6280080c70 osd=10 4 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 10 client.4468.objecter _send_command 1 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 1 -- 10.20.193.10:0/1729113869 --> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62a804ee80 con 0x7f6280081340 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 20 client.4468.objecter dump_active .. 0 homeless 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 1 -- 10.20.193.10:0/1729113869 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f62a80832a0 con 0x7f62b406e2d0 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f629affd640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7fd8495b3640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7fd814081390 0x7fd8140837d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:58.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7fd8327fc640 10 client.4466.objecter ms_handle_connect 0x7fd814081390 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f62b2d76640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7f6280081340 0x7f6280083780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f6410ff9640 1 -- 10.20.193.10:0/3027232958 <== osd.3 v2:10.20.193.174:6816/2117394394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f64140745c0 con 0x7f63e4081390 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f6410ff9640 10 client.4465.objecter ms_dispatch2 0x7f6414000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f6410ff9640 10 client.4465.objecter _finish_command 2 = system:0 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f6410ff9640 20 client.4465.objecter put_session s=0x7f63e4080cc0 osd=3 4 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f6410ff9640 15 client.4465.objecter _session_command_op_remove 3 2 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.961+0000 7f62b2d76640 10 monclient: get_auth_request con 0x7f6280081340 auth_method 0 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 10 librados: watch_flush enter 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 10 librados: watch_flush exit 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 10 client.4465.objecter close_session for osd.3 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f63e4081390 msgr2=0x7f63e40837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:58.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f63e4081390 0x7f63e40837d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 20 client.4465.objecter put_session s=0x7f63e4080cc0 osd=3 1 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 20 client.4465.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 10 client.4465.objecter successfully canceled tick 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f63e4078e50 msgr2=0x7f63e407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f63e4078e50 0x7f63e407b310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6400006fd0 tx=0x7f6400006d40 comp rx=0 tx=0).stop 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 10 monclient: shutdown 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414155e80 msgr2=0x7f6414147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 --2- 10.20.193.10:0/3027232958 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6414155e80 0x7f6414147650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6404009130 tx=0x7f64040047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f6418f44640 1 -- 10.20.193.10:0/3027232958 reap_dead start 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 shutdown_connections 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 >> 10.20.193.10:0/3027232958 conn(0x7f64140ce2b0 msgr2=0x7f64140cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 shutdown_connections 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 -- 10.20.193.10:0/3027232958 wait complete. 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f641a9ce640 1 librados: shutdown 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f6892ffd640 1 -- 10.20.193.10:0/1064042678 <== osd.14 v2:10.20.193.153:6808/3794015163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6878083ea0 con 0x7f6878081390 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f6892ffd640 10 client.4462.objecter ms_dispatch2 0x7f68ac000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f6892ffd640 10 client.4462.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f6892ffd640 20 client.4462.objecter put_session s=0x7f6878080cc0 osd=14 4 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.962+0000 7f6892ffd640 15 client.4462.objecter _session_command_op_remove 14 1 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 1 -- 10.20.193.10:0/493418506 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0004500 con 0x7f92b8155e80 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 10 monclient: dump: 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.000 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 1 -- 10.20.193.10:0/493418506 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a0015070 con 0x7f92b8155e80 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 1 -- 10.20.193.10:0/493418506 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a00029c0 con 0x7f92b8155e80 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92ad7fa640 10 monclient: dump: 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92aeffd640 4 set_mon_vals no callback set 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 5 monclient: authenticate success, global_id 4469 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 10 monclient: _renew_subs 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b80ca2a0 con 0x7f92b8155e80 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 10 monclient: _renew_subs 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b80ca860 con 0x7f92b8155e80 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 1 librados: init done 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.963+0000 7f92bf175640 10 client.4469.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f92bf175640 15 client.4469.objecter _session_command_op_assign -1 1 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f92bf175640 20 client.4469.objecter _get_session osd=-1 returning homeless 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f92bf175640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f92bf175640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92b80745c0 con 0x7f92b8155e80 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f629affd640 10 client.4468.objecter ms_handle_connect 0x7f6280081340 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f62b2d76640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7f6280081340 0x7f6280083780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stdout:103079215110 2026-02-17T11:55:59.002 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f27757fa640 1 -- 10.20.193.10:0/3638045022 <== osd.6 v2:10.20.193.153:6824/3203696878 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f2758083f00 con 0x7f27580813f0 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f27757fa640 10 client.4457.objecter ms_dispatch2 0x7f2780000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f27757fa640 10 client.4457.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f27757fa640 20 client.4457.objecter put_session s=0x7f2758080d20 osd=6 4 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.964+0000 7f27757fa640 15 client.4457.objecter _session_command_op_remove 6 1 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.965+0000 7f955f7fe640 1 -- 10.20.193.10:0/80305228 <== osd.5 v2:10.20.193.71:6816/1474787626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f954c083ea0 con 0x7f954c081390 2026-02-17T11:55:59.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.965+0000 7f955f7fe640 10 client.4463.objecter ms_dispatch2 0x7f9580000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.965+0000 7f955f7fe640 10 client.4463.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.965+0000 7f955f7fe640 20 client.4463.objecter put_session s=0x7f954c080cc0 osd=5 4 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.965+0000 7f955f7fe640 15 client.4463.objecter _session_command_op_remove 5 1 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.967+0000 7f6faffff640 1 -- 10.20.193.10:0/1248961327 <== osd.11 v2:10.20.193.174:6800/4034633078 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6fc0051ec0 con 0x7f6fa8081390 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.967+0000 7f6faffff640 10 client.4404.objecter ms_dispatch2 0x7f6fd8000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.967+0000 7f6faffff640 10 client.4404.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.967+0000 7f6faffff640 20 client.4404.objecter put_session s=0x7f6fa8080cc0 osd=11 4 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.967+0000 7f6faffff640 15 client.4404.objecter _session_command_op_remove 11 1 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f921e7fc640 1 -- 10.20.193.10:0/3543626693 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f922001d030 con 0x7f92300ccbc0 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 10 client.4462.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 15 client.4462.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 20 client.4462.objecter _get_session s=0x7f6878080cc0 osd=14 3 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 20 client.4462.objecter put_session s=0x7f6878080cc0 osd=14 3 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 20 client.4462.objecter _get_session s=0x7f6878080cc0 osd=14 3 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 15 client.4462.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 20 client.4462.objecter get_session s=0x7f6878080cc0 osd=14 3 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 15 client.4462.objecter _session_command_op_assign 14 2 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 20 client.4462.objecter put_session s=0x7f6878080cc0 osd=14 4 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 10 client.4462.objecter _send_command 2 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 --> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68ac0cb810 con 0x7f6878081390 2026-02-17T11:55:59.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f921e7fc640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9200078e80 0x7f920007b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stdout:124554051590 2026-02-17T11:55:59.004 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f92356d5640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9200078e80 0x7f920007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f92356d5640 10 monclient: get_auth_request con 0x7f9200078e80 auth_method 0 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f921e7fc640 10 client.4477.objecter ms_handle_connect 0x7f9200078e80 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f92356d5640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9200078e80 0x7f920007b340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f923008f350 tx=0x7f9224031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f9287fff640 1 -- 10.20.193.10:0/860503007 <== osd.12 v2:10.20.193.10:6802/2920105256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f927c083ea0 con 0x7f927c081390 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f9287fff640 10 client.4471.objecter ms_dispatch2 0x7f92ac000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f9287fff640 10 client.4471.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f9287fff640 20 client.4471.objecter put_session s=0x7f927c080cc0 osd=12 4 2026-02-17T11:55:59.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.969+0000 7f9287fff640 15 client.4471.objecter _session_command_op_remove 12 1 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 1 -- 10.20.193.10:0/3543626693 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f922005d4a0 con 0x7f92300ccbc0 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 10 client.4477.objecter ms_dispatch2 0x7f9230000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 3 client.4477.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 3 client.4477.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 10 client.4477.objecter checking command 1 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7f92000813c0 0x7f9200083800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 20 client.4477.objecter _get_session s=0x7f9200080cf0 osd=9 3 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 20 client.4477.objecter put_session s=0x7f9200080cf0 osd=9 3 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 15 client.4477.objecter _session_command_op_remove -1 1 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 20 client.4477.objecter _get_session s=0x7f9200080cf0 osd=9 3 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 20 client.4477.objecter get_session s=0x7f9200080cf0 osd=9 3 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 15 client.4477.objecter _session_command_op_assign 9 1 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 20 client.4477.objecter put_session s=0x7f9200080cf0 osd=9 4 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 10 client.4477.objecter _send_command 1 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 1 -- 10.20.193.10:0/3543626693 --> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9220022ec0 con 0x7f92000813c0 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.970+0000 7f921e7fc640 20 client.4477.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f921e7fc640 1 -- 10.20.193.10:0/3543626693 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f922005d860 con 0x7f92300ccbc0 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f921e7fc640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f70ab7fe640 1 -- 10.20.193.10:0/7085713 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f70c000f460 con 0x7f70cc0c9b70 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f92366d7640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7f92000813c0 0x7f9200083800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f70ab7fe640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7098078e50 0x7f709807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f92366d7640 10 monclient: get_auth_request con 0x7f92000813c0 auth_method 0 2026-02-17T11:55:59.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f70ca7fc640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7098078e50 0x7f709807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f70ca7fc640 10 monclient: get_auth_request con 0x7f7098078e50 auth_method 0 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 10 client.4457.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 15 client.4457.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 20 client.4457.objecter _get_session s=0x7f2758080d20 osd=6 3 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 20 client.4457.objecter put_session s=0x7f2758080d20 osd=6 3 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 20 client.4457.objecter _get_session s=0x7f2758080d20 osd=6 3 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 15 client.4457.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 20 client.4457.objecter get_session s=0x7f2758080d20 osd=6 3 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 15 client.4457.objecter _session_command_op_assign 6 2 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 20 client.4457.objecter put_session s=0x7f2758080d20 osd=6 4 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 10 client.4457.objecter _send_command 2 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.971+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 --> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27801597b0 con 0x7f27580813f0 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ca7fc640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7098078e50 0x7f709807b310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f70b4039000 tx=0x7f70b4033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 10 client.4460.objecter ms_handle_connect 0x7f7098078e50 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 1 -- 10.20.193.10:0/7085713 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f70c005e040 con 0x7f70cc0c9b70 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 10 client.4460.objecter ms_dispatch2 0x7f70cc000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 3 client.4460.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 3 client.4460.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 10 client.4460.objecter checking command 1 2026-02-17T11:55:59.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7f7098081390 0x7f70980837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 20 client.4460.objecter _get_session s=0x7f7098080cc0 osd=1 3 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 20 client.4460.objecter put_session s=0x7f7098080cc0 osd=1 3 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 15 client.4460.objecter _session_command_op_remove -1 1 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 20 client.4460.objecter _get_session s=0x7f7098080cc0 osd=1 3 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 20 client.4460.objecter get_session s=0x7f7098080cc0 osd=1 3 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 15 client.4460.objecter _session_command_op_assign 1 1 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 20 client.4460.objecter put_session s=0x7f7098080cc0 osd=1 4 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 10 client.4460.objecter _send_command 1 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 1 -- 10.20.193.10:0/7085713 --> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70c0023ec0 con 0x7f7098081390 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 20 client.4460.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 1 -- 10.20.193.10:0/7085713 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f70c005e400 con 0x7f70cc0c9b70 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f70ab7fe640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 10 client.4463.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 15 client.4463.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 20 client.4463.objecter _get_session s=0x7f954c080cc0 osd=5 3 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 20 client.4463.objecter put_session s=0x7f954c080cc0 osd=5 3 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 20 client.4463.objecter _get_session s=0x7f954c080cc0 osd=5 3 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 15 client.4463.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 20 client.4463.objecter get_session s=0x7f954c080cc0 osd=5 3 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 15 client.4463.objecter _session_command_op_assign 5 2 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 20 client.4463.objecter put_session s=0x7f954c080cc0 osd=5 4 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 10 client.4463.objecter _send_command 2 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.972+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 --> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9580159800 con 0x7f954c081390 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.973+0000 7f70cb7fe640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7f7098081390 0x7f70980837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.973+0000 7f70cb7fe640 10 monclient: get_auth_request con 0x7f7098081390 auth_method 0 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.973+0000 7f92366d7640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7f92000813c0 0x7f9200083800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.973+0000 7f921e7fc640 10 client.4477.objecter ms_handle_connect 0x7f92000813c0 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 10 client.4404.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 15 client.4404.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 20 client.4404.objecter _get_session s=0x7f6fa8080cc0 osd=11 3 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 20 client.4404.objecter put_session s=0x7f6fa8080cc0 osd=11 3 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 20 client.4404.objecter _get_session s=0x7f6fa8080cc0 osd=11 3 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 15 client.4404.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 20 client.4404.objecter get_session s=0x7f6fa8080cc0 osd=11 3 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 15 client.4404.objecter _session_command_op_assign 11 2 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 20 client.4404.objecter put_session s=0x7f6fa8080cc0 osd=11 4 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 10 client.4404.objecter _send_command 2 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 --> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6fd81597b0 con 0x7f6fa8081390 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6892ffd640 1 -- 10.20.193.10:0/1064042678 <== osd.14 v2:10.20.193.153:6808/3794015163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f68ac0cb810 con 0x7f6878081390 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6892ffd640 10 client.4462.objecter ms_dispatch2 0x7f68ac000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6892ffd640 10 client.4462.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6892ffd640 20 client.4462.objecter put_session s=0x7f6878080cc0 osd=14 4 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f6892ffd640 15 client.4462.objecter _session_command_op_remove 14 2 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f70cb7fe640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7f7098081390 0x7f70980837d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f70ab7fe640 10 client.4460.objecter ms_handle_connect 0x7f7098081390 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 10 librados: watch_flush enter 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 10 librados: watch_flush exit 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 10 client.4462.objecter close_session for osd.14 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f6878081390 msgr2=0x7f68780837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f6878081390 0x7f68780837d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 20 client.4462.objecter put_session s=0x7f6878080cc0 osd=14 1 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 20 client.4462.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 10 client.4462.objecter successfully canceled tick 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6878078e50 msgr2=0x7f687807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6878078e50 0x7f687807b310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68a0007b70 tx=0x7f68a0009040 comp rx=0 tx=0).stop 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 10 monclient: shutdown 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f68ac147820 msgr2=0x7f68ac15e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 --2- 10.20.193.10:0/1064042678 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f68ac147820 0x7f68ac15e830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f689402ed50 tx=0x7f68940048d0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68aad76640 1 -- 10.20.193.10:0/1064042678 reap_dead start 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 shutdown_connections 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 >> 10.20.193.10:0/1064042678 conn(0x7f68ac0ce2b0 msgr2=0x7f68ac151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 shutdown_connections 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 -- 10.20.193.10:0/1064042678 wait complete. 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.975+0000 7f68b0d1b640 1 librados: shutdown 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 10 client.4471.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 15 client.4471.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 20 client.4471.objecter _get_session s=0x7f927c080cc0 osd=12 3 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 20 client.4471.objecter put_session s=0x7f927c080cc0 osd=12 3 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 20 client.4471.objecter _get_session s=0x7f927c080cc0 osd=12 3 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 15 client.4471.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 20 client.4471.objecter get_session s=0x7f927c080cc0 osd=12 3 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 15 client.4471.objecter _session_command_op_assign 12 2 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 20 client.4471.objecter put_session s=0x7f927c080cc0 osd=12 4 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 10 client.4471.objecter _send_command 2 2026-02-17T11:55:59.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.976+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 --> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92ac0cbe80 con 0x7f927c081390 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27757fa640 1 -- 10.20.193.10:0/3638045022 <== osd.6 v2:10.20.193.153:6824/3203696878 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f27801597b0 con 0x7f27580813f0 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27757fa640 10 client.4457.objecter ms_dispatch2 0x7f2780000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27757fa640 10 client.4457.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27757fa640 20 client.4457.objecter put_session s=0x7f2758080d20 osd=6 4 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27757fa640 15 client.4457.objecter _session_command_op_remove 6 2 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 10 librados: watch_flush enter 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 10 librados: watch_flush exit 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 10 client.4457.objecter close_session for osd.6 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7f27580813f0 msgr2=0x7f2758083830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7f27580813f0 0x7f2758083830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 20 client.4457.objecter put_session s=0x7f2758080d20 osd=6 1 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 20 client.4457.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 10 client.4457.objecter successfully canceled tick 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2758078e50 msgr2=0x7f275807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2758078e50 0x7f275807b310 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27800ccc40 tx=0x7f2768006d90 comp rx=0 tx=0).stop 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 10 monclient: shutdown 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780074cd0 msgr2=0x7f27801f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 --2- 10.20.193.10:0/3638045022 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2780074cd0 0x7f27801f5170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f277000c760 tx=0x7f277000cc30 comp rx=0 tx=0).stop 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f2785667640 1 -- 10.20.193.10:0/3638045022 reap_dead start 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 shutdown_connections 2026-02-17T11:55:59.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 >> 10.20.193.10:0/3638045022 conn(0x7f27800ce2b0 msgr2=0x7f27800ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 shutdown_connections 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.977+0000 7f27870f1640 1 -- 10.20.193.10:0/3638045022 wait complete. 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.978+0000 7f27870f1640 1 librados: shutdown 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f955f7fe640 1 -- 10.20.193.10:0/80305228 <== osd.5 v2:10.20.193.71:6816/1474787626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9580159800 con 0x7f954c081390 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f955f7fe640 10 client.4463.objecter ms_dispatch2 0x7f9580000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f955f7fe640 10 client.4463.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f955f7fe640 20 client.4463.objecter put_session s=0x7f954c080cc0 osd=5 4 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f955f7fe640 15 client.4463.objecter _session_command_op_remove 5 2 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 10 librados: watch_flush enter 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 10 librados: watch_flush exit 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 10 client.4463.objecter close_session for osd.5 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7f954c081390 msgr2=0x7f954c0837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7f954c081390 0x7f954c0837d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 20 client.4463.objecter put_session s=0x7f954c080cc0 osd=5 1 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 20 client.4463.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 10 client.4463.objecter successfully canceled tick 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f954c078e50 msgr2=0x7f954c07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f954c078e50 0x7f954c07b310 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f958006a200 tx=0x7f9574031000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 10 monclient: shutdown 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 msgr2=0x7f95800ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 --2- 10.20.193.10:0/80305228 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9580155d60 0x7f95800ce640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f956800b530 tx=0x7f956800ba00 comp rx=0 tx=0).stop 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f957f7fe640 1 -- 10.20.193.10:0/80305228 reap_dead start 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 shutdown_connections 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 >> 10.20.193.10:0/80305228 conn(0x7f95800cc020 msgr2=0x7f9580150df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 shutdown_connections 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6faffff640 1 -- 10.20.193.10:0/1248961327 <== osd.11 v2:10.20.193.174:6800/4034633078 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6fd81597b0 con 0x7f6fa8081390 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6faffff640 10 client.4404.objecter ms_dispatch2 0x7f6fd8000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 -- 10.20.193.10:0/80305228 wait complete. 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6faffff640 10 client.4404.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6faffff640 20 client.4404.objecter put_session s=0x7f6fa8080cc0 osd=11 4 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6faffff640 15 client.4404.objecter _session_command_op_remove 11 2 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f95857a9640 1 librados: shutdown 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 10 librados: watch_flush enter 2026-02-17T11:55:59.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 10 librados: watch_flush exit 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 10 client.4404.objecter close_session for osd.11 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7f6fa8081390 msgr2=0x7f6fa80837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7f6fa8081390 0x7f6fa80837d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 20 client.4404.objecter put_session s=0x7f6fa8080cc0 osd=11 1 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 20 client.4404.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 10 client.4404.objecter successfully canceled tick 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6fa8078e50 msgr2=0x7f6fa807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6fa8078e50 0x7f6fa807b310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc006fd0 tx=0x7f6fcc006d40 comp rx=0 tx=0).stop 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 10 monclient: shutdown 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6fd8155e80 msgr2=0x7f6fd81e95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 1 --2- 10.20.193.10:0/1248961327 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6fd8155e80 0x7f6fd81e95c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0002410 tx=0x7f6fc00047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fd77fe640 1 -- 10.20.193.10:0/1248961327 reap_dead start 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 shutdown_connections 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.979+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 >> 10.20.193.10:0/1248961327 conn(0x7f6fd80ce2b0 msgr2=0x7f6fd8150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 shutdown_connections 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f6fdd898640 1 -- 10.20.193.10:0/1248961327 wait complete. 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f6fdd898640 1 librados: shutdown 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f9287fff640 1 -- 10.20.193.10:0/860503007 <== osd.12 v2:10.20.193.10:6802/2920105256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f92ac0cbe80 con 0x7f927c081390 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f9287fff640 10 client.4471.objecter ms_dispatch2 0x7f92ac000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f9287fff640 10 client.4471.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f9287fff640 20 client.4471.objecter put_session s=0x7f927c080cc0 osd=12 4 2026-02-17T11:55:59.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f9287fff640 15 client.4471.objecter _session_command_op_remove 12 2 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 10 librados: watch_flush enter 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 10 librados: watch_flush exit 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 10 client.4471.objecter close_session for osd.12 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7f927c081390 msgr2=0x7f927c0837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7f927c081390 0x7f927c0837d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 20 client.4471.objecter put_session s=0x7f927c080cc0 osd=12 1 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 20 client.4471.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 10 client.4471.objecter successfully canceled tick 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f927c078e50 msgr2=0x7f927c07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f927c078e50 0x7f927c07b310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f92ac08f5e0 tx=0x7f9298031000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 10 monclient: shutdown 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac156260 msgr2=0x7f92ac1f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 --2- 10.20.193.10:0/860503007 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92ac156260 0x7f92ac1f5be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b970 tx=0x7f92a000be40 comp rx=0 tx=0).stop 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92abfff640 1 -- 10.20.193.10:0/860503007 reap_dead start 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 shutdown_connections 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 >> 10.20.193.10:0/860503007 conn(0x7f92ac0ce2b0 msgr2=0x7f92ac0cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 shutdown_connections 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.980+0000 7f92b1fc1640 1 -- 10.20.193.10:0/860503007 wait complete. 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.981+0000 7f92b1fc1640 1 librados: shutdown 2026-02-17T11:55:59.014 INFO:teuthology.orchestra.run.trial010.stdout:120259084293 2026-02-17T11:55:59.015 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-17T11:55:59.015 INFO:teuthology.orchestra.run.trial010.stdout:115964117002 2026-02-17T11:55:59.015 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T11:55:59.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.986+0000 7f92ad7fa640 1 -- 10.20.193.10:0/493418506 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f92a001a460 con 0x7f92b8155e80 2026-02-17T11:55:59.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.986+0000 7f92ad7fa640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9288078e00 0x7f928807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.986+0000 7f92bceea640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9288078e00 0x7f928807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.986+0000 7f92bceea640 10 monclient: get_auth_request con 0x7f9288078e00 auth_method 0 2026-02-17T11:55:59.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.986+0000 7f92bceea640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9288078e00 0x7f928807b2c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92b8159780 tx=0x7f92a8006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.986+0000 7f92ad7fa640 10 client.4469.objecter ms_handle_connect 0x7f9288078e00 2026-02-17T11:55:59.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.987+0000 7f537bfff640 1 -- 10.20.193.10:0/965146319 <== osd.13 v2:10.20.193.71:6824/1119039635 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f538c036ec0 con 0x7f5370081390 2026-02-17T11:55:59.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.987+0000 7f537bfff640 10 client.4454.objecter ms_dispatch2 0x7f53a0000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.987+0000 7f537bfff640 10 client.4454.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.987+0000 7f537bfff640 20 client.4454.objecter put_session s=0x7f5370080cc0 osd=13 4 2026-02-17T11:55:59.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.987+0000 7f537bfff640 15 client.4454.objecter _session_command_op_remove 13 1 2026-02-17T11:55:59.016 INFO:teuthology.orchestra.run.trial010.stdout:115964117000 2026-02-17T11:55:59.016 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T11:55:59.016 INFO:teuthology.orchestra.run.trial010.stdout:103079215110 2026-02-17T11:55:59.016 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stdout:94489280518 2026-02-17T11:55:59.017 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 1 -- 10.20.193.10:0/493418506 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f92a0097920 con 0x7f92b8155e80 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 10 client.4469.objecter ms_dispatch2 0x7f92b8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 3 client.4469.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 3 client.4469.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 10 client.4469.objecter checking command 1 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7fd8327fc640 1 -- 10.20.193.10:0/1744815795 <== osd.0 v2:10.20.193.10:6826/311345990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd8400038c0 con 0x7fd814081390 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7f9288081340 0x7f9288083780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 20 client.4469.objecter _get_session s=0x7f9288080c70 osd=15 3 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 20 client.4469.objecter put_session s=0x7f9288080c70 osd=15 3 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 15 client.4469.objecter _session_command_op_remove -1 1 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 20 client.4469.objecter _get_session s=0x7f9288080c70 osd=15 3 2026-02-17T11:55:59.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 20 client.4469.objecter get_session s=0x7f9288080c70 osd=15 3 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 15 client.4469.objecter _session_command_op_assign 15 1 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7fd8327fc640 10 client.4466.objecter ms_dispatch2 0x7fd844000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7fd8327fc640 10 client.4466.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7fd8327fc640 20 client.4466.objecter put_session s=0x7fd814080cc0 osd=0 4 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7fd8327fc640 15 client.4466.objecter _session_command_op_remove 0 1 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 20 client.4469.objecter put_session s=0x7f9288080c70 osd=15 4 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 10 client.4469.objecter _send_command 1 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 1 -- 10.20.193.10:0/493418506 --> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92a0013e50 con 0x7f9288081340 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 20 client.4469.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 1 -- 10.20.193.10:0/493418506 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f92a005e3c0 con 0x7f92b8155e80 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92ad7fa640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.988+0000 7f92bd6eb640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7f9288081340 0x7f9288083780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.989+0000 7f92bd6eb640 10 monclient: get_auth_request con 0x7f9288081340 auth_method 0 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.991+0000 7f92ad7fa640 10 client.4469.objecter ms_handle_connect 0x7f9288081340 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.991+0000 7f92bd6eb640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7f9288081340 0x7f9288083780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 10 client.4454.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 15 client.4454.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 20 client.4454.objecter _get_session s=0x7f5370080cc0 osd=13 3 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 20 client.4454.objecter put_session s=0x7f5370080cc0 osd=13 3 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 20 client.4454.objecter _get_session s=0x7f5370080cc0 osd=13 3 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 15 client.4454.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 20 client.4454.objecter get_session s=0x7f5370080cc0 osd=13 3 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 15 client.4454.objecter _session_command_op_assign 13 2 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 20 client.4454.objecter put_session s=0x7f5370080cc0 osd=13 4 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 10 client.4454.objecter _send_command 2 2026-02-17T11:55:59.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.993+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 --> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53a00ccbc0 con 0x7f5370081390 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 10 client.4466.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 15 client.4466.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 20 client.4466.objecter _get_session s=0x7fd814080cc0 osd=0 3 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 20 client.4466.objecter put_session s=0x7fd814080cc0 osd=0 3 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 20 client.4466.objecter _get_session s=0x7fd814080cc0 osd=0 3 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 15 client.4466.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 20 client.4466.objecter get_session s=0x7fd814080cc0 osd=0 3 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 15 client.4466.objecter _session_command_op_assign 0 2 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 20 client.4466.objecter put_session s=0x7fd814080cc0 osd=0 4 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 10 client.4466.objecter _send_command 2 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.995+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 --> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd8440cd280 con 0x7fd814081390 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd8327fc640 1 -- 10.20.193.10:0/1744815795 <== osd.0 v2:10.20.193.10:6826/311345990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd8440cd280 con 0x7fd814081390 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd8327fc640 10 client.4466.objecter ms_dispatch2 0x7fd844000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd8327fc640 10 client.4466.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd8327fc640 20 client.4466.objecter put_session s=0x7fd814080cc0 osd=0 4 2026-02-17T11:55:59.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd8327fc640 15 client.4466.objecter _session_command_op_remove 0 2 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 10 librados: watch_flush enter 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 10 librados: watch_flush exit 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 10 client.4466.objecter close_session for osd.0 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7fd814081390 msgr2=0x7fd8140837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7fd814081390 0x7fd8140837d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 20 client.4466.objecter put_session s=0x7fd814080cc0 osd=0 1 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 20 client.4466.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 10 client.4466.objecter successfully canceled tick 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd814078e50 msgr2=0x7fd81407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd814078e50 0x7fd81407b310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd834002770 tx=0x7fd834009040 comp rx=0 tx=0).stop 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 10 monclient: shutdown 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd844156260 msgr2=0x7fd8441f3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 --2- 10.20.193.10:0/1744815795 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd844156260 0x7fd8441f3f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd84003a040 tx=0x7fd840004b40 comp rx=0 tx=0).stop 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84a5b5640 1 -- 10.20.193.10:0/1744815795 reap_dead start 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 shutdown_connections 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 >> 10.20.193.10:0/1744815795 conn(0x7fd8440ce2b0 msgr2=0x7fd8440ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 shutdown_connections 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 -- 10.20.193.10:0/1744815795 wait complete. 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:58.999+0000 7fd84c03f640 1 librados: shutdown 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.001+0000 7f629affd640 1 -- 10.20.193.10:0/1729113869 <== osd.10 v2:10.20.193.153:6800/22479275 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f62a804ee80 con 0x7f6280081340 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.001+0000 7f629affd640 10 client.4468.objecter ms_dispatch2 0x7f62b4000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.001+0000 7f629affd640 10 client.4468.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.001+0000 7f629affd640 20 client.4468.objecter put_session s=0x7f6280080c70 osd=10 4 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.001+0000 7f629affd640 15 client.4468.objecter _session_command_op_remove 10 1 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f537bfff640 1 -- 10.20.193.10:0/965146319 <== osd.13 v2:10.20.193.71:6824/1119039635 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f53a00ccbc0 con 0x7f5370081390 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f537bfff640 10 client.4454.objecter ms_dispatch2 0x7f53a0000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f537bfff640 10 client.4454.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f537bfff640 20 client.4454.objecter put_session s=0x7f5370080cc0 osd=13 4 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f537bfff640 15 client.4454.objecter _session_command_op_remove 13 2 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 10 librados: watch_flush enter 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 10 librados: watch_flush exit 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 10 client.4454.objecter close_session for osd.13 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f5370081390 msgr2=0x7f53700837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f5370081390 0x7f53700837d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 20 client.4454.objecter put_session s=0x7f5370080cc0 osd=13 1 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 20 client.4454.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 10 client.4454.objecter successfully canceled tick 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5370078e50 msgr2=0x7f537007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5370078e50 0x7f537007b310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f53a0159340 tx=0x7f5390009110 comp rx=0 tx=0).stop 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 10 monclient: shutdown 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53a00cd2d0 msgr2=0x7f53a01e9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 --2- 10.20.193.10:0/965146319 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53a00cd2d0 0x7f53a01e9aa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f538c009130 tx=0x7f538c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f539ffff640 1 -- 10.20.193.10:0/965146319 reap_dead start 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 shutdown_connections 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 >> 10.20.193.10:0/965146319 conn(0x7f53a00ce2b0 msgr2=0x7f53a00ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 shutdown_connections 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 -- 10.20.193.10:0/965146319 wait complete. 2026-02-17T11:55:59.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.002+0000 7f53a61fb640 1 librados: shutdown 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stdout:94489280519 2026-02-17T11:55:59.022 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 10 client.4468.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 15 client.4468.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 20 client.4468.objecter _get_session s=0x7f6280080c70 osd=10 3 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 20 client.4468.objecter put_session s=0x7f6280080c70 osd=10 3 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 20 client.4468.objecter _get_session s=0x7f6280080c70 osd=10 3 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 15 client.4468.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 20 client.4468.objecter get_session s=0x7f6280080c70 osd=10 3 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 15 client.4468.objecter _session_command_op_assign 10 2 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 20 client.4468.objecter put_session s=0x7f6280080c70 osd=10 4 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 10 client.4468.objecter _send_command 2 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.008+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 --> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f62b415ffb0 con 0x7f6280081340 2026-02-17T11:55:59.022 INFO:teuthology.orchestra.run.trial010.stdout:120259084291 2026-02-17T11:55:59.023 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.010+0000 7f921e7fc640 1 -- 10.20.193.10:0/3543626693 <== osd.9 v2:10.20.193.71:6800/1369683666 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f9220022ec0 con 0x7f92000813c0 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.010+0000 7f921e7fc640 10 client.4477.objecter ms_dispatch2 0x7f9230000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.010+0000 7f921e7fc640 10 client.4477.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.010+0000 7f921e7fc640 20 client.4477.objecter put_session s=0x7f9200080cf0 osd=9 4 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.010+0000 7f921e7fc640 15 client.4477.objecter _session_command_op_remove 9 1 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.012+0000 7f70ab7fe640 1 -- 10.20.193.10:0/7085713 <== osd.1 v2:10.20.193.71:6808/168831009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f70c0023ec0 con 0x7f7098081390 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.012+0000 7f70ab7fe640 10 client.4460.objecter ms_dispatch2 0x7f70cc000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.012+0000 7f70ab7fe640 10 client.4460.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.012+0000 7f70ab7fe640 20 client.4460.objecter put_session s=0x7f7098080cc0 osd=1 4 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.012+0000 7f70ab7fe640 15 client.4460.objecter _session_command_op_remove 1 1 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f629affd640 1 -- 10.20.193.10:0/1729113869 <== osd.10 v2:10.20.193.153:6800/22479275 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f62b415ffb0 con 0x7f6280081340 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f629affd640 10 client.4468.objecter ms_dispatch2 0x7f62b4000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f629affd640 10 client.4468.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f629affd640 20 client.4468.objecter put_session s=0x7f6280080c70 osd=10 4 2026-02-17T11:55:59.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f629affd640 15 client.4468.objecter _session_command_op_remove 10 2 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 10 librados: watch_flush enter 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 10 librados: watch_flush exit 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 10 client.4468.objecter close_session for osd.10 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7f6280081340 msgr2=0x7f6280083780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7f6280081340 0x7f6280083780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 20 client.4468.objecter put_session s=0x7f6280080c70 osd=10 1 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 20 client.4468.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 10 client.4468.objecter successfully canceled tick 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6280078e00 msgr2=0x7f628007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6280078e00 0x7f628007b2c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f62b41eeb30 tx=0x7f629c006ca0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 10 monclient: shutdown 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b406e2d0 msgr2=0x7f62b414be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b8cfc640 1 --2- 10.20.193.10:0/1729113869 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f62b406e2d0 0x7f62b414be60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f62a8002410 tx=0x7f62a80047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.013+0000 7f62b2d76640 1 -- 10.20.193.10:0/1729113869 reap_dead start 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 shutdown_connections 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 >> 10.20.193.10:0/1729113869 conn(0x7f62b4074090 msgr2=0x7f62b40c71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 shutdown_connections 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f62b8cfc640 1 -- 10.20.193.10:0/1729113869 wait complete. 2026-02-17T11:55:59.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f62b8cfc640 1 librados: shutdown 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f92ad7fa640 1 -- 10.20.193.10:0/493418506 <== osd.15 v2:10.20.193.174:6824/3564494722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f92a0013e50 con 0x7f9288081340 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f92ad7fa640 10 client.4469.objecter ms_dispatch2 0x7f92b8000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f92ad7fa640 10 client.4469.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f92ad7fa640 20 client.4469.objecter put_session s=0x7f9288080c70 osd=15 4 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.014+0000 7f92ad7fa640 15 client.4469.objecter _session_command_op_remove 15 1 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 10 client.4477.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 15 client.4477.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 20 client.4477.objecter _get_session s=0x7f9200080cf0 osd=9 3 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 20 client.4477.objecter put_session s=0x7f9200080cf0 osd=9 3 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 20 client.4477.objecter _get_session s=0x7f9200080cf0 osd=9 3 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 15 client.4477.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 20 client.4477.objecter get_session s=0x7f9200080cf0 osd=9 3 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 15 client.4477.objecter _session_command_op_assign 9 2 2026-02-17T11:55:59.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 20 client.4477.objecter put_session s=0x7f9200080cf0 osd=9 4 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 10 client.4477.objecter _send_command 2 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.017+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 --> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92300ccfe0 con 0x7f92000813c0 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 10 client.4460.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 15 client.4460.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 20 client.4460.objecter _get_session s=0x7f7098080cc0 osd=1 3 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 20 client.4460.objecter put_session s=0x7f7098080cc0 osd=1 3 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 20 client.4460.objecter _get_session s=0x7f7098080cc0 osd=1 3 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 15 client.4460.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 20 client.4460.objecter get_session s=0x7f7098080cc0 osd=1 3 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 15 client.4460.objecter _session_command_op_assign 1 2 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 20 client.4460.objecter put_session s=0x7f7098080cc0 osd=1 4 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 10 client.4460.objecter _send_command 2 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.018+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 --> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f70cc15a6c0 con 0x7f7098081390 2026-02-17T11:55:59.026 INFO:teuthology.orchestra.run.trial010.stdout:115964117001 2026-02-17T11:55:59.027 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 10 client.4469.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 15 client.4469.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 20 client.4469.objecter _get_session s=0x7f9288080c70 osd=15 3 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 20 client.4469.objecter put_session s=0x7f9288080c70 osd=15 3 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 20 client.4469.objecter _get_session s=0x7f9288080c70 osd=15 3 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 15 client.4469.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 20 client.4469.objecter get_session s=0x7f9288080c70 osd=15 3 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 15 client.4469.objecter _session_command_op_assign 15 2 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 20 client.4469.objecter put_session s=0x7f9288080c70 osd=15 4 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 10 client.4469.objecter _send_command 2 2026-02-17T11:55:59.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.021+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 --> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92b81597b0 con 0x7f9288081340 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f921e7fc640 1 -- 10.20.193.10:0/3543626693 <== osd.9 v2:10.20.193.71:6800/1369683666 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f92300ccfe0 con 0x7f92000813c0 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f921e7fc640 10 client.4477.objecter ms_dispatch2 0x7f9230000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f921e7fc640 10 client.4477.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f921e7fc640 20 client.4477.objecter put_session s=0x7f9200080cf0 osd=9 4 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f921e7fc640 15 client.4477.objecter _session_command_op_remove 9 2 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 10 librados: watch_flush enter 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 10 librados: watch_flush exit 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 10 client.4477.objecter close_session for osd.9 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7f92000813c0 msgr2=0x7f9200083800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7f92000813c0 0x7f9200083800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 20 client.4477.objecter put_session s=0x7f9200080cf0 osd=9 1 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 20 client.4477.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 10 client.4477.objecter successfully canceled tick 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9200078e80 msgr2=0x7f920007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9200078e80 0x7f920007b340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f923008f350 tx=0x7f9224031000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 10 monclient: shutdown 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92300ccbc0 msgr2=0x7f92301f4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 --2- 10.20.193.10:0/3543626693 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f92300ccbc0 0x7f92301f4470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f922000b780 tx=0x7f922000bc50 comp rx=0 tx=0).stop 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f92366d7640 1 -- 10.20.193.10:0/3543626693 reap_dead start 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 shutdown_connections 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 >> 10.20.193.10:0/3543626693 conn(0x7f92300ce2b0 msgr2=0x7f92300d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 shutdown_connections 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 -- 10.20.193.10:0/3543626693 wait complete. 2026-02-17T11:55:59.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f9238161640 1 librados: shutdown 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f70ab7fe640 1 -- 10.20.193.10:0/7085713 <== osd.1 v2:10.20.193.71:6808/168831009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f70cc15a6c0 con 0x7f7098081390 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.023+0000 7f70ab7fe640 10 client.4460.objecter ms_dispatch2 0x7f70cc000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70ab7fe640 10 client.4460.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70ab7fe640 20 client.4460.objecter put_session s=0x7f7098080cc0 osd=1 4 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70ab7fe640 15 client.4460.objecter _session_command_op_remove 1 2 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 10 librados: watch_flush enter 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 10 librados: watch_flush exit 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 10 client.4460.objecter close_session for osd.1 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7f7098081390 msgr2=0x7f70980837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7f7098081390 0x7f70980837d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 20 client.4460.objecter put_session s=0x7f7098080cc0 osd=1 1 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 20 client.4460.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 10 client.4460.objecter successfully canceled tick 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7098078e50 msgr2=0x7f709807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7098078e50 0x7f709807b310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f70b4039000 tx=0x7f70b4033000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 10 monclient: shutdown 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f70cc0c9b70 msgr2=0x7f70cc1fc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 --2- 10.20.193.10:0/7085713 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f70cc0c9b70 0x7f70cc1fc3b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70c000b570 tx=0x7f70c000ba40 comp rx=0 tx=0).stop 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70cb7fe640 1 -- 10.20.193.10:0/7085713 reap_dead start 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 shutdown_connections 2026-02-17T11:55:59.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 >> 10.20.193.10:0/7085713 conn(0x7f70cc073070 msgr2=0x7f70cc0cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 shutdown_connections 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 -- 10.20.193.10:0/7085713 wait complete. 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.024+0000 7f70d13e5640 1 librados: shutdown 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.025+0000 7f92ad7fa640 1 -- 10.20.193.10:0/493418506 <== osd.15 v2:10.20.193.174:6824/3564494722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f92b81597b0 con 0x7f9288081340 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.025+0000 7f92ad7fa640 10 client.4469.objecter ms_dispatch2 0x7f92b8000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.025+0000 7f92ad7fa640 10 client.4469.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.025+0000 7f92ad7fa640 20 client.4469.objecter put_session s=0x7f9288080c70 osd=15 4 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.025+0000 7f92ad7fa640 15 client.4469.objecter _session_command_op_remove 15 2 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.025+0000 7f92bf175640 10 librados: watch_flush enter 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 10 librados: watch_flush exit 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 10 client.4469.objecter close_session for osd.15 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7f9288081340 msgr2=0x7f9288083780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7f9288081340 0x7f9288083780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 20 client.4469.objecter put_session s=0x7f9288080c70 osd=15 1 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 20 client.4469.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 10 client.4469.objecter successfully canceled tick 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9288078e00 msgr2=0x7f928807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9288078e00 0x7f928807b2c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92b8159780 tx=0x7f92a8006f90 comp rx=0 tx=0).stop 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 10 monclient: shutdown 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f92b8155e80 msgr2=0x7f92b80cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 --2- 10.20.193.10:0/493418506 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f92b8155e80 0x7f92b80cc320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b550 tx=0x7f92a000ba20 comp rx=0 tx=0).stop 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bd6eb640 1 -- 10.20.193.10:0/493418506 reap_dead start 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 shutdown_connections 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 >> 10.20.193.10:0/493418506 conn(0x7f92b80ce2b0 msgr2=0x7f92b81e7960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 shutdown_connections 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 -- 10.20.193.10:0/493418506 wait complete. 2026-02-17T11:55:59.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.026+0000 7f92bf175640 1 librados: shutdown 2026-02-17T11:55:59.034 INFO:teuthology.orchestra.run.trial010.stdout:115964116999 2026-02-17T11:55:59.034 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T11:55:59.035 INFO:teuthology.orchestra.run.trial010.stdout:115964116999 2026-02-17T11:55:59.036 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:55:59.037 INFO:teuthology.orchestra.run.trial010.stdout:107374182405 2026-02-17T11:55:59.037 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T11:55:59.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.090+0000 7f99d8bce640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.090+0000 7f99d8bce640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.090+0000 7f99d8bce640 10 monclient: monmap: 2026-02-17T11:55:59.092 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.092225+0000 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.092225+0000 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.091+0000 7f99d8bce640 1 Processor -- start 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.091+0000 7f99d8bce640 1 -- start start 2026-02-17T11:55:59.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.091+0000 7f99d8bce640 10 monclient: init 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 10 monclient: _add_conns ranks=[5,1,0,3,2,4] 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f99d415f5c0 0x7f99d415f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 10 monclient(hunting): picked mon.noname-c con 0x7f99d415f5c0 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f99d40c97f0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f99d415e2f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d40c9d20 con 0x7f99d415e2f0 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d40ca000 con 0x7f99d40c97f0 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f99d40ca2e0 con 0x7f99d415f5c0 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d8bce640 10 monclient(hunting): authenticate will time out at 1028.814385s 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d2575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f99d415f5c0 0x7f99d415f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d1d74640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f99d40c97f0 0x7f99d415dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:57986/0 (socket says 10.20.193.10:57986) 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d1d74640 1 -- 10.20.193.10:0/331495694 learned_addr learned my addr 10.20.193.10:0/331495694 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d2575640 10 monclient(hunting): get_auth_request con 0x7f99d415f5c0 auth_method 0 2026-02-17T11:55:59.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.092+0000 7f99d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.093+0000 7f99d2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.093+0000 7f99d2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.093+0000 7f99d2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d1573640 1 -- 10.20.193.10:0/331495694 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776482941 0 0) 0x7f99d40ca000 con 0x7f99d40c97f0 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d1573640 10 monclient(hunting): _negotiate 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d1573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d1573640 10 monclient(hunting): my global_id is 4483 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d1573640 1 -- 10.20.193.10:0/331495694 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99c0003620 con 0x7f99d40c97f0 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d2575640 10 monclient(hunting): handle_auth_done global_id 4472 payload 274 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d2575640 1 -- 10.20.193.10:0/331495694 >> v1:10.20.193.71:6789/0 conn(0x7f99d40c97f0 legacy=0x7f99d415dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d2575640 1 -- 10.20.193.10:0/331495694 >> v1:10.20.193.10:6789/0 conn(0x7f99d415e2f0 legacy=0x7f99d41557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d2575640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d2575640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d2575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.094+0000 7f99d2575640 1 -- 10.20.193.10:0/331495694 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d415d400 con 0x7f99d415f5c0 2026-02-17T11:55:59.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.095+0000 7f99d2575640 1 --2- 10.20.193.10:0/331495694 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 0x7f99d415f9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99c80098a0 tx=0x7f99c802ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b309011ddc2f7182 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.095+0000 7f58a498f640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.095+0000 7f58a498f640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.095+0000 7f58a498f640 10 monclient: monmap: 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.096703+0000 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.096703+0000 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f58a498f640 1 Processor -- start 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f58a498f640 1 -- start start 2026-02-17T11:55:59.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f58a498f640 10 monclient: init 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f99d1573640 1 -- 10.20.193.10:0/331495694 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c803c070 con 0x7f99d415f5c0 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f99d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f99d1573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f99d1573640 10 monclient: dump: 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f99d1573640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f99d1573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f99d1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f99d8bce640 5 monclient: authenticate success, global_id 4472 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f99d8bce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f58a498f640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f58a498f640 10 monclient: _add_conns ranks=[0,4,5,3,1,2] 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f58a498f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f589c155e80 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.096+0000 7f58a498f640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f589c074cd0 0x7f589c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 10 monclient(hunting): picked mon.noname-b con 0x7f589c074cd0 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f589c156260 0x7f589c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d1573640 1 -- 10.20.193.10:0/331495694 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c802fc10 con 0x7f99d415f5c0 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d1573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d1573640 1 -- 10.20.193.10:0/331495694 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8037440 con 0x7f99d415f5c0 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d1573640 10 monclient: dump: 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.099 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d8bce640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d8bce640 4 set_mon_vals no callback set 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 10 monclient(hunting): picked mon.noname-c con 0x7f589c156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589c073520 con 0x7f589c155e80 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f589c0cd840 con 0x7f589c074cd0 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f589c073800 con 0x7f589c156260 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a498f640 10 monclient(hunting): authenticate will time out at 1028.819158s 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a1f03640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f589c074cd0 0x7f589c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2f05640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f589c156260 0x7f589c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2704640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f589c155e80 0x7f589c0745c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:42112/0 (socket says 10.20.193.10:42112) 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2704640 1 -- 10.20.193.10:0/685337756 learned_addr learned my addr 10.20.193.10:0/685337756 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a1f03640 10 monclient(hunting): get_auth_request con 0x7f589c074cd0 auth_method 0 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a1f03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a1f03640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a1f03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2f05640 10 monclient(hunting): get_auth_request con 0x7f589c156260 auth_method 0 2026-02-17T11:55:59.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2f05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2f05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2f05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d8bce640 10 monclient: shutdown 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d8bce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d8bce640 1 -- 10.20.193.10:0/331495694 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 msgr2=0x7f99d415f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d8bce640 1 --2- 10.20.193.10:0/331495694 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 0x7f99d415f9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99c80098a0 tx=0x7f99c802ef00 comp rx=0 tx=0).stop 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a1f03640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a1f03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a1f03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2f05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2f05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f58a2f05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d8bce640 1 -- 10.20.193.10:0/331495694 shutdown_connections 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.097+0000 7f99d8bce640 1 --2- 10.20.193.10:0/331495694 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 0x7f99d415f9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f99d8bce640 1 -- 10.20.193.10:0/331495694 >> 10.20.193.10:0/331495694 conn(0x7f99d4073070 msgr2=0x7f99d4073480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f99d8bce640 1 -- 10.20.193.10:0/331495694 shutdown_connections 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f58a1f03640 10 monclient(hunting): handle_auth_done global_id 4486 payload 274 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f58a1f03640 1 -- 10.20.193.10:0/685337756 >> v2:10.20.193.153:3300/0 conn(0x7f589c156260 msgr2=0x7f589c0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f58a1f03640 1 --2- 10.20.193.10:0/685337756 >> v2:10.20.193.153:3300/0 conn(0x7f589c156260 0x7f589c0cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f58a1f03640 1 -- 10.20.193.10:0/685337756 >> v1:10.20.193.10:6789/0 conn(0x7f589c155e80 legacy=0x7f589c0745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f58a1f03640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f58a1f03640 1 monclient: found mon.noname-b 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f58a1f03640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f58a1f03640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f58a1f03640 1 -- 10.20.193.10:0/685337756 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c073ae0 con 0x7f589c074cd0 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.098+0000 7f99d8bce640 1 -- 10.20.193.10:0/331495694 wait complete. 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f99d8bce640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f99d8bce640 10 monclient: monmap: 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f99d8bce640 1 librados: starting msgr at 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f99d8bce640 1 librados: starting objecter 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f99d8bce640 1 Processor -- start 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f58a1f03640 1 --2- 10.20.193.10:0/685337756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f589c074cd0 0x7f589c0ccbc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f589c08f350 tx=0x7f588802ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d83eb7869c67a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f99d8bce640 1 -- start start 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f99d8bce640 1 librados: setting wanted keys 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f99d8bce640 1 librados: calling monclient init 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.099+0000 7f99d8bce640 10 monclient: init 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f99d40c97f0 0x7f99d41f9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient(hunting): picked mon.noname-b con 0x7f99d40c97f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f99d415e2f0 0x7f99d415be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient(hunting): picked mon.noname-a con 0x7f99d415e2f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 0x7f99d415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient(hunting): picked mon.noname-c con 0x7f99d415f5c0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f99d40cba80 con 0x7f99d415e2f0 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f99d408f870 con 0x7f99d40c97f0 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99d40cbc00 con 0x7f99d415f5c0 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f13e0ebf640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f13e0ebf640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f13e0ebf640 10 monclient: monmap: 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.101896+0000 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.101896+0000 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d8bce640 10 monclient(hunting): authenticate will time out at 1028.822458s 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f99d1d74640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f99d415e2f0 0x7f99d415be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f58a1702640 1 -- 10.20.193.10:0/685337756 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588803c070 con 0x7f589c074cd0 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f58a1702640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f58a1702640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f58a1702640 10 monclient: dump: 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f58a1702640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f58a1702640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f58a1702640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.100+0000 7f58a498f640 5 monclient: authenticate success, global_id 4486 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f58a498f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 0x7f99d415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 0x7f99d415c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35692/0 (socket says 10.20.193.10:35692) 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 1 -- 10.20.193.10:0/771972275 learned_addr learned my addr 10.20.193.10:0/771972275 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 10 monclient(hunting): get_auth_request con 0x7f99d415f5c0 auth_method 0 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d1d74640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f99d415e2f0 0x7f99d415be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38278/0 (socket says 10.20.193.10:38278) 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d1d74640 10 monclient(hunting): get_auth_request con 0x7f99d415e2f0 auth_method 0 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 1 Processor -- start 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 1 -- start start 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient: init 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f71bffc1640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f71bffc1640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f71bffc1640 10 monclient: monmap: 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.102622+0000 2026-02-17T11:55:59.106 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.102622+0000 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f99d2575640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f99d40c97f0 0x7f99d41f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f71bffc1640 1 Processor -- start 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient: _add_conns ranks=[3,4,2,5,1,0] 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f71bffc1640 1 -- start start 2026-02-17T11:55:59.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f13dc152660 0x7f13dc15a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f71bffc1640 10 monclient: init 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7fc57babf640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7fc57babf640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7fc57babf640 10 monclient: monmap: 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.103110+0000 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.103110+0000 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient(hunting): picked mon.noname-a con 0x7f13dc152660 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f13dc152a40 0x7f13dc15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient(hunting): picked mon.noname-b con 0x7f13dc152a40 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f13dc0c8dd0 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:59.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13dc0c71e0 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f13dc0c77a0 con 0x7f13dc152660 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f13dc0c74c0 con 0x7f13dc152a40 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.101+0000 7f13e0ebf640 10 monclient(hunting): authenticate will time out at 1028.823988s 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a1702640 1 -- 10.20.193.10:0/685337756 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588802faf0 con 0x7f589c074cd0 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a1702640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a1702640 1 -- 10.20.193.10:0/685337756 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888037440 con 0x7f589c074cd0 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a1702640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a1702640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a1702640 10 monclient: dump: 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 4 set_mon_vals no callback set 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2575640 10 monclient(hunting): get_auth_request con 0x7f99d40c97f0 auth_method 0 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 10 monclient: _add_conns ranks=[5,1,3,2,0,4] 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f71b8152400 0x7f71b815d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 10 monclient(hunting): picked mon.noname-c con 0x7f71b8152400 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7fc57babf640 1 Processor -- start 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f874a287640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f874a287640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f874a287640 10 monclient: monmap: 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.103517+0000 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.103517+0000 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.110 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f71b81527e0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f71b80ccd10 0x7f71b806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7fc57babf640 1 -- start start 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7fc57babf640 10 monclient: init 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 10 monclient(hunting): picked mon.noname-a con 0x7f71b80ccd10 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 10 monclient(hunting): handle_auth_done global_id 4478 payload 824 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b80cb990 con 0x7f71b81527e0 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f71b80cbc70 con 0x7f71b80ccd10 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 10 monclient: shutdown 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 1 -- 10.20.193.10:0/685337756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f589c074cd0 msgr2=0x7f589c0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 1 --2- 10.20.193.10:0/685337756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f589c074cd0 0x7f589c0ccbc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f589c08f350 tx=0x7f588802ede0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 1 -- 10.20.193.10:0/771972275 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f99d40c97f0 msgr2=0x7f99d41f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f99d40c97f0 0x7f99d41f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f71b80cbf50 con 0x7f71b8152400 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 1 -- 10.20.193.10:0/771972275 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f99d415e2f0 msgr2=0x7f99d415be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f71bffc1640 10 monclient(hunting): authenticate will time out at 1028.824699s 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f99d415e2f0 0x7f99d415be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f99d2d76640 1 -- 10.20.193.10:0/771972275 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d41f8e10 con 0x7f99d415f5c0 2026-02-17T11:55:59.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 1 -- 10.20.193.10:0/685337756 shutdown_connections 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 1 --2- 10.20.193.10:0/685337756 >> v2:10.20.193.153:3300/0 conn(0x7f589c156260 0x7f589c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 1 --2- 10.20.193.10:0/685337756 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f589c074cd0 0x7f589c0ccbc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 1 -- 10.20.193.10:0/685337756 >> 10.20.193.10:0/685337756 conn(0x7f589c0ce2b0 msgr2=0x7f589c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 1 -- 10.20.193.10:0/685337756 shutdown_connections 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f874a287640 1 Processor -- start 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f58a498f640 1 -- 10.20.193.10:0/685337756 wait complete. 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f874a287640 1 -- start start 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f874a287640 10 monclient: init 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.102+0000 7f13d9d74640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f13dc152a40 0x7f13dc15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f13d9d74640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f13dc152a40 0x7f13dc15ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47092/0 (socket says 10.20.193.10:47092) 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f13d9d74640 1 -- 10.20.193.10:0/1630622709 learned_addr learned my addr 10.20.193.10:0/1630622709 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f13d9d74640 10 monclient(hunting): get_auth_request con 0x7f13dc152a40 auth_method 0 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f13d9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f13d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f13d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 10 monclient: _add_conns ranks=[0,5,2,1,4,3] 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc574155e80 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc574074cd0 0x7fc5740ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 10 monclient(hunting): picked mon.noname-c con 0x7fc574074cd0 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc574156260 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f58a498f640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f58a498f640 10 monclient: monmap: 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc574073520 con 0x7fc574155e80 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc574073800 con 0x7fc574156260 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc5740cd840 con 0x7fc574074cd0 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fc57babf640 10 monclient(hunting): authenticate will time out at 1028.825542s 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 10 monclient: _add_conns ranks=[2,3,1,5,0,4] 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f71bd535640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f71b81527e0 0x7f71b8070d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:57996/0 (socket says 10.20.193.10:57996) 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f71bd535640 1 -- 10.20.193.10:0/2269421115 learned_addr learned my addr 10.20.193.10:0/2269421115 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8744155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f58a498f640 1 librados: starting msgr at 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f58a498f640 1 librados: starting objecter 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8744074cd0 0x7f87440ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 10 monclient(hunting): picked mon.noname-a con 0x7f8744074cd0 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f8744156260 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8744073520 con 0x7f8744156260 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8744073800 con 0x7f8744155e80 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f87440cd840 con 0x7f8744074cd0 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fcabcc87640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fcabcc87640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7fcabcc87640 10 monclient: monmap: 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.104874+0000 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.104874+0000 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f874a287640 10 monclient(hunting): authenticate will time out at 1028.825746s 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f58a498f640 1 Processor -- start 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f58a498f640 1 -- start start 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f58a498f640 1 librados: setting wanted keys 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f58a498f640 1 librados: calling monclient init 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.103+0000 7f58a498f640 10 monclient: init 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f13d9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f13d9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f13d9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f99baffd640 10 client.?.objecter ms_handle_connect 0x7f99d415f5c0 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f99baffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f99d2d76640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 0x7f99d415c3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99c400cc50 tx=0x7f99c400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f589c074cd0 0x7f589c1f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient(hunting): picked mon.noname-b con 0x7f589c074cd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f589c155e80 0x7f589c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient(hunting): picked mon.noname-c con 0x7f589c155e80 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f589c156260 0x7f589c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient(hunting): picked mon.noname-a con 0x7f589c156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f589c0c4870 con 0x7f589c156260 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f589c0740a0 con 0x7f589c074cd0 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f589c0c49f0 con 0x7f589c155e80 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f58a498f640 10 monclient(hunting): authenticate will time out at 1028.826623s 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7f71bdd36640 1 --2- 10.20.193.10:0/2269421115 >> v2:10.20.193.153:3300/0 conn(0x7f71b8152400 0x7f71b815d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fc579033640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc574074cd0 0x7fc5740ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bdd36640 10 monclient(hunting): get_auth_request con 0x7f71b8152400 auth_method 0 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bdd36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bdd36640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bdd36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 1 Processor -- start 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 1 -- start start 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 10 monclient: init 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bcd34640 1 -- 10.20.193.10:0/2269421115 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 718040268 0 0) 0x7f71b80cb990 con 0x7f71b81527e0 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bcd34640 10 monclient(hunting): _negotiate 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bcd34640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bcd34640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bcd34640 10 monclient(hunting): my global_id is 4495 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 10 monclient: _add_conns ranks=[5,2,1,3,0,4] 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcab815a4f0 0x7fcab80d1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 10 monclient(hunting): picked mon.noname-c con 0x7fcab815a4f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fc579033640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc574074cd0 0x7fc5740ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35700/0 (socket says 10.20.193.10:35700) 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fc579033640 1 -- 10.20.193.10:0/756432318 learned_addr learned my addr 10.20.193.10:0/756432318 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fc579033640 10 monclient(hunting): get_auth_request con 0x7fc574074cd0 auth_method 0 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fc579033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fc579033640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcab80d1e90 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fcab80c92b0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab80d2300 con 0x7fcab80c92b0 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab815a8d0 con 0x7fcab80d1e90 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcab8164620 con 0x7fcab815a4f0 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71bcd34640 1 -- 10.20.193.10:0/2269421115 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71a0003620 con 0x7f71b81527e0 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fc579033640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.104+0000 7fcabcc87640 10 monclient(hunting): authenticate will time out at 1028.826765s 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f8743fff640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f8744156260 0x7f874415f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:58006/0 (socket says 10.20.193.10:58006) 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f8743fff640 1 -- 10.20.193.10:0/267912522 learned_addr learned my addr 10.20.193.10:0/267912522 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fae32755640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fae32755640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fae32755640 10 monclient: monmap: 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.106796+0000 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.106796+0000 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7f71be537640 1 --2- 10.20.193.10:0/2269421115 >> v2:10.20.193.10:3300/0 conn(0x7f71b80ccd10 0x7f71b806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71be537640 10 monclient(hunting): get_auth_request con 0x7f71b80ccd10 auth_method 0 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71be537640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71be537640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71be537640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fcab6d76640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fcab80c92b0 0x7fcab8163800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:58014/0 (socket says 10.20.193.10:58014) 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.105+0000 7fcab6d76640 1 -- 10.20.193.10:0/1714634857 learned_addr learned my addr 10.20.193.10:0/1714634857 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7fae32755640 1 Processor -- start 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7fae32755640 1 -- start start 2026-02-17T11:55:59.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7fae32755640 10 monclient: init 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71bdd36640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71bdd36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71bdd36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71be537640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71be537640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f71be537640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f13d9d74640 10 monclient(hunting): handle_auth_done global_id 4492 payload 274 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f13d9d74640 1 -- 10.20.193.10:0/1630622709 >> v2:10.20.193.10:3300/0 conn(0x7f13dc152660 msgr2=0x7f13dc15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f13d9d74640 1 --2- 10.20.193.10:0/1630622709 >> v2:10.20.193.10:3300/0 conn(0x7f13dc152660 0x7f13dc15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f13d9d74640 1 -- 10.20.193.10:0/1630622709 >> v1:10.20.193.153:6789/0 conn(0x7f13dc0c8dd0 legacy=0x7f13dc0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f13d9d74640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f13d9d74640 1 monclient: found mon.noname-b 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f13d9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f13d9d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7f13d9d74640 1 -- 10.20.193.10:0/1630622709 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc159e40 con 0x7f13dc152a40 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7fae32755640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7fae32755640 10 monclient: _add_conns ranks=[5,3,0,2,1,4] 2026-02-17T11:55:59.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7fae32755640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fae2c156020 0x7fae2c0cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7fae32755640 10 monclient(hunting): picked mon.noname-c con 0x7fae2c156020 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.106+0000 7fae32755640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fae2c0c98f0 0x7fae2c0c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fae32755640 10 monclient(hunting): picked mon.noname-a con 0x7fae2c0c98f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fae32755640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fae2c0d1710 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fc579033640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fc579033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fc579033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fae32755640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2c0c8ba0 con 0x7fae2c0d1710 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fae32755640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fae32755640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fae2c0c9460 con 0x7fae2c0c98f0 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fae32755640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fae32755640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fae2c15cbf0 con 0x7fae2c156020 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fae32755640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7fae32755640 10 monclient(hunting): authenticate will time out at 1028.829076s 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7f71bdd36640 10 monclient(hunting): handle_auth_done global_id 4481 payload 274 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7f71bdd36640 1 -- 10.20.193.10:0/2269421115 >> v2:10.20.193.10:3300/0 conn(0x7f71b80ccd10 msgr2=0x7f71b806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7f71bdd36640 1 --2- 10.20.193.10:0/2269421115 >> v2:10.20.193.10:3300/0 conn(0x7f71b80ccd10 0x7f71b806e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7f71bdd36640 1 -- 10.20.193.10:0/2269421115 >> v1:10.20.193.71:6789/0 conn(0x7f71b81527e0 legacy=0x7f71b8070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7f71bdd36640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7f71bdd36640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7f71bdd36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7f71bdd36640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.107+0000 7f71bdd36640 1 -- 10.20.193.10:0/2269421115 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b80cc230 con 0x7f71b8152400 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7fc579033640 10 monclient(hunting): handle_auth_done global_id 4484 payload 274 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7fc579033640 1 -- 10.20.193.10:0/756432318 >> v1:10.20.193.153:6789/0 conn(0x7fc574156260 legacy=0x7fc57415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7fc579033640 1 -- 10.20.193.10:0/756432318 >> v1:10.20.193.10:6789/0 conn(0x7fc574155e80 legacy=0x7fc5740745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7fc579033640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7fc579033640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7fc579033640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7fc579033640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7fc579033640 1 -- 10.20.193.10:0/756432318 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc574073ae0 con 0x7fc574074cd0 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7f58a2f05640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f589c156260 0x7f589c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7f58a2f05640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f589c156260 0x7f589c0c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38304/0 (socket says 10.20.193.10:38304) 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f58a2f05640 1 -- 10.20.193.10:0/861504163 learned_addr learned my addr 10.20.193.10:0/861504163 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f58a2f05640 10 monclient(hunting): get_auth_request con 0x7f589c156260 auth_method 0 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f58a2f05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f58a2f05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f58a2f05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7f0249032640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7f0249032640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.108+0000 7f0249032640 10 monclient: monmap: 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.110225+0000 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.110225+0000 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.123 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7ff19612a640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7ff19612a640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7ff19612a640 10 monclient: monmap: 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.110312+0000 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.110312+0000 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 1 Processor -- start 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 1 -- start start 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 10 monclient: init 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f58a2f05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f58a2f05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f58a2f05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7ff19612a640 1 Processor -- start 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f13d9d74640 1 --2- 10.20.193.10:0/1630622709 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc152a40 0x7f13dc15ae60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13dc1563f0 tx=0x7f13c402eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfe0d1c7c25971f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7ff19612a640 1 -- start start 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7ff19612a640 10 monclient: init 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f8742ffd640 1 --2- 10.20.193.10:0/267912522 >> v2:10.20.193.10:3300/0 conn(0x7f8744074cd0 0x7f87440ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 10 monclient: _add_conns ranks=[4,2,1,3,5,0] 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f0244155e80 0x7f02440745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 10 monclient(hunting): picked mon.noname-b con 0x7f0244155e80 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0244156260 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f02440cd2d0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.109+0000 7f0249032640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0244073520 con 0x7f02440cd2d0 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7f0249032640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0244073800 con 0x7f0244156260 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7f0249032640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7f0249032640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f02440cd840 con 0x7f0244155e80 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7f0249032640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7f0249032640 10 monclient(hunting): authenticate will time out at 1028.832019s 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 10 monclient: _add_conns ranks=[5,2,0,1,4,3] 2026-02-17T11:55:59.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff19015d220 0x7ff19015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 10 monclient(hunting): picked mon.noname-c con 0x7ff19015d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7fab3a903640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7fab3a903640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7fab3a903640 10 monclient: monmap: 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.111373+0000 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.111373+0000 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff190074920 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff1900c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1900c58a0 con 0x7ff1900c92f0 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1900c55c0 con 0x7ff190074920 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff1900c7e20 con 0x7ff19015d220 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7ff19612a640 10 monclient(hunting): authenticate will time out at 1028.832160s 2026-02-17T11:55:59.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7f71bdd36640 1 --2- 10.20.193.10:0/2269421115 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f71b8152400 0x7f71b815d0e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f71b80cd430 tx=0x7f71a802eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57083d455fbda676 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7fc579033640 1 --2- 10.20.193.10:0/756432318 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc574074cd0 0x7fc5740ccbc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc568009970 tx=0x7fc56802eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee17a3caebdafaf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7fab3a903640 1 Processor -- start 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7fab3a903640 1 -- start start 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.110+0000 7fab3a903640 10 monclient: init 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 10 monclient: _add_conns ranks=[4,5,1,0,2,3] 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fab34155e80 0x7fab340745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 10 monclient(hunting): picked mon.noname-b con 0x7fab34155e80 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972167409 0 0) 0x7f8744073520 con 0x7f8744156260 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f87427fc640 10 monclient(hunting): _negotiate 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f87427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f87427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f87427fc640 10 monclient(hunting): my global_id is 4498 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fab34156260 0x7fab34074b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 10 monclient(hunting): picked mon.noname-c con 0x7fab34156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8728003620 con 0x7f8744156260 2026-02-17T11:55:59.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fab340ccbc0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab34073520 con 0x7fab340ccbc0 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fab340cd840 con 0x7fab34155e80 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fab34073800 con 0x7fab34156260 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7fab3a903640 10 monclient(hunting): authenticate will time out at 1028.833325s 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 10 monclient(hunting): handle_auth_done global_id 4425 payload 824 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 1 -- 10.20.193.10:0/861504163 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f589c155e80 msgr2=0x7f589c158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f589c155e80 0x7f589c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 1 -- 10.20.193.10:0/861504163 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f589c074cd0 msgr2=0x7f589c1f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f589c074cd0 0x7f589c1f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 1 monclient: found mon.noname-a 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.111+0000 7f58a2f05640 1 -- 10.20.193.10:0/861504163 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c0c8f90 con 0x7f589c156260 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.112+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857964412 0 0) 0x7fcab80d2300 con 0x7fcab80c92b0 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.112+0000 7fcab5573640 10 monclient(hunting): _negotiate 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.112+0000 7fcab5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.112+0000 7fcab5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.112+0000 7fcab5573640 10 monclient(hunting): my global_id is 4501 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.112+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaa4003620 con 0x7fcab80c92b0 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.112+0000 7f0242d76640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f0244155e80 0x7f02440745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.113+0000 7f0242d76640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f0244155e80 0x7f02440745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47106/0 (socket says 10.20.193.10:47106) 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.113+0000 7f0242d76640 1 -- 10.20.193.10:0/3586363036 learned_addr learned my addr 10.20.193.10:0/3586363036 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.113+0000 7f0242d76640 10 monclient(hunting): get_auth_request con 0x7f0244155e80 auth_method 0 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.113+0000 7f0242d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.113+0000 7f0242d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.113+0000 7f0242d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f58a2f05640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f589c156260 0x7f589c0c7b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5890009d30 tx=0x7f589000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f5886ffd640 10 client.?.objecter ms_handle_connect 0x7f589c156260 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f5886ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f8742ffd640 10 monclient(hunting): get_auth_request con 0x7f8744074cd0 auth_method 0 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f8742ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f8742ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f8742ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 1 -- 10.20.193.10:0/771972275 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4003a70 con 0x7f99d415f5c0 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 10 monclient: dump: 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 1 -- 10.20.193.10:0/771972275 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c4003c10 con 0x7f99d415f5c0 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d8bce640 5 monclient: authenticate success, global_id 4478 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d8bce640 10 monclient: _renew_subs 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d0d72640 4 set_mon_vals no callback set 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d8bce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d40cdb60 con 0x7f99d415f5c0 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 1 -- 10.20.193.10:0/771972275 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4003a70 con 0x7f99d415f5c0 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99baffd640 10 monclient: dump: 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d8bce640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d8bce640 10 monclient: _renew_subs 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d8bce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d40ce120 con 0x7f99d415f5c0 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f99d8bce640 1 librados: init done 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f8742ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f8742ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7f8742ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7ff18f7fe640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff19015d220 0x7ff19015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7fae30ccb640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fae2c0d1710 0x7fae2c0ce1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:42124/0 (socket says 10.20.193.10:42124) 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.114+0000 7fae30ccb640 1 -- 10.20.193.10:0/482536272 learned_addr learned my addr 10.20.193.10:0/482536272 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7f99d8bce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7f99d8bce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7f99d8bce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d406d6b0 con 0x7f99d415f5c0 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7ff18f7fe640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff19015d220 0x7ff19015d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35746/0 (socket says 10.20.193.10:35746) 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7ff18f7fe640 1 -- 10.20.193.10:0/2439353136 learned_addr learned my addr 10.20.193.10:0/2439353136 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7ff18f7fe640 10 monclient(hunting): get_auth_request con 0x7ff19015d220 auth_method 0 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7ff18f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7ff18f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7ff18f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7ff18f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7ff18f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7ff18f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.115+0000 7fae2bfff640 1 --2- 10.20.193.10:0/482536272 >> v2:10.20.193.153:3300/0 conn(0x7fae2c156020 0x7fae2c0cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1186093420 0 0) 0x7fcaa4003620 con 0x7fcab80c92b0 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 >> v2:10.20.193.153:3300/0 conn(0x7fcab815a4f0 msgr2=0x7fcab80d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 --2- 10.20.193.10:0/1714634857 >> v2:10.20.193.153:3300/0 conn(0x7fcab815a4f0 0x7fcab80d1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 >> v1:10.20.193.153:6789/0 conn(0x7fcab80d1e90 legacy=0x7fcab80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab8160280 con 0x7fcab80c92b0 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fcaa8003280 con 0x7fcab80c92b0 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient: dump: 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 >> v1:10.20.193.71:6789/0 conn(0x7fcab80c92b0 legacy=0x7fcab8163800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 --2- 10.20.193.10:0/1714634857 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcaa4003b50 0x7fcaa4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient(hunting): picked mon.b con 0x7fcaa4003b50 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 --2- 10.20.193.10:0/1714634857 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 0x7fcaa4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient(hunting): picked mon.a con 0x7fcaa4004900 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 --2- 10.20.193.10:0/1714634857 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcaa4005470 0x7fcaa400bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient(hunting): picked mon.c con 0x7fcaa4005470 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8164620 con 0x7fcaa4004900 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa400c3c0 con 0x7fcaa4003b50 2026-02-17T11:55:59.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa400c5c0 con 0x7fcaa4005470 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fcab5573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fab38e79640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fab340ccbc0 0x7fab340ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:58032/0 (socket says 10.20.193.10:58032) 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fab38e79640 1 -- 10.20.193.10:0/2793147683 learned_addr learned my addr 10.20.193.10:0/2793147683 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7f0242d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7f0242d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7f0242d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fe44b666640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fe44b666640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fe44b666640 10 monclient: monmap: 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.117759+0000 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.117759+0000 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fe44b666640 1 Processor -- start 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.116+0000 7fe44b666640 1 -- start start 2026-02-17T11:55:59.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 10 monclient: init 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7ff18f7fe640 10 monclient(hunting): handle_auth_done global_id 4487 payload 274 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7ff18f7fe640 1 -- 10.20.193.10:0/2439353136 >> v1:10.20.193.153:6789/0 conn(0x7ff190074920 legacy=0x7ff1900c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7ff18f7fe640 1 -- 10.20.193.10:0/2439353136 >> v1:10.20.193.10:6789/0 conn(0x7ff1900c92f0 legacy=0x7ff190153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7ff18f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7ff18f7fe640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7ff18f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7ff18f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7ff18f7fe640 1 -- 10.20.193.10:0/2439353136 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1900c8100 con 0x7ff19015d220 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7f0242d76640 10 monclient(hunting): handle_auth_done global_id 4504 payload 274 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7f0242d76640 1 -- 10.20.193.10:0/3586363036 >> v1:10.20.193.153:6789/0 conn(0x7f0244156260 legacy=0x7f02440ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7f0242d76640 1 -- 10.20.193.10:0/3586363036 >> v1:10.20.193.71:6789/0 conn(0x7f02440cd2d0 legacy=0x7f024415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7f0242d76640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7f0242d76640 1 monclient: found mon.noname-b 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7f0242d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7f0242d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7f0242d76640 1 -- 10.20.193.10:0/3586363036 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0244073ae0 con 0x7f0244155e80 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 10 monclient: _add_conns ranks=[2,0,1,5,3,4] 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe444155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe444074cd0 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe444156260 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe444073520 con 0x7fe444074cd0 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe444073800 con 0x7fe444156260 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe444073ae0 con 0x7fe444155e80 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fe44b666640 10 monclient(hunting): authenticate will time out at 1028.839667s 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fae2bfff640 10 monclient(hunting): get_auth_request con 0x7fae2c156020 auth_method 0 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fae2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fae2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.117+0000 7fae2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 1 -- 10.20.193.10:0/1630622709 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c403c070 con 0x7f13dc152a40 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7fae2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7fae2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7fae2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 10 monclient: dump: 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.135 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 1 -- 10.20.193.10:0/1630622709 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c402fbe0 con 0x7f13dc152a40 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 5 monclient: authenticate success, global_id 4492 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 4 set_mon_vals no callback set 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 1 -- 10.20.193.10:0/1630622709 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4037440 con 0x7f13dc152a40 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13d9573640 10 monclient: dump: 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 10 monclient: shutdown 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1630622709 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc152a40 msgr2=0x7f13dc15ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 1 --2- 10.20.193.10:0/1630622709 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc152a40 0x7f13dc15ae60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13dc1563f0 tx=0x7f13c402eed0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1630622709 shutdown_connections 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 1 --2- 10.20.193.10:0/1630622709 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc152a40 0x7f13dc15ae60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 1 --2- 10.20.193.10:0/1630622709 >> v2:10.20.193.10:3300/0 conn(0x7f13dc152660 0x7f13dc15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1630622709 >> 10.20.193.10:0/1630622709 conn(0x7f13dc0c9d80 msgr2=0x7f13dc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1630622709 shutdown_connections 2026-02-17T11:55:59.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1630622709 wait complete. 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.118+0000 7fab337fe640 1 --2- 10.20.193.10:0/2793147683 >> v2:10.20.193.153:3300/0 conn(0x7fab34156260 0x7fab34074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3166136013 0 0) 0x7f8728003620 con 0x7f8744156260 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 >> v2:10.20.193.10:3300/0 conn(0x7f8744074cd0 msgr2=0x7f87440ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 --2- 10.20.193.10:0/267912522 >> v2:10.20.193.10:3300/0 conn(0x7f8744074cd0 0x7f87440ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 >> v1:10.20.193.153:6789/0 conn(0x7f8744155e80 legacy=0x7f87440745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8744073ae0 con 0x7f8744156260 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f8738003280 con 0x7f8744156260 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient: dump: 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 >> v1:10.20.193.71:6789/0 conn(0x7f8744156260 legacy=0x7f874415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8728003bf0 0x7f8728004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient(hunting): picked mon.a con 0x7f8728003bf0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8728004900 0x7f8728004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient(hunting): picked mon.c con 0x7f8728004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 0x7f872800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient(hunting): picked mon.b con 0x7f87280054c0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f87440cd840 con 0x7f8728003bf0 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f872800c330 con 0x7f87280054c0 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f872800c530 con 0x7f8728004900 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f87427fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f13e0ebf640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f13e0ebf640 10 monclient: monmap: 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f13e0ebf640 1 librados: starting msgr at 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f13e0ebf640 1 librados: starting objecter 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f13e0ebf640 1 Processor -- start 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f13e0ebf640 1 -- start start 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f13e0ebf640 1 librados: setting wanted keys 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f13e0ebf640 1 librados: calling monclient init 2026-02-17T11:55:59.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7f13e0ebf640 10 monclient: init 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7fae2bfff640 10 monclient(hunting): handle_auth_done global_id 4493 payload 274 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7fae2bfff640 1 -- 10.20.193.10:0/482536272 >> v2:10.20.193.10:3300/0 conn(0x7fae2c0c98f0 msgr2=0x7fae2c0c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7fae2bfff640 1 --2- 10.20.193.10:0/482536272 >> v2:10.20.193.10:3300/0 conn(0x7fae2c0c98f0 0x7fae2c0c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7fae2bfff640 1 -- 10.20.193.10:0/482536272 >> v1:10.20.193.10:6789/0 conn(0x7fae2c0d1710 legacy=0x7fae2c0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7fae2bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7fae2bfff640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7fae2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7fae2bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.119+0000 7fae2bfff640 1 -- 10.20.193.10:0/482536272 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c0d2290 con 0x7fae2c156020 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7fab337fe640 10 monclient(hunting): get_auth_request con 0x7fab34156260 auth_method 0 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7fab337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7fab337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7fab337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc0c8dd0 0x7f13dc1f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient(hunting): picked mon.noname-b con 0x7f13dc0c8dd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f13dc152660 0x7f13dc1f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient(hunting): picked mon.noname-c con 0x7f13dc152660 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13dc152a40 0x7f13dc14de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient(hunting): picked mon.noname-a con 0x7f13dc152a40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc0c5cd0 con 0x7f13dc152a40 2026-02-17T11:55:59.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc15a400 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc0c5e50 con 0x7f13dc152660 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f13e0ebf640 10 monclient(hunting): authenticate will time out at 1028.842263s 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7ff18f7fe640 1 --2- 10.20.193.10:0/2439353136 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 0x7ff19015d600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0099a0 tx=0x7ff17c02ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc086c8949fcdc60 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 1 -- 10.20.193.10:0/861504163 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890018020 con 0x7f589c156260 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 10 monclient: dump: 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 1 -- 10.20.193.10:0/861504163 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5890014480 con 0x7f589c156260 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a498f640 5 monclient: authenticate success, global_id 4425 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 1 -- 10.20.193.10:0/861504163 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890014870 con 0x7f589c156260 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a498f640 10 monclient: _renew_subs 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a498f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589c0c9270 con 0x7f589c156260 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f5886ffd640 10 monclient: dump: 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a0f01640 4 set_mon_vals no callback set 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a498f640 10 client.4425.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a498f640 10 monclient: _renew_subs 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a498f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f589c0c9830 con 0x7f589c156260 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.120+0000 7f58a498f640 1 librados: init done 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fab337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fab337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fab337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fae2bfff640 1 --2- 10.20.193.10:0/482536272 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c156020 0x7fae2c0cb590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae2c08ebe0 tx=0x7fae1802eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc6e31fb7b776d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7f58a498f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7f58a498f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fcab5d74640 1 --2- 10.20.193.10:0/1714634857 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 0x7fcaa4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7f58a498f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589c06e2a0 con 0x7f589c156260 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fab33fff640 1 --2- 10.20.193.10:0/2793147683 >> v2:10.20.193.71:3300/0 conn(0x7fab34155e80 0x7fab340745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fcab5d74640 10 monclient(hunting): get_auth_request con 0x7fcaa4004900 auth_method 0 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fcab5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fcab5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fcab5d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fe448bda640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fe444074cd0 0x7fe4440ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:42132/0 (socket says 10.20.193.10:42132) 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fe448bda640 1 -- 10.20.193.10:0/1068312535 learned_addr learned my addr 10.20.193.10:0/1068312535 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fc98cb33640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fc98cb33640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.121+0000 7fc98cb33640 10 monclient: monmap: 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.123223+0000 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.123223+0000 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.142 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fc98cb33640 1 Processor -- start 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fc98cb33640 1 -- start start 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fc98cb33640 10 monclient: init 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7f0242d76640 1 --2- 10.20.193.10:0/3586363036 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244155e80 0x7f02440745c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0238009970 tx=0x7f023802eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c18d3fc23a780b1a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fab33fff640 10 monclient(hunting): get_auth_request con 0x7fab34155e80 auth_method 0 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fab33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fab33fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fab33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fcab5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fcab5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.122+0000 7fcab5d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 10 monclient: _add_conns ranks=[2,0,1,4,5,3] 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc988150520 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc98815d070 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc9881623f0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98815af70 con 0x7fc98815d070 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98815b250 con 0x7fc9881623f0 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98815b530 con 0x7fc988150520 2026-02-17T11:55:59.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 1 -- 10.20.193.10:0/756432318 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56803c070 con 0x7fc574074cd0 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 10 monclient: dump: 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 1 -- 10.20.193.10:0/756432318 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56802fb60 con 0x7fc574074cd0 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 1 -- 10.20.193.10:0/756432318 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568037440 con 0x7fc574074cd0 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc578832640 10 monclient: dump: 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc98cb33640 10 monclient(hunting): authenticate will time out at 1028.845295s 2026-02-17T11:55:59.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fab33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fab33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fab33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 5 monclient: authenticate success, global_id 4484 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 4 set_mon_vals no callback set 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 10 monclient: shutdown 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 1 -- 10.20.193.10:0/756432318 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc574074cd0 msgr2=0x7fc5740ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 1 --2- 10.20.193.10:0/756432318 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc574074cd0 0x7fc5740ccbc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc568009970 tx=0x7fc56802eef0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7f87437fe640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8728003bf0 0x7f8728004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fab32ffd640 1 -- 10.20.193.10:0/2793147683 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627341524 0 0) 0x7fab34073520 con 0x7fab340ccbc0 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fab32ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fab32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fab32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fab32ffd640 10 monclient(hunting): my global_id is 4507 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fab32ffd640 1 -- 10.20.193.10:0/2793147683 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab18003620 con 0x7fab340ccbc0 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 1 -- 10.20.193.10:0/756432318 shutdown_connections 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 1 --2- 10.20.193.10:0/756432318 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc574074cd0 0x7fc5740ccbc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 1 -- 10.20.193.10:0/756432318 >> 10.20.193.10:0/756432318 conn(0x7fc5740ce2b0 msgr2=0x7fc5740ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 1 -- 10.20.193.10:0/756432318 shutdown_connections 2026-02-17T11:55:59.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7fc57babf640 1 -- 10.20.193.10:0/756432318 wait complete. 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7f168dda8640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7f168dda8640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.123+0000 7f168dda8640 10 monclient: monmap: 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.125192+0000 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.125192+0000 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 10 monclient: monmap: 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7f168dda8640 1 Processor -- start 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 1 librados: starting msgr at 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 1 librados: starting objecter 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 1 Processor -- start 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 1 -- start start 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 1 librados: setting wanted keys 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 1 librados: calling monclient init 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 10 monclient: init 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fab33fff640 10 monclient(hunting): handle_auth_done global_id 4510 payload 274 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fab33fff640 1 -- 10.20.193.10:0/2793147683 >> v2:10.20.193.153:3300/0 conn(0x7fab34156260 msgr2=0x7fab34074b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fab33fff640 1 --2- 10.20.193.10:0/2793147683 >> v2:10.20.193.153:3300/0 conn(0x7fab34156260 0x7fab34074b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fab33fff640 1 -- 10.20.193.10:0/2793147683 >> v1:10.20.193.71:6789/0 conn(0x7fab340ccbc0 legacy=0x7fab340ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fab33fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fab33fff640 1 monclient: found mon.noname-b 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fab33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fab33fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fab33fff640 1 -- 10.20.193.10:0/2793147683 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab34073ae0 con 0x7fab34155e80 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 10 monclient(hunting): handle_auth_done global_id 4501 payload 293 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 1 -- 10.20.193.10:0/1714634857 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcaa4005470 msgr2=0x7fcaa400bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 1 --2- 10.20.193.10:0/1714634857 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcaa4005470 0x7fcaa400bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 1 -- 10.20.193.10:0/1714634857 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcaa4003b50 msgr2=0x7fcaa4003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 1 --2- 10.20.193.10:0/1714634857 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcaa4003b50 0x7fcaa4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 1 monclient: found mon.a 2026-02-17T11:55:59.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7f168dda8640 1 -- start start 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7f168dda8640 10 monclient: init 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7f168dda8640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7f168dda8640 10 monclient: _add_conns ranks=[0,3,5,2,1,4] 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab6d76640 1 -- 10.20.193.10:0/1714634857 reap_dead start 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 1 -- 10.20.193.10:0/1714634857 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab8160280 con 0x7fcaa4004900 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fc57babf640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcab5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcabcc87640 5 monclient: authenticate success, global_id 4501 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.124+0000 7fcabcc87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc574074cd0 0x7fc5741f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 10 monclient(hunting): picked mon.noname-c con 0x7fc574074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc574155e80 0x7fc5741e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 10 monclient(hunting): picked mon.noname-b con 0x7fc574155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc574156260 0x7fc5741e91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1688156020 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:59.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f16880c98f0 0x7f16880c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 10 monclient(hunting): picked mon.noname-a con 0x7f16880c98f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 1 -- 10.20.193.10:0/2269421115 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a803c070 con 0x7f71b8152400 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fb19cd22640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fb19cd22640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fb19cd22640 10 monclient: monmap: 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.126364+0000 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.126364+0000 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 10 monclient(hunting): picked mon.noname-a con 0x7fc574156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740c4870 con 0x7fc574156260 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740740a0 con 0x7fc574155e80 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740c49f0 con 0x7fc574074cd0 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fc57babf640 10 monclient(hunting): authenticate will time out at 1028.847149s 2026-02-17T11:55:59.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f16880d1710 0x7f16880d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 10 monclient(hunting): picked mon.noname-c con 0x7f16880d1710 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16880c8ba0 con 0x7f1688156020 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f16880c9460 con 0x7f16880c98f0 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f168815cbf0 con 0x7f16880d1710 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f168dda8640 10 monclient(hunting): authenticate will time out at 1028.847201s 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 10 monclient: dump: 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 1 -- 10.20.193.10:0/2269421115 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a802fb80 con 0x7f71b8152400 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 1 -- 10.20.193.10:0/2269421115 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8037440 con 0x7f71b8152400 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bcd34640 10 monclient: dump: 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.150 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 5 monclient: authenticate success, global_id 4481 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 4 set_mon_vals no callback set 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f14d8816640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 0x7f14a4083800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 10 monclient: shutdown 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 1 -- 10.20.193.10:0/2269421115 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f71b8152400 msgr2=0x7f71b815d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 1 --2- 10.20.193.10:0/2269421115 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f71b8152400 0x7f71b815d0e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f71b80cd430 tx=0x7f71a802eeb0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fb19cd22640 1 Processor -- start 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 1 -- 10.20.193.10:0/2269421115 shutdown_connections 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 1 --2- 10.20.193.10:0/2269421115 >> v2:10.20.193.10:3300/0 conn(0x7f71b80ccd10 0x7f71b806e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 1 --2- 10.20.193.10:0/2269421115 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f71b8152400 0x7f71b815d0e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 1 -- 10.20.193.10:0/2269421115 >> 10.20.193.10:0/2269421115 conn(0x7f71b80ca190 msgr2=0x7f71b80ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f14d8816640 10 monclient: get_auth_request con 0x7f14a40813c0 auth_method 0 2026-02-17T11:55:59.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fb19cd22640 1 -- start start 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7fb19cd22640 10 monclient: init 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 1 -- 10.20.193.10:0/2269421115 shutdown_connections 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.125+0000 7f71bffc1640 1 -- 10.20.193.10:0/2269421115 wait complete. 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 10 monclient: _add_conns ranks=[2,1,3,5,4,0] 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f71bffc1640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f71bffc1640 10 monclient: monmap: 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb198155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb198074cd0 addr v1:10.20.193.71:6789/0 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fb198156260 0x7fb198166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 10 monclient(hunting): picked mon.noname-a con 0x7fb198156260 addr v2:10.20.193.10:3300/0 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb198073520 con 0x7fb198074cd0 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb198073800 con 0x7fb198155e80 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fb1980cd840 con 0x7fb198156260 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7fb19cd22640 10 monclient(hunting): authenticate will time out at 1028.848450s 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f87437fe640 10 monclient(hunting): get_auth_request con 0x7f8728003bf0 auth_method 0 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f87437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f87437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f87437fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f71bffc1640 1 librados: starting msgr at 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f71bffc1640 1 librados: starting objecter 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f71bffc1640 1 Processor -- start 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f71bffc1640 1 -- start start 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f71bffc1640 1 librados: setting wanted keys 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f71bffc1640 1 librados: calling monclient init 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.126+0000 7f71bffc1640 10 monclient: init 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f71b80ccd10 0x7f71b814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient(hunting): picked mon.noname-c con 0x7f71b80ccd10 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f71b8152400 0x7f71b8147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient(hunting): picked mon.noname-a con 0x7f71b8152400 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f71b81527e0 0x7f71b8147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient(hunting): picked mon.noname-b con 0x7f71b81527e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f14d0ff9640 10 client.4407.objecter ms_handle_connect 0x7f14a40813c0 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f14d8816640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 0x7f14a4083800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7fab33fff640 1 --2- 10.20.193.10:0/2793147683 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fab34155e80 0x7fab340745c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab3408f5e0 tx=0x7fab2002ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4ae5d1b7445622 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80cb610 con 0x7f71b8152400 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80cc7f0 con 0x7f71b81527e0 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71b815ff90 con 0x7f71b80ccd10 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.127+0000 7f71bffc1640 10 monclient(hunting): authenticate will time out at 1028.849651s 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 1 -- 10.20.193.10:0/3586363036 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023803c070 con 0x7f0244155e80 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 10 monclient: dump: 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.154 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 1 -- 10.20.193.10:0/3586363036 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023802fb60 con 0x7f0244155e80 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0249032640 5 monclient: authenticate success, global_id 4504 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0249032640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0249032640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 1 -- 10.20.193.10:0/3586363036 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238037440 con 0x7f0244155e80 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0249032640 4 set_mon_vals no callback set 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0241d74640 10 monclient: dump: 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 1 -- 10.20.193.10:0/482536272 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1803c070 con 0x7fae2c156020 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 10 monclient: dump: 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.155 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 1 -- 10.20.193.10:0/482536272 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1802fb80 con 0x7fae2c156020 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae32755640 5 monclient: authenticate success, global_id 4493 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae32755640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 1 -- 10.20.193.10:0/482536272 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18037440 con 0x7fae2c156020 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae2affd640 10 monclient: dump: 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae32755640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7fae32755640 4 set_mon_vals no callback set 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0249032640 10 monclient: shutdown 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0249032640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0249032640 1 -- 10.20.193.10:0/3586363036 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244155e80 msgr2=0x7f02440745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.128+0000 7f0249032640 1 --2- 10.20.193.10:0/3586363036 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244155e80 0x7f02440745c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0238009970 tx=0x7f023802eef0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 -- 10.20.193.10:0/3586363036 shutdown_connections 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 --2- 10.20.193.10:0/3586363036 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244155e80 0x7f02440745c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 -- 10.20.193.10:0/3586363036 >> 10.20.193.10:0/3586363036 conn(0x7f02440ce2b0 msgr2=0x7f02440ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 -- 10.20.193.10:0/3586363036 shutdown_connections 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 -- 10.20.193.10:0/3586363036 wait complete. 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 10 monclient: shutdown 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 1 -- 10.20.193.10:0/482536272 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c156020 msgr2=0x7fae2c0cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 1 --2- 10.20.193.10:0/482536272 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c156020 0x7fae2c0cb590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae2c08ebe0 tx=0x7fae1802eeb0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 1 -- 10.20.193.10:0/482536272 shutdown_connections 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 1 --2- 10.20.193.10:0/482536272 >> v2:10.20.193.10:3300/0 conn(0x7fae2c0c98f0 0x7fae2c0c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 1 --2- 10.20.193.10:0/482536272 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c156020 0x7fae2c0cb590 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 1 -- 10.20.193.10:0/482536272 >> 10.20.193.10:0/482536272 conn(0x7fae2c06d970 msgr2=0x7fae2c06dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 1 -- 10.20.193.10:0/482536272 shutdown_connections 2026-02-17T11:55:59.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7fae32755640 1 -- 10.20.193.10:0/482536272 wait complete. 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 10 monclient: monmap: 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 librados: starting msgr at 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 librados: starting objecter 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 Processor -- start 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 -- start start 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 librados: setting wanted keys 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 1 librados: calling monclient init 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.129+0000 7f0249032640 10 monclient: init 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 10 monclient: monmap: 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 1 librados: starting msgr at 2026-02-17T11:55:59.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 1 librados: starting objecter 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f02440cd2d0 0x7f02441f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 1 Processor -- start 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 1 -- start start 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 1 librados: setting wanted keys 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 1 librados: calling monclient init 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient(hunting): picked mon.noname-a con 0x7f02440cd2d0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0244155e80 0x7f0244158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient(hunting): picked mon.noname-c con 0x7f0244155e80 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 10 monclient: init 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244156260 0x7f02440745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient(hunting): picked mon.noname-b con 0x7f0244156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f02440c4870 con 0x7f02440cd2d0 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02440740a0 con 0x7f0244156260 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f02440c49f0 con 0x7f0244155e80 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f0249032640 10 monclient(hunting): authenticate will time out at 1028.852586s 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7f8743fff640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 0x7f872800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fae32755640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7f8743fff640 10 monclient(hunting): get_auth_request con 0x7f87280054c0 auth_method 0 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7f8743fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7f8743fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7f8743fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.130+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328676029 0 0) 0x7fe444073520 con 0x7fe444074cd0 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fe433fff640 10 monclient(hunting): _negotiate 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fe433fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fe433fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fe433fff640 10 monclient(hunting): my global_id is 4434 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c0c98f0 0x7fae2c156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 10 monclient(hunting): picked mon.noname-c con 0x7fae2c0c98f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c0d1710 0x7fae2c144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe42c003620 con 0x7fe444074cd0 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 10 monclient(hunting): picked mon.noname-a con 0x7fae2c0d1710 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c156020 0x7fae2c158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 10 monclient(hunting): picked mon.noname-b con 0x7fae2c156020 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c0c90f0 con 0x7fae2c0d1710 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c0c8e10 con 0x7fae2c156020 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c0cc120 con 0x7fae2c0c98f0 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7fae32755640 10 monclient(hunting): authenticate will time out at 1028.853251s 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7f8743fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7f8743fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.131+0000 7f8743fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.132+0000 7f13da575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc0c8dd0 0x7f13dc1f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.132+0000 7f13da575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc0c8dd0 0x7f13dc1f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47134/0 (socket says 10.20.193.10:47134) 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.132+0000 7f13da575640 1 -- 10.20.193.10:0/1935467456 learned_addr learned my addr 10.20.193.10:0/1935467456 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.132+0000 7f13da575640 10 monclient(hunting): get_auth_request con 0x7f13dc0c8dd0 auth_method 0 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.132+0000 7f13da575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.132+0000 7f13da575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.132+0000 7f13da575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 10 monclient(hunting): handle_auth_done global_id 4498 payload 293 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 1 -- 10.20.193.10:0/267912522 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8728004900 msgr2=0x7f8728004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8728004900 0x7f8728004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 1 -- 10.20.193.10:0/267912522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8728003bf0 msgr2=0x7f8728004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8728003bf0 0x7f8728004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 1 monclient: found mon.b 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 1 -- 10.20.193.10:0/267912522 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8728003620 con 0x7f87280054c0 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f874a287640 5 monclient: authenticate success, global_id 4498 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f874a287640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f8743fff640 1 -- 10.20.193.10:0/267912522 reap_dead start 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f13da575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f13da575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f13da575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.133+0000 7f71be537640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f71b81527e0 0x7f71b8147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.134+0000 7f71be537640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f71b81527e0 0x7f71b8147740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47148/0 (socket says 10.20.193.10:47148) 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.134+0000 7f71be537640 1 -- 10.20.193.10:0/3283439339 learned_addr learned my addr 10.20.193.10:0/3283439339 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.134+0000 7f71be537640 10 monclient(hunting): get_auth_request con 0x7f71b81527e0 auth_method 0 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.134+0000 7f71be537640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.134+0000 7f71be537640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.134+0000 7f71be537640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 10 monclient(hunting): handle_auth_done global_id 4513 payload 824 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 1 -- 10.20.193.10:0/1935467456 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f13dc152660 msgr2=0x7f13dc1f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f13dc152660 0x7f13dc1f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 1 -- 10.20.193.10:0/1935467456 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13dc152a40 msgr2=0x7f13dc14de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13dc152a40 0x7f13dc14de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 1 monclient: found mon.noname-b 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.135+0000 7f13da575640 1 -- 10.20.193.10:0/1935467456 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc148fa0 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.136+0000 7f71be537640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.136+0000 7f71be537640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.136+0000 7f71be537640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 1 -- 10.20.193.10:0/2793147683 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2003c070 con 0x7fab34155e80 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 10 monclient: dump: 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 1 -- 10.20.193.10:0/2793147683 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2002faf0 con 0x7fab34155e80 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 1 -- 10.20.193.10:0/2793147683 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20037440 con 0x7fab34155e80 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 5 monclient: authenticate success, global_id 4510 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 4 set_mon_vals no callback set 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab32ffd640 10 monclient: dump: 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 10 monclient: shutdown 2026-02-17T11:55:59.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 1 -- 10.20.193.10:0/2793147683 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fab34155e80 msgr2=0x7fab340745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 1 --2- 10.20.193.10:0/2793147683 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fab34155e80 0x7fab340745c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab3408f5e0 tx=0x7fab2002ede0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 1 -- 10.20.193.10:0/2793147683 shutdown_connections 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 1 --2- 10.20.193.10:0/2793147683 >> v2:10.20.193.153:3300/0 conn(0x7fab34156260 0x7fab34074b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 1 --2- 10.20.193.10:0/2793147683 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fab34155e80 0x7fab340745c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 1 -- 10.20.193.10:0/2793147683 >> 10.20.193.10:0/2793147683 conn(0x7fab340ce2b0 msgr2=0x7fab340ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.137+0000 7fab3a903640 1 -- 10.20.193.10:0/2793147683 shutdown_connections 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 1 -- 10.20.193.10:0/2793147683 wait complete. 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 10 monclient: monmap: 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 1 librados: starting msgr at 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 1 librados: starting objecter 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 1 Processor -- start 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 10 monclient(hunting): handle_auth_done global_id 4516 payload 824 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 1 -- 10.20.193.10:0/3283439339 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f71b80ccd10 msgr2=0x7f71b814d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f71b80ccd10 0x7f71b814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 1 -- 10.20.193.10:0/3283439339 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f71b8152400 msgr2=0x7f71b8147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f71b8152400 0x7f71b8147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 1 monclient: found mon.noname-b 2026-02-17T11:55:59.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 1 -- start start 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 1 librados: setting wanted keys 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7f71be537640 1 -- 10.20.193.10:0/3283439339 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b8146160 con 0x7f71b81527e0 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 1 librados: calling monclient init 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.138+0000 7fab3a903640 10 monclient: init 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fc579033640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc574155e80 0x7fc5741e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fab340ccbc0 0x7fab340c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient(hunting): picked mon.noname-c con 0x7fab340ccbc0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fab34155e80 0x7fab340ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient(hunting): picked mon.noname-b con 0x7fab34155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fab34156260 0x7fab3415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient(hunting): picked mon.noname-a con 0x7fab34156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fab340c4870 con 0x7fab34156260 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fab340740a0 con 0x7fab34155e80 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fab340c49f0 con 0x7fab340ccbc0 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7f13c2ffd640 10 client.?.objecter ms_handle_connect 0x7f13dc0c8dd0 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7f13c2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7f13da575640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc0c8dd0 0x7f13dc1f7650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f13d000b7b0 tx=0x7f13d000bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.139+0000 7fab3a903640 10 monclient(hunting): authenticate will time out at 1028.861680s 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.140+0000 7fc579033640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc574155e80 0x7fc5741e8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47142/0 (socket says 10.20.193.10:47142) 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.140+0000 7fc579033640 1 -- 10.20.193.10:0/3876363916 learned_addr learned my addr 10.20.193.10:0/3876363916 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.140+0000 7fc579033640 10 monclient(hunting): get_auth_request con 0x7fc574155e80 auth_method 0 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.140+0000 7fc579033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.140+0000 7fc579033640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.140+0000 7fc579033640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.140+0000 7f71be537640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f71b81527e0 0x7f71b8147740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f71b400efc0 tx=0x7f71b400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.140+0000 7f71a67fc640 10 client.?.objecter ms_handle_connect 0x7f71b81527e0 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.140+0000 7f71a67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.141+0000 7f0243577640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244156260 0x7f02440745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.141+0000 7fc579033640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.141+0000 7fc579033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.141+0000 7fc579033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.142+0000 7f0243577640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244156260 0x7f02440745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47160/0 (socket says 10.20.193.10:47160) 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.142+0000 7f0243577640 1 -- 10.20.193.10:0/4275763893 learned_addr learned my addr 10.20.193.10:0/4275763893 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.142+0000 7f0243577640 10 monclient(hunting): get_auth_request con 0x7f0244156260 auth_method 0 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.142+0000 7f0243577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.142+0000 7f0243577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.142+0000 7f0243577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 10 monclient(hunting): handle_auth_done global_id 4519 payload 824 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 1 -- 10.20.193.10:0/3876363916 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc574074cd0 msgr2=0x7fc5741f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc574074cd0 0x7fc5741f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 1 -- 10.20.193.10:0/3876363916 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc574156260 msgr2=0x7fc5741e91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc574156260 0x7fc5741e91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 1 monclient: found mon.noname-b 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.144+0000 7fc579033640 1 -- 10.20.193.10:0/3876363916 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5740c9e70 con 0x7fc574155e80 2026-02-17T11:55:59.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.145+0000 7fc986d76640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fc9881623f0 0x7fc9881647e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:58052/0 (socket says 10.20.193.10:58052) 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.145+0000 7fc986d76640 1 -- 10.20.193.10:0/3906703629 learned_addr learned my addr 10.20.193.10:0/3906703629 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.145+0000 7f0243577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.145+0000 7f0243577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.145+0000 7f0243577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 10 monclient(hunting): handle_auth_done global_id 4522 payload 824 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 1 -- 10.20.193.10:0/4275763893 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0244155e80 msgr2=0x7f0244158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0244155e80 0x7f0244158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 1 -- 10.20.193.10:0/4275763893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f02440cd2d0 msgr2=0x7f02441f0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f02440cd2d0 0x7f02441f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 1 monclient: found mon.noname-b 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7f0243577640 1 -- 10.20.193.10:0/4275763893 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02441e8f30 con 0x7f0244156260 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7fc579033640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc574155e80 0x7fc5741e8c60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc568009970 tx=0x7fc5680047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7fc5627fc640 10 client.?.objecter ms_handle_connect 0x7fc574155e80 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.148+0000 7fc5627fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.150+0000 7f0243577640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244156260 0x7f02440745c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f023400b990 tx=0x7f023400be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.150+0000 7f02237fe640 10 client.?.objecter ms_handle_connect 0x7f0244156260 2026-02-17T11:55:59.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.150+0000 7f02237fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.150+0000 7f14d0ff9640 1 -- 10.20.193.10:0/3587228391 <== osd.8 v2:10.20.193.10:6818/1997295941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f14c0018e50 con 0x7f14a40813c0 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.150+0000 7f14d0ff9640 10 client.4407.objecter ms_dispatch2 0x7f14d4000b90 command_reply(tid 1: 0 ) 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.150+0000 7f14d0ff9640 10 client.4407.objecter _finish_command 1 = system:0 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.150+0000 7f14d0ff9640 20 client.4407.objecter put_session s=0x7f14a4080cf0 osd=8 4 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.150+0000 7f14d0ff9640 15 client.4407.objecter _session_command_op_remove 8 1 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.151+0000 7f8743fff640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 0x7f872800bac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f873800a810 tx=0x7f873802fbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180b749dcffce9fd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.155+0000 7fae30ccb640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c156020 0x7fae2c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.155+0000 7fae30ccb640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c156020 0x7fae2c158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47168/0 (socket says 10.20.193.10:47168) 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.155+0000 7fae30ccb640 1 -- 10.20.193.10:0/3644012781 learned_addr learned my addr 10.20.193.10:0/3644012781 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.155+0000 7fae30ccb640 10 monclient(hunting): get_auth_request con 0x7fae2c156020 auth_method 0 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.155+0000 7fae30ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.155+0000 7fae30ccb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.155+0000 7fae30ccb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7fae30ccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7fae30ccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7fae30ccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 1 -- 10.20.193.10:0/3283439339 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4018020 con 0x7f71b81527e0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 10 monclient: dump: 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 1 -- 10.20.193.10:0/3283439339 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b4014480 con 0x7f71b81527e0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a7fff640 4 set_mon_vals no callback set 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 1 -- 10.20.193.10:0/3283439339 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4014870 con 0x7f71b81527e0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71bffc1640 5 monclient: authenticate success, global_id 4516 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71a67fc640 10 monclient: dump: 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71bffc1640 10 monclient: _renew_subs 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71bffc1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b8146440 con 0x7f71b81527e0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71bffc1640 10 client.4516.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71bffc1640 10 monclient: _renew_subs 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71bffc1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b8146a00 con 0x7f71b81527e0 2026-02-17T11:55:59.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.156+0000 7f71bffc1640 1 librados: init done 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 10 client.4407.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 15 client.4407.objecter _session_command_op_assign -1 2 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 20 client.4407.objecter _get_session s=0x7f14a4080cf0 osd=8 3 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 20 client.4407.objecter put_session s=0x7f14a4080cf0 osd=8 3 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 20 client.4407.objecter _get_session s=0x7f14a4080cf0 osd=8 3 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 15 client.4407.objecter _session_command_op_remove -1 2 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 20 client.4407.objecter get_session s=0x7f14a4080cf0 osd=8 3 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 15 client.4407.objecter _session_command_op_assign 8 2 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 20 client.4407.objecter put_session s=0x7f14a4080cf0 osd=8 4 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 10 client.4407.objecter _send_command 2 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 --> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14d406d1b0 con 0x7f14a40813c0 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f71bffc1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f71bffc1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f71bffc1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b80caf30 con 0x7f71b81527e0 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 10 monclient(hunting): handle_auth_done global_id 4531 payload 824 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 1 -- 10.20.193.10:0/3644012781 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c0c98f0 msgr2=0x7fae2c156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c0c98f0 0x7fae2c156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 1 -- 10.20.193.10:0/3644012781 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c0d1710 msgr2=0x7fae2c144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c0d1710 0x7fae2c144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 1 monclient: found mon.noname-b 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.157+0000 7fae30ccb640 1 -- 10.20.193.10:0/3644012781 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c1f6ef0 con 0x7fae2c156020 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.158+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704553089 0 0) 0x7fc98815b250 con 0x7fc9881623f0 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.158+0000 7fc985573640 10 monclient(hunting): _negotiate 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.158+0000 7fc985573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.158+0000 7fc985573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.158+0000 7fc985573640 10 monclient(hunting): my global_id is 4525 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.158+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc974003620 con 0x7fc9881623f0 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8738036070 con 0x7f87280054c0 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 10 monclient: dump: 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8738031660 con 0x7f87280054c0 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 1 -- 10.20.193.10:0/267912522 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873800a430 con 0x7f87280054c0 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 4 set_mon_vals no callback set 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f87427fc640 10 monclient: dump: 2026-02-17T11:55:59.173 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7fae30ccb640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c156020 0x7fae2c158030 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae2000cb80 tx=0x7fae2000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7fae28ff9640 10 client.?.objecter ms_handle_connect 0x7fae2c156020 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7fae28ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 10 monclient: shutdown 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 1 -- 10.20.193.10:0/267912522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 msgr2=0x7f872800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 0x7f872800bac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f873800a810 tx=0x7f873802fbf0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 1 -- 10.20.193.10:0/267912522 shutdown_connections 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 1 --2- 10.20.193.10:0/267912522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 0x7f872800bac0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 1 -- 10.20.193.10:0/267912522 >> 10.20.193.10:0/267912522 conn(0x7f87440ce2b0 msgr2=0x7f87440ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 1 -- 10.20.193.10:0/267912522 shutdown_connections 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.159+0000 7f874a287640 1 -- 10.20.193.10:0/267912522 wait complete. 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14d0ff9640 1 -- 10.20.193.10:0/3587228391 <== osd.8 v2:10.20.193.10:6818/1997295941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f14d406d1b0 con 0x7f14a40813c0 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14d0ff9640 10 client.4407.objecter ms_dispatch2 0x7f14d4000b90 command_reply(tid 2: 0 ) 2026-02-17T11:55:59.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14d0ff9640 10 client.4407.objecter _finish_command 2 = system:0 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14d0ff9640 20 client.4407.objecter put_session s=0x7f14a4080cf0 osd=8 4 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14d0ff9640 15 client.4407.objecter _session_command_op_remove 8 2 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f874a287640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f874a287640 10 monclient: monmap: 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 10 librados: watch_flush enter 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 10 librados: watch_flush exit 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 10 client.4407.objecter close_session for osd.8 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 msgr2=0x7f14a4083800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7f14a40813c0 0x7f14a4083800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 20 client.4407.objecter put_session s=0x7f14a4080cf0 osd=8 1 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 20 client.4407.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 10 client.4407.objecter successfully canceled tick 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f14a4078e80 msgr2=0x7f14a407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f14a4078e80 0x7f14a407b340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f14c4006fd0 tx=0x7f14c4006d40 comp rx=0 tx=0).stop 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 10 monclient: shutdown 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f14d415a240 msgr2=0x7f14d40c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 --2- 10.20.193.10:0/3587228391 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f14d415a240 0x7f14d40c4c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b5a0 tx=0x7f14c000ba70 comp rx=0 tx=0).stop 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14d8816640 1 -- 10.20.193.10:0/3587228391 reap_dead start 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f874a287640 1 librados: starting msgr at 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f874a287640 1 librados: starting objecter 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 shutdown_connections 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 >> 10.20.193.10:0/3587228391 conn(0x7f14d40c9d80 msgr2=0x7f14d4159900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f874a287640 1 Processor -- start 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 shutdown_connections 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 -- 10.20.193.10:0/3587228391 wait complete. 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f874a287640 1 -- start start 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f874a287640 1 librados: setting wanted keys 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f874a287640 1 librados: calling monclient init 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f874a287640 10 monclient: init 2026-02-17T11:55:59.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.160+0000 7f14da2a0640 1 librados: shutdown 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 0x7f87440ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient(hunting): picked mon.noname-b con 0x7f87280054c0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f87440ca590 0x7f87441f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient(hunting): picked mon.noname-c con 0x7f87440ca590 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f87441f5da0 0x7f8744144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient(hunting): picked mon.noname-a con 0x7f87441f5da0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f87440c4870 con 0x7f87441f5da0 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f87440740a0 con 0x7f87280054c0 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f87440c49f0 con 0x7f87440ca590 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.161+0000 7f874a287640 10 monclient(hunting): authenticate will time out at 1028.883346s 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 1 -- 10.20.193.10:0/3876363916 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568046070 con 0x7fc574155e80 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 10 monclient: dump: 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.177 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 1 -- 10.20.193.10:0/3876363916 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc568041890 con 0x7fc574155e80 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 1 -- 10.20.193.10:0/3876363916 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56803c040 con 0x7fc574155e80 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc57babf640 5 monclient: authenticate success, global_id 4519 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc57babf640 10 monclient: _renew_subs 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc563fff640 4 set_mon_vals no callback set 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc57babf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5740ca150 con 0x7fc574155e80 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc5627fc640 10 monclient: dump: 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc57babf640 10 client.4519.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc57babf640 10 monclient: _renew_subs 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc57babf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5740ca710 con 0x7fc574155e80 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.164+0000 7fc57babf640 1 librados: init done 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.165+0000 7fc57babf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.165+0000 7fc57babf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.165+0000 7fc57babf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.165+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5740745c0 con 0x7fc574155e80 2026-02-17T11:55:59.179 INFO:teuthology.orchestra.run.trial010.stdout:90194313223 2026-02-17T11:55:59.179 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T11:55:59.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.171+0000 7fcab5d74640 1 --2- 10.20.193.10:0/1714634857 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 0x7fcaa4004d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0003fb0 tx=0x7fcaa002ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5faf984a83e495e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 1 -- 10.20.193.10:0/2439353136 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c03c070 con 0x7ff19015d220 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 10 monclient: dump: 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 1 -- 10.20.193.10:0/2439353136 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17c02fb80 con 0x7ff19015d220 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 1 -- 10.20.193.10:0/2439353136 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c037440 con 0x7ff19015d220 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff19612a640 5 monclient: authenticate success, global_id 4487 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff19612a640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff19612a640 4 set_mon_vals no callback set 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.232+0000 7ff18e7fc640 10 monclient: dump: 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.235 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 10 monclient: shutdown 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 1 -- 10.20.193.10:0/2439353136 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 msgr2=0x7ff19015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 1 --2- 10.20.193.10:0/2439353136 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 0x7ff19015d600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0099a0 tx=0x7ff17c02ef50 comp rx=0 tx=0).stop 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 1 -- 10.20.193.10:0/2439353136 shutdown_connections 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 1 --2- 10.20.193.10:0/2439353136 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 0x7ff19015d600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 1 -- 10.20.193.10:0/2439353136 >> 10.20.193.10:0/2439353136 conn(0x7ff1900c9d80 msgr2=0x7ff1900ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 1 -- 10.20.193.10:0/2439353136 shutdown_connections 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 1 -- 10.20.193.10:0/2439353136 wait complete. 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 10 monclient: monmap: 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.236 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 1 librados: starting msgr at 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.233+0000 7ff19612a640 1 librados: starting objecter 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 Processor -- start 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 -- start start 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 librados: setting wanted keys 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 librados: calling monclient init 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient: init 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff190074920 0x7ff1901e7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient(hunting): picked mon.noname-a con 0x7ff190074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff1900c92f0 0x7ff1901451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient(hunting): picked mon.noname-b con 0x7ff1900c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 0x7ff1901e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient(hunting): picked mon.noname-c con 0x7ff19015d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff190074d70 con 0x7ff190074920 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1900c86c0 con 0x7ff1900c92f0 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff190153d60 con 0x7ff19015d220 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.234+0000 7ff19612a640 10 monclient(hunting): authenticate will time out at 1028.956460s 2026-02-17T11:55:59.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.240+0000 7f5886ffd640 1 -- 10.20.193.10:0/861504163 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5890014a10 con 0x7f589c156260 2026-02-17T11:55:59.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.241+0000 7f5886ffd640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f586c078e00 0x7f586c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.241+0000 7f58a2704640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f586c078e00 0x7f586c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.241+0000 7f58a2704640 10 monclient: get_auth_request con 0x7f586c078e00 auth_method 0 2026-02-17T11:55:59.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.241+0000 7f58a2704640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f586c078e00 0x7f586c07b2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5894007fd0 tx=0x7f5894007b20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.241+0000 7f5886ffd640 10 client.4425.objecter ms_handle_connect 0x7f586c078e00 2026-02-17T11:55:59.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.242+0000 7f99baffd640 1 -- 10.20.193.10:0/771972275 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f99c40050d0 con 0x7f99d415f5c0 2026-02-17T11:55:59.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.242+0000 7f99baffd640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99a0079200 0x7f99a007b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.242+0000 7f99d2575640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99a0079200 0x7f99a007b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.242+0000 7f99d2575640 10 monclient: get_auth_request con 0x7f99a0079200 auth_method 0 2026-02-17T11:55:59.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.242+0000 7f99baffd640 10 client.4478.objecter ms_handle_connect 0x7f99a0079200 2026-02-17T11:55:59.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.242+0000 7f99d2575640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99a0079200 0x7f99a007b6c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99c8039000 tx=0x7f99c8033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.244+0000 7f99baffd640 1 -- 10.20.193.10:0/771972275 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f99c400ad60 con 0x7f99d415f5c0 2026-02-17T11:55:59.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.244+0000 7f99baffd640 10 client.4478.objecter ms_dispatch2 0x7f99d4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.244+0000 7f99baffd640 3 client.4478.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.244+0000 7f99baffd640 3 client.4478.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.244+0000 7f99baffd640 20 client.4478.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f5886ffd640 1 -- 10.20.193.10:0/861504163 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f589005f2e0 con 0x7f589c156260 2026-02-17T11:55:59.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f5886ffd640 10 client.4425.objecter ms_dispatch2 0x7f589c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f5886ffd640 3 client.4425.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f5886ffd640 3 client.4425.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f5886ffd640 20 client.4425.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f5886ffd640 1 -- 10.20.193.10:0/861504163 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f589c06e2a0 con 0x7f589c156260 2026-02-17T11:55:59.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f5886ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f5886ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f99baffd640 1 -- 10.20.193.10:0/771972275 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f99c4062830 con 0x7f99d415f5c0 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f99baffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7f99baffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa003c070 con 0x7fcaa4004900 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 10 monclient: dump: 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa002f730 con 0x7fcaa4004900 2026-02-17T11:55:59.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 1 -- 10.20.193.10:0/1714634857 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0003b80 con 0x7fcaa4004900 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcabcc87640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcabcc87640 4 set_mon_vals no callback set 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.250+0000 7fcab5573640 10 monclient: dump: 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482966697 0 0) 0x7fc98815b530 con 0x7fc988150520 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fc985573640 10 monclient(hunting): _negotiate 2026-02-17T11:55:59.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fc985573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fc985573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fc985573640 10 monclient(hunting): my global_id is 4499 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc98815b250 con 0x7fc988150520 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fcabcc87640 10 monclient: shutdown 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fcabcc87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fcabcc87640 1 -- 10.20.193.10:0/1714634857 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 msgr2=0x7fcaa4004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fcabcc87640 1 --2- 10.20.193.10:0/1714634857 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 0x7fcaa4004d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0003fb0 tx=0x7fcaa002ecb0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fcabcc87640 1 -- 10.20.193.10:0/1714634857 shutdown_connections 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fcabcc87640 1 --2- 10.20.193.10:0/1714634857 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 0x7fcaa4004d80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fcabcc87640 1 -- 10.20.193.10:0/1714634857 >> 10.20.193.10:0/1714634857 conn(0x7fcab806d970 msgr2=0x7fcab806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fcabcc87640 1 -- 10.20.193.10:0/1714634857 shutdown_connections 2026-02-17T11:55:59.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fcabcc87640 1 -- 10.20.193.10:0/1714634857 wait complete. 2026-02-17T11:55:59.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3234797055 0 0) 0x7fe42c003620 con 0x7fe444074cd0 2026-02-17T11:55:59.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 >> v1:10.20.193.153:6789/0 conn(0x7fe444155e80 legacy=0x7fe4440745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 >> v1:10.20.193.71:6789/0 conn(0x7fe444156260 legacy=0x7fe444166710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:55:59.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:55:59.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe444073dc0 con 0x7fe444074cd0 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fe438002f00 con 0x7fe444074cd0 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient: dump: 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 >> v1:10.20.193.10:6789/0 conn(0x7fe444074cd0 legacy=0x7fe4440ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe42c003c20 0x7fe42c004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient(hunting): picked mon.c con 0x7fe42c003c20 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe42c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 10 monclient(hunting): picked mon.a con 0x7fe42c004900 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.251+0000 7fe433fff640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe42c009ab0 0x7fe42c00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fe433fff640 10 monclient(hunting): picked mon.b con 0x7fe42c009ab0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fe433fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c00c4c0 con 0x7fe42c004900 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fe433fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c00c670 con 0x7fe42c009ab0 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fe433fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c00c870 con 0x7fe42c003c20 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fe433fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fe433fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fcabcc87640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fcabcc87640 10 monclient: monmap: 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fcabcc87640 1 librados: starting msgr at 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fcabcc87640 1 librados: starting objecter 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fcabcc87640 1 Processor -- start 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fcabcc87640 1 -- start start 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fcabcc87640 1 librados: setting wanted keys 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fcabcc87640 1 librados: calling monclient init 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.252+0000 7fcabcc87640 10 monclient: init 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:59.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 0x7fcab8144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient(hunting): picked mon.noname-a con 0x7fcaa4004900 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcab813e310 0x7fcab8162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient(hunting): picked mon.noname-b con 0x7fcab813e310 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcab81452f0 0x7fcab8145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient(hunting): picked mon.noname-c con 0x7fcab81452f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8160b20 con 0x7fcaa4004900 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8160840 con 0x7fcab813e310 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8160e00 con 0x7fcab81452f0 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.253+0000 7fcabcc87640 10 monclient(hunting): authenticate will time out at 1028.975365s 2026-02-17T11:55:59.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7f1687fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f16880d1710 0x7f16880d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 <== mon.2 v1:10.20.193.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 522075806 0 0) 0x7fc98815b250 con 0x7fc988150520 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 >> v1:10.20.193.71:6789/0 conn(0x7fc9881623f0 legacy=0x7fc9881647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 >> v1:10.20.193.10:6789/0 conn(0x7fc98815d070 legacy=0x7fc98815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.153:6789/0 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 --> v1:10.20.193.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98815b810 con 0x7fc988150520 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 <== mon.2 v1:10.20.193.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fc97c002ee0 con 0x7fc988150520 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient: dump: 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] but i'm connected to v1:10.20.193.153:6789/0, reconnecting 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 >> v1:10.20.193.153:6789/0 conn(0x7fc988150520 legacy=0x7fc98815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc974003d80 0x7fc974004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient(hunting): picked mon.b con 0x7fc974003d80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc974004900 0x7fc974004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient(hunting): picked mon.a con 0x7fc974004900 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc9740054a0 0x7fc97400bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient(hunting): picked mon.c con 0x7fc9740054a0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc97400c3b0 con 0x7fc974004900 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc97400c560 con 0x7fc974003d80 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc97400c760 con 0x7fc9740054a0 2026-02-17T11:55:59.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7fc985573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:55:59.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7f1687fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f16880d1710 0x7f16880d1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35790/0 (socket says 10.20.193.10:35790) 2026-02-17T11:55:59.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7f1687fff640 1 -- 10.20.193.10:0/4042852872 learned_addr learned my addr 10.20.193.10:0/4042852872 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7f1687fff640 10 monclient(hunting): get_auth_request con 0x7f16880d1710 auth_method 0 2026-02-17T11:55:59.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7f1687fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7f1687fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.254+0000 7f1687fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.255+0000 7f1687fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.255+0000 7f1687fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.255+0000 7f1687fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.255+0000 7f1686ffd640 1 --2- 10.20.193.10:0/4042852872 >> v2:10.20.193.10:3300/0 conn(0x7f16880c98f0 0x7f16880c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1686ffd640 10 monclient(hunting): get_auth_request con 0x7f16880c98f0 auth_method 0 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1686ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1686ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1686ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1687fff640 10 monclient(hunting): handle_auth_done global_id 4505 payload 274 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1687fff640 1 -- 10.20.193.10:0/4042852872 >> v2:10.20.193.10:3300/0 conn(0x7f16880c98f0 msgr2=0x7f16880c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1687fff640 1 --2- 10.20.193.10:0/4042852872 >> v2:10.20.193.10:3300/0 conn(0x7f16880c98f0 0x7f16880c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1687fff640 1 -- 10.20.193.10:0/4042852872 >> v1:10.20.193.10:6789/0 conn(0x7f1688156020 legacy=0x7f16880cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1687fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1687fff640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1687fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1687fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f1687fff640 1 -- 10.20.193.10:0/4042852872 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16880d2290 con 0x7f16880d1710 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.256+0000 7f8743fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f87441f5da0 0x7f8744144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.257+0000 7f8743fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f87441f5da0 0x7f8744144f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38434/0 (socket says 10.20.193.10:38434) 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.257+0000 7f8743fff640 1 -- 10.20.193.10:0/1611232521 learned_addr learned my addr 10.20.193.10:0/1611232521 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.257+0000 7f8743fff640 10 monclient(hunting): get_auth_request con 0x7f87441f5da0 auth_method 0 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.257+0000 7f8743fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.257+0000 7f8743fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.257+0000 7f8743fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.258+0000 7f8743fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.258+0000 7f8743fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.258+0000 7f8743fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 10 monclient(hunting): handle_auth_done global_id 4440 payload 824 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 1 -- 10.20.193.10:0/1611232521 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f87440ca590 msgr2=0x7f87441f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f87440ca590 0x7f87441f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 1 -- 10.20.193.10:0/1611232521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 msgr2=0x7f87440ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 0x7f87440ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 1 monclient: found mon.noname-a 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.260+0000 7f8743fff640 1 -- 10.20.193.10:0/1611232521 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87440c59b0 con 0x7f87441f5da0 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.261+0000 7fb196d76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fb198156260 0x7fb198166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fab340ccbc0 0x7fab340c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7f8743fff640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f87441f5da0 0x7f8744144f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f873802fc30 tx=0x7f87380034c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7f871ffff640 10 client.?.objecter ms_handle_connect 0x7f87441f5da0 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7f871ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab38e79640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fab34156260 0x7fab3415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fb196d76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fb198156260 0x7fb198166710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38378/0 (socket says 10.20.193.10:38378) 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fb196d76640 1 -- 10.20.193.10:0/2930383320 learned_addr learned my addr 10.20.193.10:0/2930383320 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fb196d76640 10 monclient(hunting): get_auth_request con 0x7fb198156260 auth_method 0 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fb196d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fb196d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fab340ccbc0 0x7fab340c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35838/0 (socket says 10.20.193.10:35838) 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 1 -- 10.20.193.10:0/3569736895 learned_addr learned my addr 10.20.193.10:0/3569736895 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 10 monclient(hunting): get_auth_request con 0x7fab340ccbc0 auth_method 0 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fb196d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7ff18ffff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 0x7ff1901e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.262+0000 7fab33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7fab38e79640 10 monclient(hunting): get_auth_request con 0x7fab34156260 auth_method 0 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7fab38e79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7fab38e79640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7fab38e79640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7ff18ffff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 0x7ff1901e4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35860/0 (socket says 10.20.193.10:35860) 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7ff18ffff640 1 -- 10.20.193.10:0/2454204642 learned_addr learned my addr 10.20.193.10:0/2454204642 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7ff18ffff640 10 monclient(hunting): get_auth_request con 0x7ff19015d220 auth_method 0 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7ff18ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7ff18ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7ff18ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7fb196d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7fb196d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.263+0000 7fb196d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab38e79640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab38e79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab38e79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 10 monclient(hunting): handle_auth_done global_id 4508 payload 824 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 1 -- 10.20.193.10:0/3569736895 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fab34155e80 msgr2=0x7fab340ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fab34155e80 0x7fab340ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 1 -- 10.20.193.10:0/3569736895 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fab34156260 msgr2=0x7fab3415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fab34156260 0x7fab3415f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fab33fff640 1 -- 10.20.193.10:0/3569736895 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab340c69c0 con 0x7fab340ccbc0 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fb196d76640 10 monclient(hunting): handle_auth_done global_id 4443 payload 274 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fb196d76640 1 -- 10.20.193.10:0/2930383320 >> v1:10.20.193.153:6789/0 conn(0x7fb198155e80 legacy=0x7fb1980745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fb196d76640 1 -- 10.20.193.10:0/2930383320 >> v1:10.20.193.71:6789/0 conn(0x7fb198074cd0 legacy=0x7fb1980ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fb196d76640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fb196d76640 1 monclient: found mon.noname-a 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.264+0000 7fb196d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.265+0000 7fb196d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.265+0000 7fb196d76640 1 -- 10.20.193.10:0/2930383320 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb198073ae0 con 0x7fb198156260 2026-02-17T11:55:59.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.265+0000 7fe448bda640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe42c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.265+0000 7f1687fff640 1 --2- 10.20.193.10:0/4042852872 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 0x7f16880d1bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1688075030 tx=0x7f167c02f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6764f6f48dbcd15 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.265+0000 7ff18ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.265+0000 7ff18ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.265+0000 7ff18ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.265+0000 7f71a67fc640 1 -- 10.20.193.10:0/3283439339 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f71b4014a10 con 0x7f71b81527e0 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.265+0000 7f71a67fc640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7188078e00 0x7f718807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.266+0000 7f71bdd36640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7188078e00 0x7f718807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.266+0000 7f71bdd36640 10 monclient: get_auth_request con 0x7f7188078e00 auth_method 0 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.266+0000 7f71bdd36640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7188078e00 0x7f718807b2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71a8039000 tx=0x7f71a8031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.266+0000 7f71a67fc640 10 client.4516.objecter ms_handle_connect 0x7f7188078e00 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 10 monclient(hunting): handle_auth_done global_id 4511 payload 824 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 1 -- 10.20.193.10:0/2454204642 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff1900c92f0 msgr2=0x7ff1901451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff1900c92f0 0x7ff1901451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 1 -- 10.20.193.10:0/2454204642 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff190074920 msgr2=0x7ff1901e7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff190074920 0x7ff1901e7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7ff18ffff640 1 -- 10.20.193.10:0/2454204642 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1901f5aa0 con 0x7ff19015d220 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7f71a67fc640 1 -- 10.20.193.10:0/3283439339 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f71b405ef80 con 0x7f71b81527e0 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7f71a67fc640 10 client.4516.objecter ms_dispatch2 0x7f71b8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7f71a67fc640 3 client.4516.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7f71a67fc640 3 client.4516.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7f71a67fc640 20 client.4516.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7fe448bda640 10 monclient(hunting): get_auth_request con 0x7fe42c004900 auth_method 0 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7fe448bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7fe448bda640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.267+0000 7fe448bda640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.268+0000 7fab33fff640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fab340ccbc0 0x7fab340c82d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab20009130 tx=0x7fab200047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.268+0000 7fab30ff9640 10 client.?.objecter ms_handle_connect 0x7fab340ccbc0 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.268+0000 7fab30ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.269+0000 7fb196d76640 1 --2- 10.20.193.10:0/2930383320 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198156260 0x7fb198166710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb188009e50 tx=0x7fb18802f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861fa903f8a63c47 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.269+0000 7ff18ffff640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 0x7ff1901e4ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff18400b9c0 tx=0x7ff18400be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.269+0000 7ff16bfff640 10 client.?.objecter ms_handle_connect 0x7ff19015d220 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.269+0000 7ff16bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.270+0000 7fe448bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.270+0000 7fe448bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.270+0000 7fe448bda640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:59.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe4493db640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe42c003c20 0x7fe42c004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fcab6d76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcab81452f0 0x7fcab8145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 10 monclient(hunting): handle_auth_done global_id 4434 payload 293 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 1 -- 10.20.193.10:0/1068312535 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe42c003c20 msgr2=0x7fe42c004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe42c003c20 0x7fe42c004040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 1 -- 10.20.193.10:0/1068312535 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe42c009ab0 msgr2=0x7fe42c00bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe42c009ab0 0x7fe42c00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 1 monclient: found mon.a 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 1 -- 10.20.193.10:0/1068312535 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c003620 con 0x7fe42c004900 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe448bda640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe449bdc640 1 -- 10.20.193.10:0/1068312535 reap_dead start 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe44b666640 5 monclient: authenticate success, global_id 4434 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fe44b666640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fc986d76640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc9740054a0 0x7fc97400bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fcab6d76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcab81452f0 0x7fcab8145770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35876/0 (socket says 10.20.193.10:35876) 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fcab6d76640 1 -- 10.20.193.10:0/78786432 learned_addr learned my addr 10.20.193.10:0/78786432 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fcab6d76640 10 monclient(hunting): get_auth_request con 0x7fcab81452f0 auth_method 0 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fcab6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fcab6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.272+0000 7fcab6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.273+0000 7fc986d76640 10 monclient(hunting): get_auth_request con 0x7fc9740054a0 auth_method 0 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.273+0000 7fc986d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.273+0000 7fc986d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.273+0000 7fc986d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:59.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.274+0000 7fcab6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.274+0000 7fcab6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.274+0000 7fcab6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.274+0000 7fe448bda640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe42c004d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe43800c210 tx=0x7fe43802f590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21e318b50182d41 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.274+0000 7fc986d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.274+0000 7fc986d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.274+0000 7fc986d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:59.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.275+0000 7fc985d74640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc974004900 0x7fc974004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.275+0000 7f71a67fc640 1 -- 10.20.193.10:0/3283439339 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f71b80caf30 con 0x7f71b81527e0 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.275+0000 7f71a67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.275+0000 7f71a67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.275+0000 7fc985d74640 10 monclient(hunting): get_auth_request con 0x7fc974004900 auth_method 0 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.275+0000 7fc985d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.275+0000 7fc985d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.275+0000 7fc985d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 10 monclient(hunting): handle_auth_done global_id 4514 payload 824 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 1 -- 10.20.193.10:0/78786432 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcab813e310 msgr2=0x7fcab8162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcab813e310 0x7fcab8162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 1 -- 10.20.193.10:0/78786432 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 msgr2=0x7fcab8144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 0x7fcab8144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.276+0000 7fcab6d76640 1 -- 10.20.193.10:0/78786432 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab813f210 con 0x7fcab81452f0 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc985d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc985d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc985d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 10 monclient(hunting): handle_auth_done global_id 4499 payload 293 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 1 -- 10.20.193.10:0/3906703629 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc974003d80 msgr2=0x7fc974004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc974003d80 0x7fc974004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 1 -- 10.20.193.10:0/3906703629 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc974004900 msgr2=0x7fc974004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc974004900 0x7fc974004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 1 monclient: found mon.c 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 1 -- 10.20.193.10:0/3906703629 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98815b250 con 0x7fc9740054a0 2026-02-17T11:55:59.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc986d76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc98cb33640 5 monclient: authenticate success, global_id 4499 2026-02-17T11:55:59.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.277+0000 7fc98cb33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.278+0000 7fc986d76640 1 -- 10.20.193.10:0/3906703629 reap_dead start 2026-02-17T11:55:59.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 1 -- 10.20.193.10:0/1935467456 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0004480 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 10 monclient: dump: 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 1 -- 10.20.193.10:0/1935467456 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d0010070 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 1 -- 10.20.193.10:0/1935467456 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0002920 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 5 monclient: authenticate success, global_id 4513 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 10 monclient: _renew_subs 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13d8d72640 4 set_mon_vals no callback set 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13dc149280 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13c2ffd640 10 monclient: dump: 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.281 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 1 -- 10.20.193.10:0/4042852872 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c02fd70 con 0x7f16880d1710 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 10 monclient: dump: 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.282 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 1 -- 10.20.193.10:0/4042852872 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f167c0373f0 con 0x7f16880d1710 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 1 -- 10.20.193.10:0/4042852872 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c0377c0 con 0x7f16880d1710 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f16867fc640 10 monclient: dump: 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 5 monclient: authenticate success, global_id 4505 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 4 set_mon_vals no callback set 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 10 client.4513.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 10 monclient: _renew_subs 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13dc149840 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 1 librados: init done 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7fc986d76640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc9740054a0 0x7fc97400bb00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc988073180 tx=0x7fc97802f640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=846012c7ed63d77e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 10 monclient: shutdown 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 1 -- 10.20.193.10:0/4042852872 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 msgr2=0x7f16880d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 1 --2- 10.20.193.10:0/4042852872 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 0x7f16880d1bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1688075030 tx=0x7f167c02f310 comp rx=0 tx=0).stop 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 1 -- 10.20.193.10:0/4275763893 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0234006e60 con 0x7f0244156260 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 10 monclient: dump: 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.284 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 1 -- 10.20.193.10:0/4275763893 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0234010070 con 0x7f0244156260 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 1 -- 10.20.193.10:0/4275763893 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023400c9d0 con 0x7f0244156260 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0249032640 5 monclient: authenticate success, global_id 4522 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0249032640 10 monclient: _renew_subs 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0241573640 4 set_mon_vals no callback set 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0249032640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02441e78d0 con 0x7f0244156260 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 1 -- 10.20.193.10:0/4042852872 shutdown_connections 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 1 --2- 10.20.193.10:0/4042852872 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 0x7f16880d1bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 1 --2- 10.20.193.10:0/4042852872 >> v2:10.20.193.10:3300/0 conn(0x7f16880c98f0 0x7f16880c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13dc0c91b0 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 1 -- 10.20.193.10:0/4042852872 >> 10.20.193.10:0/4042852872 conn(0x7f168806d970 msgr2=0x7f168806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f02237fe640 10 monclient: dump: 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.286 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 1 -- 10.20.193.10:0/4042852872 shutdown_connections 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0249032640 10 client.4522.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0249032640 10 monclient: _renew_subs 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0249032640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02441e7e90 con 0x7f0244156260 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f0249032640 1 librados: init done 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.279+0000 7f168dda8640 1 -- 10.20.193.10:0/4042852872 wait complete. 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f0249032640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f0249032640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f0249032640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02440ccbc0 con 0x7f0244156260 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f168dda8640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f168dda8640 10 monclient: monmap: 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f168dda8640 1 librados: starting msgr at 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f168dda8640 1 librados: starting objecter 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f168dda8640 1 Processor -- start 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f168dda8640 1 -- start start 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f168dda8640 1 librados: setting wanted keys 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f168dda8640 1 librados: calling monclient init 2026-02-17T11:55:59.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.280+0000 7f168dda8640 10 monclient: init 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 1 -- 10.20.193.10:0/2930383320 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18802fd00 con 0x7fb198156260 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 10 monclient: dump: 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 1 -- 10.20.193.10:0/2930383320 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1880373f0 con 0x7fb198156260 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 1 -- 10.20.193.10:0/2930383320 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1880377c0 con 0x7fb198156260 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 5 monclient: authenticate success, global_id 4443 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 4 set_mon_vals no callback set 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb195573640 10 monclient: dump: 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f16880c98f0 0x7f16880d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient(hunting): picked mon.noname-a con 0x7f16880c98f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 0x7f16881f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient(hunting): picked mon.noname-c con 0x7f16880d1710 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1688156020 0x7f16881f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient(hunting): picked mon.noname-b con 0x7f1688156020 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f16880c90f0 con 0x7f16880c98f0 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f16880c8e10 con 0x7f1688156020 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f16880cc120 con 0x7f16880d1710 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7f168dda8640 10 monclient(hunting): authenticate will time out at 1029.003321s 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 10 monclient: shutdown 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 1 -- 10.20.193.10:0/2930383320 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198156260 msgr2=0x7fb198166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 1 --2- 10.20.193.10:0/2930383320 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198156260 0x7fb198166710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb188009e50 tx=0x7fb18802f2a0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 1 -- 10.20.193.10:0/2930383320 shutdown_connections 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 1 --2- 10.20.193.10:0/2930383320 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198156260 0x7fb198166710 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 1 -- 10.20.193.10:0/2930383320 >> 10.20.193.10:0/2930383320 conn(0x7fb1980ce2b0 msgr2=0x7fb1980ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 1 -- 10.20.193.10:0/2930383320 shutdown_connections 2026-02-17T11:55:59.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fb19cd22640 1 -- 10.20.193.10:0/2930383320 wait complete. 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 1 -- 10.20.193.10:0/3569736895 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20046020 con 0x7fab340ccbc0 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 10 monclient: dump: 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 1 -- 10.20.193.10:0/3569736895 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab20042630 con 0x7fab340ccbc0 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 1 -- 10.20.193.10:0/3569736895 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2003c040 con 0x7fab340ccbc0 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab3a903640 5 monclient: authenticate success, global_id 4508 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab327fc640 4 set_mon_vals no callback set 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab3a903640 10 monclient: _renew_subs 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab3a903640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab340c6ca0 con 0x7fab340ccbc0 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab30ff9640 10 monclient: dump: 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab3a903640 10 client.4508.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab3a903640 10 monclient: _renew_subs 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab3a903640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab340c7260 con 0x7fab340ccbc0 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.281+0000 7fab3a903640 1 librados: init done 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient: monmap: 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 1 -- 10.20.193.10:0/1611232521 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8738036040 con 0x7f87441f5da0 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 10 monclient: dump: 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 1 -- 10.20.193.10:0/1611232521 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8738031420 con 0x7f87441f5da0 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 librados: starting msgr at 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 librados: starting objecter 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 1 -- 10.20.193.10:0/1611232521 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873800a430 con 0x7f87441f5da0 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 5 monclient: authenticate success, global_id 4440 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f871ffff640 10 monclient: dump: 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 10 monclient: _renew_subs 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f8741ffb640 4 set_mon_vals no callback set 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87440c5c90 con 0x7f87441f5da0 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 Processor -- start 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 10 monclient: _renew_subs 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87440c6250 con 0x7f87441f5da0 2026-02-17T11:55:59.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 1 librados: init done 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fab3a903640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fab3a903640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fab3a903640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab340ccfe0 con 0x7fab340ccbc0 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 -- start start 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 librados: setting wanted keys 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 librados: calling monclient init 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient: init 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 1 -- 10.20.193.10:0/2454204642 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184006e60 con 0x7ff19015d220 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 10 monclient: dump: 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.296 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 1 -- 10.20.193.10:0/2454204642 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff184010070 con 0x7ff19015d220 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 1 -- 10.20.193.10:0/2454204642 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18400c9d0 con 0x7ff19015d220 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff16bfff640 10 monclient: dump: 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff18dffb640 4 set_mon_vals no callback set 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff19612a640 5 monclient: authenticate success, global_id 4511 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff19612a640 10 monclient: _renew_subs 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff19612a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1901f1780 con 0x7ff19015d220 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f16877fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f16880c98f0 0x7f16880d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff19612a640 10 client.4511.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff19612a640 10 monclient: _renew_subs 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff19612a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1901f1d40 con 0x7ff19015d220 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7ff19612a640 1 librados: init done 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fcab6d76640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcab81452f0 0x7fcab8145770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40058e0 tx=0x7fcaa800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fca9effd640 10 client.?.objecter ms_handle_connect 0x7fcab81452f0 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fca9effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f1686ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 0x7f16881f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438007d80 con 0x7fe42c004900 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 10 monclient: dump: 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe438005bd0 con 0x7fe42c004900 2026-02-17T11:55:59.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 1 -- 10.20.193.10:0/1068312535 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438007070 con 0x7fe42c004900 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe433fff640 10 monclient: dump: 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe44b666640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fe44b666640 4 set_mon_vals no callback set 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198074cd0 0x7fb1981f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient(hunting): picked mon.noname-a con 0x7fb198074cd0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb198155e80 0x7fb1981f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient(hunting): picked mon.noname-b con 0x7fb198155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb198156260 0x7fb198151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient(hunting): picked mon.noname-c con 0x7fb198156260 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fb1980c4870 con 0x7fb198074cd0 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb1980740a0 con 0x7fb198155e80 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb1980c49f0 con 0x7fb198156260 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7fb19cd22640 10 monclient(hunting): authenticate will time out at 1029.004942s 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.282+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87440745c0 con 0x7f87441f5da0 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f1686ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 0x7f16881f51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35890/0 (socket says 10.20.193.10:35890) 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f1686ffd640 1 -- 10.20.193.10:0/3437252879 learned_addr learned my addr 10.20.193.10:0/3437252879 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f1686ffd640 10 monclient(hunting): get_auth_request con 0x7f16880d1710 auth_method 0 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f1686ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f1686ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f1686ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7ff19612a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7ff19612a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7ff19612a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19015d600 con 0x7ff19015d220 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97800c0e0 con 0x7fc9740054a0 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 10 monclient: dump: 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc978037630 con 0x7fc9740054a0 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 1 -- 10.20.193.10:0/3906703629 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9780379e0 con 0x7fc9740054a0 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 4 set_mon_vals no callback set 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc985573640 10 monclient: dump: 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.301 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 10 monclient: shutdown 2026-02-17T11:55:59.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 1 -- 10.20.193.10:0/1068312535 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 msgr2=0x7fe42c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe42c004d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe43800c210 tx=0x7fe43802f590 comp rx=0 tx=0).stop 2026-02-17T11:55:59.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 1 -- 10.20.193.10:0/1068312535 shutdown_connections 2026-02-17T11:55:59.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 1 --2- 10.20.193.10:0/1068312535 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe42c004d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 1 -- 10.20.193.10:0/1068312535 >> 10.20.193.10:0/1068312535 conn(0x7fe4440ce2b0 msgr2=0x7fe4440ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 1 -- 10.20.193.10:0/1068312535 shutdown_connections 2026-02-17T11:55:59.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 1 -- 10.20.193.10:0/1068312535 wait complete. 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f16877fe640 10 monclient(hunting): get_auth_request con 0x7f16880c98f0 auth_method 0 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f16877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f16877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f16877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 10 monclient: shutdown 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 1 -- 10.20.193.10:0/3906703629 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc9740054a0 msgr2=0x7fc97400bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc9740054a0 0x7fc97400bb00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc988073180 tx=0x7fc97802f640 comp rx=0 tx=0).stop 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f1686ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f1686ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7f1686ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 1 -- 10.20.193.10:0/3906703629 shutdown_connections 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 1 --2- 10.20.193.10:0/3906703629 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc9740054a0 0x7fc97400bb00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 1 -- 10.20.193.10:0/3906703629 >> 10.20.193.10:0/3906703629 conn(0x7fc9880cf550 msgr2=0x7fc9880cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 1 -- 10.20.193.10:0/3906703629 shutdown_connections 2026-02-17T11:55:59.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fc98cb33640 1 -- 10.20.193.10:0/3906703629 wait complete. 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.283+0000 7fe44b666640 10 monclient: monmap: 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 librados: starting msgr at 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 librados: starting objecter 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 Processor -- start 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 -- start start 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 librados: setting wanted keys 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 librados: calling monclient init 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient: init 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fc98cb33640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fc98cb33640 10 monclient: monmap: 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.304 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe44413c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient(hunting): picked mon.noname-a con 0x7fe42c004900 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4441f7380 0x7fe4441f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient(hunting): picked mon.noname-c con 0x7fe4441f7380 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4441f43c0 0x7fe4440ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient(hunting): picked mon.noname-b con 0x7fe4441f43c0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fe4440c4870 con 0x7fe42c004900 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe4440cd840 con 0x7fe4441f43c0 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4440c49f0 con 0x7fe4441f7380 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fe44b666640 10 monclient(hunting): authenticate will time out at 1029.006608s 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fc98cb33640 1 librados: starting msgr at 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fc98cb33640 1 librados: starting objecter 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fc98cb33640 1 Processor -- start 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fc98cb33640 1 -- start start 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fc98cb33640 1 librados: setting wanted keys 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fc98cb33640 1 librados: calling monclient init 2026-02-17T11:55:59.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.284+0000 7fc98cb33640 10 monclient: init 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fd363d75640 10 monclient: get_monmap_and_config 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fd363d75640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fd363d75640 10 monclient: monmap: 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:55:59.286414+0000 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:55:59.286414+0000 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9740054a0 0x7fc9881f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient(hunting): picked mon.noname-a con 0x7fc9740054a0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc988156bd0 0x7fc988154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient(hunting): picked mon.noname-b con 0x7fc988156bd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc988157050 0x7fc9881548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient(hunting): picked mon.noname-c con 0x7fc988157050 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc98815bdd0 con 0x7fc9740054a0 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc98815c140 con 0x7fc988156bd0 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc988150900 con 0x7fc988157050 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fc98cb33640 10 monclient(hunting): authenticate will time out at 1029.007484s 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fd363d75640 1 Processor -- start 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fd363d75640 1 -- start start 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.285+0000 7fd363d75640 10 monclient: init 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 10 monclient: _add_conns ranks=[4,5,0,1,2,3] 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fd35c155e80 0x7fd35c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 10 monclient(hunting): picked mon.noname-b con 0x7fd35c155e80 addr v2:10.20.193.71:3300/0 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fd35c156260 0x7fd35c074b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 10 monclient(hunting): picked mon.noname-c con 0x7fd35c156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd35c0ccbc0 addr v1:10.20.193.10:6789/0 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd35c073520 con 0x7fd35c0ccbc0 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd35c0cd840 con 0x7fd35c155e80 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd35c073800 con 0x7fd35c156260 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.286+0000 7fd363d75640 10 monclient(hunting): authenticate will time out at 1029.008232s 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.289+0000 7f16877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.289+0000 7f16877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.289+0000 7f16877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.296+0000 7ff16bfff640 1 -- 10.20.193.10:0/2454204642 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7ff18401d030 con 0x7ff19015d220 2026-02-17T11:55:59.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.296+0000 7ff16bfff640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff160078e50 0x7ff16007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.297+0000 7ff18f7fe640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff160078e50 0x7ff16007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.297+0000 7ff18f7fe640 10 monclient: get_auth_request con 0x7ff160078e50 auth_method 0 2026-02-17T11:55:59.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.297+0000 7ff16bfff640 10 client.4511.objecter ms_handle_connect 0x7ff160078e50 2026-02-17T11:55:59.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.297+0000 7ff18f7fe640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff160078e50 0x7ff16007b310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1900c6b30 tx=0x7ff17c031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.337+0000 7f58a498f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:55:59.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.337+0000 7f58a498f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:55:59.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.337+0000 7f58a498f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.337+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f589c0d0690 con 0x7f589c156260 2026-02-17T11:55:59.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.339+0000 7f99d8bce640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:55:59.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.339+0000 7f99d8bce640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:55:59.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.339+0000 7f99d8bce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.339+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f99d4074f10 con 0x7f99d415f5c0 2026-02-17T11:55:59.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.360+0000 7f71bffc1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:55:59.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.360+0000 7f71bffc1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:55:59.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.360+0000 7f71bffc1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.360+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f71b8160330 con 0x7f71b81527e0 2026-02-17T11:55:59.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 1 -- 10.20.193.10:0/3644012781 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20017070 con 0x7fae2c156020 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 10 monclient: dump: 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 1 -- 10.20.193.10:0/3644012781 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae2000ad50 con 0x7fae2c156020 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 1 -- 10.20.193.10:0/3644012781 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20012600 con 0x7fae2c156020 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae28ff9640 10 monclient: dump: 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.383 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae2a7fc640 4 set_mon_vals no callback set 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae32755640 5 monclient: authenticate success, global_id 4531 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae32755640 10 monclient: _renew_subs 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae32755640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c1f71d0 con 0x7fae2c156020 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae32755640 10 client.4531.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae32755640 10 monclient: _renew_subs 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae32755640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c1f7790 con 0x7fae2c156020 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.380+0000 7fae32755640 1 librados: init done 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.381+0000 7fae32755640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.381+0000 7fae32755640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.381+0000 7fae32755640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.381+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2c0c9d30 con 0x7fae2c156020 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 10 monclient(hunting): handle_auth_done global_id 4517 payload 824 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 1 -- 10.20.193.10:0/3437252879 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1688156020 msgr2=0x7f16881f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1688156020 0x7f16881f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 1 -- 10.20.193.10:0/3437252879 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f16880c98f0 msgr2=0x7f16880d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f16880c98f0 0x7f16880d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.390+0000 7f1686ffd640 1 -- 10.20.193.10:0/3437252879 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168815b8b0 con 0x7f16880d1710 2026-02-17T11:55:59.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.394+0000 7ff16bfff640 1 -- 10.20.193.10:0/2454204642 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7ff18405d6b0 con 0x7ff19015d220 2026-02-17T11:55:59.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.394+0000 7ff16bfff640 10 client.4511.objecter ms_dispatch2 0x7ff190000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.394+0000 7ff16bfff640 3 client.4511.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.394+0000 7ff16bfff640 3 client.4511.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.394+0000 7ff16bfff640 20 client.4511.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.394+0000 7f871ffff640 1 -- 10.20.193.10:0/1611232521 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f8738031040 con 0x7f87441f5da0 2026-02-17T11:55:59.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.395+0000 7f871ffff640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8714078e30 0x7f871407b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.395+0000 7f87437fe640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8714078e30 0x7f871407b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.395+0000 7f87437fe640 10 monclient: get_auth_request con 0x7f8714078e30 auth_method 0 2026-02-17T11:55:59.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.395+0000 7f87437fe640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8714078e30 0x7f871407b2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8730004ea0 tx=0x7f8730009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.395+0000 7f871ffff640 10 client.4440.objecter ms_handle_connect 0x7f8714078e30 2026-02-17T11:55:59.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.396+0000 7fb196575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198074cd0 0x7fb1981f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.406+0000 7f871ffff640 1 -- 10.20.193.10:0/1611232521 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f8738082920 con 0x7f87441f5da0 2026-02-17T11:55:59.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.406+0000 7f871ffff640 10 client.4440.objecter ms_dispatch2 0x7f8744000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.406+0000 7f871ffff640 3 client.4440.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.406+0000 7f871ffff640 3 client.4440.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.406+0000 7f871ffff640 20 client.4440.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.406+0000 7f871ffff640 1 -- 10.20.193.10:0/1611232521 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f873804c070 con 0x7f87441f5da0 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.406+0000 7f871ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.406+0000 7f871ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.407+0000 7fb196575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198074cd0 0x7fb1981f7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38468/0 (socket says 10.20.193.10:38468) 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.407+0000 7fb196575640 1 -- 10.20.193.10:0/1769594601 learned_addr learned my addr 10.20.193.10:0/1769594601 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.407+0000 7fb196575640 10 monclient(hunting): get_auth_request con 0x7fb198074cd0 auth_method 0 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.407+0000 7fb196575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.407+0000 7fb196575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.407+0000 7fb196575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.408+0000 7fb196575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.408+0000 7fb196575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.408+0000 7fb196575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 10 monclient(hunting): handle_auth_done global_id 4452 payload 824 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 1 -- 10.20.193.10:0/1769594601 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb198156260 msgr2=0x7fb198151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb198156260 0x7fb198151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 1 -- 10.20.193.10:0/1769594601 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb198155e80 msgr2=0x7fb1981f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb198155e80 0x7fb1981f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 1 monclient: found mon.noname-a 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.412+0000 7fb196575640 1 -- 10.20.193.10:0/1769594601 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1981f4380 con 0x7fb198074cd0 2026-02-17T11:55:59.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.413+0000 7fd3622eb640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fd35c0ccbc0 0x7fd35c0ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:42178/0 (socket says 10.20.193.10:42178) 2026-02-17T11:55:59.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.413+0000 7fd3622eb640 1 -- 10.20.193.10:0/278757626 learned_addr learned my addr 10.20.193.10:0/278757626 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:55:59.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.414+0000 7f5886ffd640 1 -- 10.20.193.10:0/861504163 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5890022030 con 0x7f589c156260 2026-02-17T11:55:59.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.414+0000 7f5886ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:55:59.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.414+0000 7f5886ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.417 INFO:teuthology.orchestra.run.trial010.stdout:115964116998 2026-02-17T11:55:59.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7fb196575640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198074cd0 0x7fb1981f7ce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00b5a0 tx=0x7fb18c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7fb17effd640 10 client.?.objecter ms_handle_connect 0x7fb198074cd0 2026-02-17T11:55:59.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7fb17effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 10 librados: watch_flush enter 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 10 librados: watch_flush exit 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 20 client.4425.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 10 client.4425.objecter successfully canceled tick 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f586c078e00 msgr2=0x7f586c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f586c078e00 0x7f586c07b2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5894007fd0 tx=0x7f5894007b20 comp rx=0 tx=0).stop 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 10 monclient: shutdown 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f589c156260 msgr2=0x7f589c0c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f589c156260 0x7f589c0c7b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5890009d30 tx=0x7f589000c490 comp rx=0 tx=0).stop 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 shutdown_connections 2026-02-17T11:55:59.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f586c078e00 0x7f586c07b2c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f589c156260 0x7f589c0c7b20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f589c155e80 0x7f589c158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 --2- 10.20.193.10:0/861504163 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f589c074cd0 0x7f589c1f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 >> 10.20.193.10:0/861504163 conn(0x7f589c0ce2b0 msgr2=0x7f589c0ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 shutdown_connections 2026-02-17T11:55:59.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 -- 10.20.193.10:0/861504163 wait complete. 2026-02-17T11:55:59.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.416+0000 7f58a498f640 1 librados: shutdown 2026-02-17T11:55:59.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.417+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2386260994 0 0) 0x7fd35c073520 con 0x7fd35c0ccbc0 2026-02-17T11:55:59.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.417+0000 7fd360ae8640 10 monclient(hunting): _negotiate 2026-02-17T11:55:59.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.417+0000 7fd360ae8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.417+0000 7fd360ae8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.417+0000 7fd360ae8640 10 monclient(hunting): my global_id is 4455 2026-02-17T11:55:59.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.417+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd344003620 con 0x7fd35c0ccbc0 2026-02-17T11:55:59.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.419+0000 7fe4493db640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe44413c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fc986575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9740054a0 0x7fc9881f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fe4493db640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe44413c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38474/0 (socket says 10.20.193.10:38474) 2026-02-17T11:55:59.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fe4493db640 1 -- 10.20.193.10:0/2388239222 learned_addr learned my addr 10.20.193.10:0/2388239222 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fe4493db640 10 monclient(hunting): get_auth_request con 0x7fe42c004900 auth_method 0 2026-02-17T11:55:59.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fe4493db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fe4493db640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fe4493db640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 1 -- 10.20.193.10:0/1769594601 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c012070 con 0x7fb198074cd0 2026-02-17T11:55:59.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:59.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 10 monclient: dump: 2026-02-17T11:55:59.425 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.425 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 1 -- 10.20.193.10:0/1769594601 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18c0044a0 con 0x7fb198074cd0 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 1 -- 10.20.193.10:0/1769594601 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0029c0 con 0x7fb198074cd0 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb17effd640 10 monclient: dump: 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.427 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb194d72640 4 set_mon_vals no callback set 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb19cd22640 5 monclient: authenticate success, global_id 4452 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb19cd22640 10 monclient: _renew_subs 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb19cd22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1981f4660 con 0x7fb198074cd0 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb19cd22640 10 client.4452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb19cd22640 10 monclient: _renew_subs 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb19cd22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1981e75d0 con 0x7fb198074cd0 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.420+0000 7fb19cd22640 1 librados: init done 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fb19cd22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fb19cd22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fb19cd22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1981e73c0 con 0x7fb198074cd0 2026-02-17T11:55:59.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fc986575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9740054a0 0x7fc9881f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38476/0 (socket says 10.20.193.10:38476) 2026-02-17T11:55:59.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fc986575640 1 -- 10.20.193.10:0/3720678724 learned_addr learned my addr 10.20.193.10:0/3720678724 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fc986575640 10 monclient(hunting): get_auth_request con 0x7fc9740054a0 auth_method 0 2026-02-17T11:55:59.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fc986575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fc986575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.421+0000 7fc986575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.422+0000 7fe4493db640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.422+0000 7fe4493db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.422+0000 7fe4493db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fc986575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fc986575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fc986575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 10 monclient(hunting): handle_auth_done global_id 4458 payload 824 2026-02-17T11:55:59.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 1 -- 10.20.193.10:0/2388239222 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4441f7380 msgr2=0x7fe4441f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4441f7380 0x7fe4441f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 1 -- 10.20.193.10:0/2388239222 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4441f43c0 msgr2=0x7fe4440ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4441f43c0 0x7fe4440ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 1 monclient: found mon.noname-a 2026-02-17T11:55:59.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.424+0000 7fe4493db640 1 -- 10.20.193.10:0/2388239222 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4441f48c0 con 0x7fe42c004900 2026-02-17T11:55:59.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117000 got 115964116998 for osd.4 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 10 monclient(hunting): handle_auth_done global_id 4461 payload 824 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 1 -- 10.20.193.10:0/3720678724 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc988157050 msgr2=0x7fc9881548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc988157050 0x7fc9881548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 1 -- 10.20.193.10:0/3720678724 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc988156bd0 msgr2=0x7fc988154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc988156bd0 0x7fc988154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 1 monclient: found mon.noname-a 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.427+0000 7fc986575640 1 -- 10.20.193.10:0/3720678724 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc988154eb0 con 0x7fc9740054a0 2026-02-17T11:55:59.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.492+0000 7f874a287640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:55:59.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.492+0000 7f874a287640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:55:59.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.492+0000 7f874a287640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.492+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f87441f5510 con 0x7f87441f5da0 2026-02-17T11:55:59.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.509+0000 7ff16bfff640 1 -- 10.20.193.10:0/2454204642 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff184061d70 con 0x7ff19015d220 2026-02-17T11:55:59.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.509+0000 7ff16bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.509+0000 7ff16bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 1 -- 10.20.193.10:0/78786432 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8014420 con 0x7fcab81452f0 2026-02-17T11:55:59.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 10 monclient: dump: 2026-02-17T11:55:59.514 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.514 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.514 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.514 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 1 -- 10.20.193.10:0/78786432 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa80145c0 con 0x7fcab81452f0 2026-02-17T11:55:59.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 1 -- 10.20.193.10:0/78786432 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80149b0 con 0x7fcab81452f0 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcabcc87640 5 monclient: authenticate success, global_id 4514 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcab4d72640 4 set_mon_vals no callback set 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcabcc87640 10 monclient: _renew_subs 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcabcc87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab813e970 con 0x7fcab81452f0 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fca9effd640 10 monclient: dump: 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.516 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcabcc87640 10 client.4514.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcabcc87640 10 monclient: _renew_subs 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcabcc87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab813ef30 con 0x7fcab81452f0 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.511+0000 7fcabcc87640 1 librados: init done 2026-02-17T11:55:59.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.512+0000 7fcabcc87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.512+0000 7fcabcc87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.512+0000 7fcabcc87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.512+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab81610e0 con 0x7fcab81452f0 2026-02-17T11:55:59.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.519+0000 7fab30ff9640 1 -- 10.20.193.10:0/3569736895 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fab20053070 con 0x7fab340ccbc0 2026-02-17T11:55:59.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.519+0000 7fab30ff9640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab04078e50 0x7fab0407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.519+0000 7fab337fe640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab04078e50 0x7fab0407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.519+0000 7fab337fe640 10 monclient: get_auth_request con 0x7fab04078e50 auth_method 0 2026-02-17T11:55:59.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.519+0000 7fab337fe640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab04078e50 0x7fab0407b310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab24006b90 tx=0x7fab24006b20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.519+0000 7fab30ff9640 10 client.4508.objecter ms_handle_connect 0x7fab04078e50 2026-02-17T11:55:59.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.520+0000 7fab30ff9640 1 -- 10.20.193.10:0/3569736895 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fab2002f9b0 con 0x7fab340ccbc0 2026-02-17T11:55:59.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.520+0000 7fab30ff9640 10 client.4508.objecter ms_dispatch2 0x7fab34000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.520+0000 7fab30ff9640 3 client.4508.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.520+0000 7fab30ff9640 3 client.4508.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.520+0000 7f1686ffd640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 0x7f16881f51f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f167800e810 tx=0x7f167800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.520+0000 7f1663fff640 10 client.?.objecter ms_handle_connect 0x7f16880d1710 2026-02-17T11:55:59.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.520+0000 7f1663fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.520+0000 7fab30ff9640 20 client.4508.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.527+0000 7fab30ff9640 1 -- 10.20.193.10:0/3569736895 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fab20050020 con 0x7fab340ccbc0 2026-02-17T11:55:59.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.527+0000 7fab30ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.527+0000 7fab30ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.534+0000 7fb17effd640 1 -- 10.20.193.10:0/1769594601 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fb18c021480 con 0x7fb198074cd0 2026-02-17T11:55:59.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.534+0000 7fb17effd640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb164078e00 0x7fb16407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.534+0000 7fb195d74640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb164078e00 0x7fb16407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.534+0000 7fb195d74640 10 monclient: get_auth_request con 0x7fb164078e00 auth_method 0 2026-02-17T11:55:59.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.534+0000 7fb17effd640 10 client.4452.objecter ms_handle_connect 0x7fb164078e00 2026-02-17T11:55:59.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.534+0000 7fb195d74640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb164078e00 0x7fb16407b2c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb180006fd0 tx=0x7fb180006d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.536+0000 7fe4493db640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe44413c150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe43400d750 tx=0x7fe43400dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.536+0000 7fe431ffb640 10 client.?.objecter ms_handle_connect 0x7fe42c004900 2026-02-17T11:55:59.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.536+0000 7fe431ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.542+0000 7fb17effd640 1 -- 10.20.193.10:0/1769594601 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fb18c05d9f0 con 0x7fb198074cd0 2026-02-17T11:55:59.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.542+0000 7fb17effd640 10 client.4452.objecter ms_dispatch2 0x7fb198000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.542+0000 7fb17effd640 3 client.4452.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.542+0000 7fb17effd640 3 client.4452.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.543+0000 7fb17effd640 20 client.4452.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.543+0000 7fb17effd640 1 -- 10.20.193.10:0/1769594601 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb18c0620b0 con 0x7fb198074cd0 2026-02-17T11:55:59.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.543+0000 7fb17effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.543+0000 7fb17effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.543+0000 7fc986575640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9740054a0 0x7fc9881f2090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00ce00 tx=0x7fc97c0076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.543+0000 7fc96effd640 10 client.?.objecter ms_handle_connect 0x7fc9740054a0 2026-02-17T11:55:59.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.543+0000 7fc96effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4285296519 0 0) 0x7fd344003620 con 0x7fd35c0ccbc0 2026-02-17T11:55:59.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 >> v2:10.20.193.153:3300/0 conn(0x7fd35c156260 msgr2=0x7fd35c074b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 --2- 10.20.193.10:0/278757626 >> v2:10.20.193.153:3300/0 conn(0x7fd35c156260 0x7fd35c074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 >> v2:10.20.193.71:3300/0 conn(0x7fd35c155e80 msgr2=0x7fd35c0745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 --2- 10.20.193.10:0/278757626 >> v2:10.20.193.71:3300/0 conn(0x7fd35c155e80 0x7fd35c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:55:59.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c073ae0 con 0x7fd35c0ccbc0 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fd358003280 con 0x7fd35c0ccbc0 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient: dump: 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 >> v1:10.20.193.10:6789/0 conn(0x7fd35c0ccbc0 legacy=0x7fd35c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 --2- 10.20.193.10:0/278757626 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd344003bf0 0x7fd344004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient(hunting): picked mon.a con 0x7fd344003bf0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 --2- 10.20.193.10:0/278757626 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd344004900 0x7fd344004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient(hunting): picked mon.b con 0x7fd344004900 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 --2- 10.20.193.10:0/278757626 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd344009ab0 0x7fd34400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient(hunting): picked mon.c con 0x7fd344009ab0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c0cd840 con 0x7fd344003bf0 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c073800 con 0x7fd344004900 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd34400c540 con 0x7fd344009ab0 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.547+0000 7fd360ae8640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:55:59.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 1 -- 10.20.193.10:0/2388239222 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434005270 con 0x7fe42c004900 2026-02-17T11:55:59.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:59.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 10 monclient: dump: 2026-02-17T11:55:59.551 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 1 -- 10.20.193.10:0/2388239222 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe434017070 con 0x7fe42c004900 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 1 -- 10.20.193.10:0/2388239222 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434003710 con 0x7fe42c004900 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe4337fe640 4 set_mon_vals no callback set 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe431ffb640 10 monclient: dump: 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fd361aea640 1 --2- 10.20.193.10:0/278757626 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd344003bf0 0x7fd344004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 5 monclient: authenticate success, global_id 4458 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 10 monclient: _renew_subs 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4441f4ba0 con 0x7fe42c004900 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 10 client.4458.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 10 monclient: _renew_subs 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4440c9800 con 0x7fe42c004900 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 1 librados: init done 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 1 -- 10.20.193.10:0/3720678724 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00d650 con 0x7fc9740054a0 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 10 monclient: dump: 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.553 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 1 -- 10.20.193.10:0/3720678724 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc97c011070 con 0x7fc9740054a0 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 1 -- 10.20.193.10:0/3720678724 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00da10 con 0x7fc9740054a0 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc96effd640 10 monclient: dump: 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 5 monclient: authenticate success, global_id 4461 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc984d72640 4 set_mon_vals no callback set 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 10 monclient: _renew_subs 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc988155190 con 0x7fc9740054a0 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 10 client.4461.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 10 monclient: _renew_subs 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98806f870 con 0x7fc9740054a0 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 1 librados: init done 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7f871ffff640 1 -- 10.20.193.10:0/1611232521 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f873808be20 con 0x7f87441f5da0 2026-02-17T11:55:59.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7f871ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7f871ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stdout:103079215108 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4440745c0 con 0x7fe42c004900 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.550+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98806f380 con 0x7fc9740054a0 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.551+0000 7fd361aea640 10 monclient(hunting): get_auth_request con 0x7fd344003bf0 auth_method 0 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.551+0000 7fd361aea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.551+0000 7fd361aea640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.551+0000 7fd361aea640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7fd361aea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7fd361aea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7fd361aea640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 10 librados: watch_flush enter 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 10 librados: watch_flush exit 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 20 client.4440.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 10 client.4440.objecter successfully canceled tick 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8714078e30 msgr2=0x7f871407b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8714078e30 0x7f871407b2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8730004ea0 tx=0x7f8730009040 comp rx=0 tx=0).stop 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 10 monclient: shutdown 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f87441f5da0 msgr2=0x7f8744144f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.552+0000 7f874a287640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f87441f5da0 0x7f8744144f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f873802fc30 tx=0x7f87380034c0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.553+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 shutdown_connections 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.553+0000 7f874a287640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8714078e30 0x7f871407b2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.553+0000 7f874a287640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f87441f5da0 0x7f8744144f70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.553+0000 7f874a287640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f87440ca590 0x7f87441f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.553+0000 7f874a287640 1 --2- 10.20.193.10:0/1611232521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f87280054c0 0x7f87440ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.553+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 >> 10.20.193.10:0/1611232521 conn(0x7f87440ce2b0 msgr2=0x7f87440ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.553+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 shutdown_connections 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.553+0000 7f874a287640 1 -- 10.20.193.10:0/1611232521 wait complete. 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.553+0000 7f874a287640 1 librados: shutdown 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 10 monclient(hunting): handle_auth_done global_id 4455 payload 293 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 1 -- 10.20.193.10:0/278757626 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd344009ab0 msgr2=0x7fd34400bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 1 --2- 10.20.193.10:0/278757626 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd344009ab0 0x7fd34400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 1 -- 10.20.193.10:0/278757626 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd344004900 msgr2=0x7fd344004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 1 --2- 10.20.193.10:0/278757626 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd344004900 0x7fd344004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 1 monclient: found mon.a 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd3622eb640 1 -- 10.20.193.10:0/278757626 reap_dead start 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 1 -- 10.20.193.10:0/278757626 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd344003620 con 0x7fd344003bf0 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd361aea640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd363d75640 5 monclient: authenticate success, global_id 4455 2026-02-17T11:55:59.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.554+0000 7fd363d75640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215110 got 103079215108 for osd.11 2026-02-17T11:55:59.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.598+0000 7ff19612a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:55:59.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.598+0000 7ff19612a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:55:59.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.598+0000 7ff19612a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.598+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff1900c9b60 con 0x7ff19015d220 2026-02-17T11:55:59.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.615+0000 7fab3a903640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:55:59.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.615+0000 7fab3a903640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:55:59.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.615+0000 7fab3a903640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.615+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fab34153cd0 con 0x7fab340ccbc0 2026-02-17T11:55:59.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.615+0000 7f99baffd640 1 -- 10.20.193.10:0/771972275 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99c4062130 con 0x7f99d415f5c0 2026-02-17T11:55:59.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.615+0000 7f99baffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:55:59.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.615+0000 7f99baffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.617 INFO:teuthology.orchestra.run.trial010.stdout:98784247812 2026-02-17T11:55:59.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 10 librados: watch_flush enter 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 10 librados: watch_flush exit 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 20 client.4478.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 10 client.4478.objecter successfully canceled tick 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99a0079200 msgr2=0x7f99a007b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99a0079200 0x7f99a007b6c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99c8039000 tx=0x7f99c8033000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 10 monclient: shutdown 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 msgr2=0x7f99d415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 0x7f99d415c3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99c400cc50 tx=0x7f99c400a430 comp rx=0 tx=0).stop 2026-02-17T11:55:59.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 shutdown_connections 2026-02-17T11:55:59.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99a0079200 0x7f99a007b6c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f99d415f5c0 0x7f99d415c3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f99d415e2f0 0x7f99d415be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 --2- 10.20.193.10:0/771972275 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f99d40c97f0 0x7f99d41f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 >> 10.20.193.10:0/771972275 conn(0x7f99d4073070 msgr2=0x7f99d41512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 shutdown_connections 2026-02-17T11:55:59.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 -- 10.20.193.10:0/771972275 wait complete. 2026-02-17T11:55:59.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.617+0000 7f99d8bce640 1 librados: shutdown 2026-02-17T11:55:59.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247812 for osd.2 2026-02-17T11:55:59.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.631+0000 7fb19cd22640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:55:59.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.631+0000 7fb19cd22640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:55:59.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.631+0000 7fb19cd22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.631+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fb1980745c0 con 0x7fb198074cd0 2026-02-17T11:55:59.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.639+0000 7fca9effd640 1 -- 10.20.193.10:0/78786432 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fcaa80133c0 con 0x7fcab81452f0 2026-02-17T11:55:59.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.639+0000 7fca9effd640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fca84078e80 0x7fca8407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.639+0000 7fcab6575640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fca84078e80 0x7fca8407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.639+0000 7fcab6575640 10 monclient: get_auth_request con 0x7fca84078e80 auth_method 0 2026-02-17T11:55:59.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.640+0000 7fca9effd640 10 client.4514.objecter ms_handle_connect 0x7fca84078e80 2026-02-17T11:55:59.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.640+0000 7fcab6575640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fca84078e80 0x7fca8407b340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcaac006fd0 tx=0x7fcaac006d00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.641+0000 7fca9effd640 1 -- 10.20.193.10:0/78786432 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fcaa805df70 con 0x7fcab81452f0 2026-02-17T11:55:59.644 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.641+0000 7fca9effd640 10 client.4514.objecter ms_dispatch2 0x7fcab8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.644 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.641+0000 7fca9effd640 3 client.4514.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.644 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.641+0000 7fca9effd640 3 client.4514.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.644 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.641+0000 7fca9effd640 20 client.4514.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.647+0000 7fca9effd640 1 -- 10.20.193.10:0/78786432 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcaa801a060 con 0x7fcab81452f0 2026-02-17T11:55:59.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.647+0000 7fca9effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.647+0000 7fca9effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 1 -- 10.20.193.10:0/3437252879 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678017020 con 0x7f16880d1710 2026-02-17T11:55:59.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 10 monclient: dump: 2026-02-17T11:55:59.651 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 1 -- 10.20.193.10:0/3437252879 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1678004230 con 0x7f16880d1710 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 1 -- 10.20.193.10:0/3437252879 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167800f040 con 0x7f16880d1710 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f168dda8640 5 monclient: authenticate success, global_id 4517 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f168dda8640 10 monclient: _renew_subs 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1685ffb640 4 set_mon_vals no callback set 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f168dda8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168815bb90 con 0x7f16880d1710 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f1663fff640 10 monclient: dump: 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f168dda8640 10 client.4517.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f168dda8640 10 monclient: _renew_subs 2026-02-17T11:55:59.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f168dda8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168815c150 con 0x7f16880d1710 2026-02-17T11:55:59.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.648+0000 7f168dda8640 1 librados: init done 2026-02-17T11:55:59.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.649+0000 7f168dda8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.649+0000 7f168dda8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.649+0000 7f168dda8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.649+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f168814b950 con 0x7f16880d1710 2026-02-17T11:55:59.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.679+0000 7f71a67fc640 1 -- 10.20.193.10:0/3283439339 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f71b8160330 con 0x7f71b81527e0 2026-02-17T11:55:59.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.679+0000 7f71a67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:55:59.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.679+0000 7f71a67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.682 INFO:teuthology.orchestra.run.trial010.stdout:124554051589 2026-02-17T11:55:59.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 10 librados: watch_flush enter 2026-02-17T11:55:59.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 10 librados: watch_flush exit 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 20 client.4516.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 10 client.4516.objecter successfully canceled tick 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7188078e00 msgr2=0x7f718807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7188078e00 0x7f718807b2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71a8039000 tx=0x7f71a8031000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 10 monclient: shutdown 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f71b81527e0 msgr2=0x7f71b8147740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f71b81527e0 0x7f71b8147740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f71b400efc0 tx=0x7f71b400c490 comp rx=0 tx=0).stop 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 shutdown_connections 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7188078e00 0x7f718807b2c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f71b81527e0 0x7f71b8147740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f71b8152400 0x7f71b8147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.681+0000 7f71bffc1640 1 --2- 10.20.193.10:0/3283439339 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f71b80ccd10 0x7f71b814d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.682+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 >> 10.20.193.10:0/3283439339 conn(0x7f71b80ca190 msgr2=0x7f71b8072970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.682+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 shutdown_connections 2026-02-17T11:55:59.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.682+0000 7f71bffc1640 1 -- 10.20.193.10:0/3283439339 wait complete. 2026-02-17T11:55:59.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.682+0000 7f71bffc1640 1 librados: shutdown 2026-02-17T11:55:59.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.688+0000 7f13c2ffd640 1 -- 10.20.193.10:0/1935467456 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f13d001d030 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.688+0000 7f13c2ffd640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13a8078e50 0x7f13a807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.689+0000 7f13d9d74640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13a8078e50 0x7f13a807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.689+0000 7f13d9d74640 10 monclient: get_auth_request con 0x7f13a8078e50 auth_method 0 2026-02-17T11:55:59.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.689+0000 7f13c2ffd640 10 client.4513.objecter ms_handle_connect 0x7f13a8078e50 2026-02-17T11:55:59.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.689+0000 7f13d9d74640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13a8078e50 0x7f13a807b310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f13dc072150 tx=0x7f13c4031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.690+0000 7f13c2ffd640 1 -- 10.20.193.10:0/1935467456 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f13d001de30 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.690+0000 7f13c2ffd640 10 client.4513.objecter ms_dispatch2 0x7f13dc000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.690+0000 7f13c2ffd640 3 client.4513.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.690+0000 7f13c2ffd640 3 client.4513.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.690+0000 7f13c2ffd640 20 client.4513.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051590 got 124554051589 for osd.3 2026-02-17T11:55:59.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.697+0000 7f13c2ffd640 1 -- 10.20.193.10:0/1935467456 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f13d0024080 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.697+0000 7f13c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.697+0000 7f13c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.706+0000 7f02237fe640 1 -- 10.20.193.10:0/4275763893 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f023400cb70 con 0x7f0244156260 2026-02-17T11:55:59.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.706+0000 7f02237fe640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0210078e80 0x7f021007b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.706+0000 7f0242d76640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0210078e80 0x7f021007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.706+0000 7f0242d76640 10 monclient: get_auth_request con 0x7f0210078e80 auth_method 0 2026-02-17T11:55:59.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.706+0000 7f0242d76640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0210078e80 0x7f021007b340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f024408f350 tx=0x7f0238031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.706+0000 7f02237fe640 10 client.4522.objecter ms_handle_connect 0x7f0210078e80 2026-02-17T11:55:59.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.708+0000 7f02237fe640 1 -- 10.20.193.10:0/4275763893 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f0234012de0 con 0x7f0244156260 2026-02-17T11:55:59.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.708+0000 7f02237fe640 10 client.4522.objecter ms_dispatch2 0x7f0244000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.708+0000 7f02237fe640 3 client.4522.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.708+0000 7f02237fe640 3 client.4522.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.709+0000 7f02237fe640 20 client.4522.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.716+0000 7f02237fe640 1 -- 10.20.193.10:0/4275763893 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f02340620f0 con 0x7f0244156260 2026-02-17T11:55:59.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.716+0000 7f02237fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.716+0000 7f02237fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.723+0000 7fae28ff9640 1 -- 10.20.193.10:0/3644012781 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fae200127a0 con 0x7fae2c156020 2026-02-17T11:55:59.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.723+0000 7fae28ff9640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadfc078e50 0x7fadfc07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.723+0000 7fae2bfff640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadfc078e50 0x7fadfc07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.724+0000 7fae2bfff640 10 monclient: get_auth_request con 0x7fadfc078e50 auth_method 0 2026-02-17T11:55:59.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.724+0000 7fae28ff9640 10 client.4531.objecter ms_handle_connect 0x7fadfc078e50 2026-02-17T11:55:59.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.724+0000 7fae2bfff640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadfc078e50 0x7fadfc07b310 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fae18039000 tx=0x7fae18031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fc5627fc640 1 -- 10.20.193.10:0/3876363916 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc568041c80 con 0x7fc574155e80 2026-02-17T11:55:59.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fcabcc87640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:55:59.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fcabcc87640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:55:59.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fcabcc87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcab8158230 con 0x7fcab81452f0 2026-02-17T11:55:59.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fc5627fc640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc544078e50 0x7fc54407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fc579834640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc544078e50 0x7fc54407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fc579834640 10 monclient: get_auth_request con 0x7fc544078e50 auth_method 0 2026-02-17T11:55:59.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fc579834640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc544078e50 0x7fc54407b310 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc564006fd0 tx=0x7fc564006d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.730+0000 7fc5627fc640 10 client.4519.objecter ms_handle_connect 0x7fc544078e50 2026-02-17T11:55:59.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.732+0000 7fae28ff9640 1 -- 10.20.193.10:0/3644012781 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fae20014de0 con 0x7fae2c156020 2026-02-17T11:55:59.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.732+0000 7fae28ff9640 10 client.4531.objecter ms_dispatch2 0x7fae2c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.732+0000 7fae28ff9640 3 client.4531.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.732+0000 7fae28ff9640 3 client.4531.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.732+0000 7fae28ff9640 20 client.4531.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.735+0000 7fc5627fc640 1 -- 10.20.193.10:0/3876363916 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fc56802fa40 con 0x7fc574155e80 2026-02-17T11:55:59.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.735+0000 7fc5627fc640 10 client.4519.objecter ms_dispatch2 0x7fc574000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.735+0000 7fc5627fc640 3 client.4519.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.735+0000 7fc5627fc640 3 client.4519.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.735+0000 7fc5627fc640 20 client.4519.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.748+0000 7fae28ff9640 1 -- 10.20.193.10:0/3644012781 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fae20022020 con 0x7fae2c156020 2026-02-17T11:55:59.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.748+0000 7fae28ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.748+0000 7fae28ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.748+0000 7fc5627fc640 1 -- 10.20.193.10:0/3876363916 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc568087fb0 con 0x7fc574155e80 2026-02-17T11:55:59.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.748+0000 7fc5627fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.748+0000 7fc5627fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.761 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.759+0000 7fab30ff9640 1 -- 10.20.193.10:0/3569736895 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fab20087cb0 con 0x7fab340ccbc0 2026-02-17T11:55:59.761 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.759+0000 7fab30ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:55:59.761 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.759+0000 7fab30ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.762 INFO:teuthology.orchestra.run.trial010.stdout:115964116998 2026-02-17T11:55:59.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.759+0000 7ff16bfff640 1 -- 10.20.193.10:0/2454204642 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff184061670 con 0x7ff19015d220 2026-02-17T11:55:59.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.759+0000 7ff16bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:55:59.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.759+0000 7ff16bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.763 INFO:teuthology.orchestra.run.trial010.stdout:103079215108 2026-02-17T11:55:59.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.761+0000 7fc96effd640 1 -- 10.20.193.10:0/3720678724 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc97c026080 con 0x7fc9740054a0 2026-02-17T11:55:59.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 10 librados: watch_flush enter 2026-02-17T11:55:59.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 10 librados: watch_flush exit 2026-02-17T11:55:59.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 20 client.4508.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 10 client.4508.objecter successfully canceled tick 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab04078e50 msgr2=0x7fab0407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab04078e50 0x7fab0407b310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab24006b90 tx=0x7fab24006b20 comp rx=0 tx=0).stop 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 10 monclient: shutdown 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fab340ccbc0 msgr2=0x7fab340c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fab340ccbc0 0x7fab340c82d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab20009130 tx=0x7fab200047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 shutdown_connections 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab04078e50 0x7fab0407b310 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fab34156260 0x7fab3415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fab34155e80 0x7fab340ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 --2- 10.20.193.10:0/3569736895 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fab340ccbc0 0x7fab340c82d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.767 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 >> 10.20.193.10:0/3569736895 conn(0x7fab340ce2b0 msgr2=0x7fab341541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.767 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fc96effd640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc954078e50 0x7fc95407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 shutdown_connections 2026-02-17T11:55:59.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 -- 10.20.193.10:0/3569736895 wait complete. 2026-02-17T11:55:59.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fab3a903640 1 librados: shutdown 2026-02-17T11:55:59.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fc985d74640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc954078e50 0x7fc95407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fc985d74640 10 monclient: get_auth_request con 0x7fc954078e50 auth_method 0 2026-02-17T11:55:59.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fc985d74640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc954078e50 0x7fc95407b310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc970007930 tx=0x7fc9700078c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7fc96effd640 10 client.4461.objecter ms_handle_connect 0x7fc954078e50 2026-02-17T11:55:59.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 10 librados: watch_flush enter 2026-02-17T11:55:59.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 10 librados: watch_flush exit 2026-02-17T11:55:59.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 20 client.4511.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 10 client.4511.objecter successfully canceled tick 2026-02-17T11:55:59.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff160078e50 msgr2=0x7ff16007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff160078e50 0x7ff16007b310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1900c6b30 tx=0x7ff17c031000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 10 monclient: shutdown 2026-02-17T11:55:59.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 msgr2=0x7ff1901e4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 0x7ff1901e4ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff18400b9c0 tx=0x7ff18400be90 comp rx=0 tx=0).stop 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 shutdown_connections 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff160078e50 0x7ff16007b310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19015d220 0x7ff1901e4ff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff1900c92f0 0x7ff1901451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 --2- 10.20.193.10:0/2454204642 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff190074920 0x7ff1901e7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 >> 10.20.193.10:0/2454204642 conn(0x7ff1900c9d80 msgr2=0x7ff190148f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 shutdown_connections 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 -- 10.20.193.10:0/2454204642 wait complete. 2026-02-17T11:55:59.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.762+0000 7ff19612a640 1 librados: shutdown 2026-02-17T11:55:59.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.768+0000 7f1663fff640 1 -- 10.20.193.10:0/3437252879 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f1678012050 con 0x7f16880d1710 2026-02-17T11:55:59.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.768+0000 7f1663fff640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1658078e50 0x7f165807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.768+0000 7f16877fe640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1658078e50 0x7f165807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.768+0000 7f16877fe640 10 monclient: get_auth_request con 0x7f1658078e50 auth_method 0 2026-02-17T11:55:59.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.768+0000 7fe431ffb640 1 -- 10.20.193.10:0/2388239222 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fe434003ac0 con 0x7fe42c004900 2026-02-17T11:55:59.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.769+0000 7f1663fff640 10 client.4517.objecter ms_handle_connect 0x7f1658078e50 2026-02-17T11:55:59.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.769+0000 7f16877fe640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1658078e50 0x7f165807b310 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f16740046e0 tx=0x7f16740091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.769+0000 7fe431ffb640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe414078e50 0x7fe41407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.769+0000 7fe448bda640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe414078e50 0x7fe41407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.769+0000 7fe448bda640 10 monclient: get_auth_request con 0x7fe414078e50 auth_method 0 2026-02-17T11:55:59.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.769+0000 7fe448bda640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe414078e50 0x7fe41407b310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe438036000 tx=0x7fe438009070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.769+0000 7fe431ffb640 10 client.4458.objecter ms_handle_connect 0x7fe414078e50 2026-02-17T11:55:59.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.770+0000 7f1663fff640 1 -- 10.20.193.10:0/3437252879 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f167805dc20 con 0x7f16880d1710 2026-02-17T11:55:59.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.770+0000 7f1663fff640 10 client.4517.objecter ms_dispatch2 0x7f1688000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.770+0000 7f1663fff640 3 client.4517.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.770+0000 7f1663fff640 3 client.4517.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.770+0000 7f1663fff640 20 client.4517.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117000 got 115964116998 for osd.5 2026-02-17T11:55:59.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215110 got 103079215108 for osd.7 2026-02-17T11:55:59.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.776+0000 7f1663fff640 1 -- 10.20.193.10:0/3437252879 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f168814b950 con 0x7f16880d1710 2026-02-17T11:55:59.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.776+0000 7f1663fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.776+0000 7f1663fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.779+0000 7fca9effd640 1 -- 10.20.193.10:0/78786432 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcaa8062630 con 0x7fcab81452f0 2026-02-17T11:55:59.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.779+0000 7fca9effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:55:59.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.779+0000 7fca9effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.781 INFO:teuthology.orchestra.run.trial010.stdout:94489280518 2026-02-17T11:55:59.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.781+0000 7fcabcc87640 10 librados: watch_flush enter 2026-02-17T11:55:59.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.781+0000 7fcabcc87640 10 librados: watch_flush exit 2026-02-17T11:55:59.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.781+0000 7fcabcc87640 20 client.4514.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.781+0000 7fcabcc87640 10 client.4514.objecter successfully canceled tick 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.781+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fca84078e80 msgr2=0x7fca8407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.781+0000 7fcabcc87640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fca84078e80 0x7fca8407b340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcaac006fd0 tx=0x7fcaac006d00 comp rx=0 tx=0).stop 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 10 monclient: shutdown 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcab81452f0 msgr2=0x7fcab8145770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcab81452f0 0x7fcab8145770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40058e0 tx=0x7fcaa800a430 comp rx=0 tx=0).stop 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 shutdown_connections 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fca84078e80 0x7fca8407b340 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcab81452f0 0x7fcab8145770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcab813e310 0x7fcab8162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 --2- 10.20.193.10:0/78786432 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcaa4004900 0x7fcab8144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 >> 10.20.193.10:0/78786432 conn(0x7fcab806d970 msgr2=0x7fcab80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 shutdown_connections 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 -- 10.20.193.10:0/78786432 wait complete. 2026-02-17T11:55:59.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.782+0000 7fcabcc87640 1 librados: shutdown 2026-02-17T11:55:59.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.786+0000 7f13e0ebf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:55:59.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.786+0000 7f13e0ebf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:55:59.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.786+0000 7f13e0ebf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.786+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f13dc1f7b90 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.788+0000 7f13c2ffd640 1 -- 10.20.193.10:0/1935467456 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f13d0061b00 con 0x7f13dc0c8dd0 2026-02-17T11:55:59.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.788+0000 7f13c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:55:59.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.788+0000 7f13c2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.790 INFO:teuthology.orchestra.run.trial010.stdout:115964117000 2026-02-17T11:55:59.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.789+0000 7fc96effd640 1 -- 10.20.193.10:0/3720678724 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fc97c05e5c0 con 0x7fc9740054a0 2026-02-17T11:55:59.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.789+0000 7fc96effd640 10 client.4461.objecter ms_dispatch2 0x7fc988000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.789+0000 7fc96effd640 3 client.4461.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.789+0000 7fc96effd640 3 client.4461.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.789+0000 7fc96effd640 20 client.4461.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.789+0000 7fc96effd640 1 -- 10.20.193.10:0/3720678724 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc97c062c80 con 0x7fc9740054a0 2026-02-17T11:55:59.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.789+0000 7fc96effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.789+0000 7fc96effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280519 got 94489280518 for osd.0 2026-02-17T11:55:59.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 10 librados: watch_flush enter 2026-02-17T11:55:59.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 10 librados: watch_flush exit 2026-02-17T11:55:59.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 20 client.4513.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 10 client.4513.objecter successfully canceled tick 2026-02-17T11:55:59.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13a8078e50 msgr2=0x7f13a807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13a8078e50 0x7f13a807b310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f13dc072150 tx=0x7f13c4031000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 10 monclient: shutdown 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc0c8dd0 msgr2=0x7f13dc1f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc0c8dd0 0x7f13dc1f7650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f13d000b7b0 tx=0x7f13d000bc80 comp rx=0 tx=0).stop 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 shutdown_connections 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13a8078e50 0x7f13a807b310 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13dc152a40 0x7f13dc14de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f13dc152660 0x7f13dc1f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 --2- 10.20.193.10:0/1935467456 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13dc0c8dd0 0x7f13dc1f7650 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 >> 10.20.193.10:0/1935467456 conn(0x7f13dc0c9d80 msgr2=0x7f13dc0c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 shutdown_connections 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 -- 10.20.193.10:0/1935467456 wait complete. 2026-02-17T11:55:59.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.790+0000 7f13e0ebf640 1 librados: shutdown 2026-02-17T11:55:59.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.795+0000 7fe431ffb640 1 -- 10.20.193.10:0/2388239222 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fe43405e7a0 con 0x7fe42c004900 2026-02-17T11:55:59.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.795+0000 7fe431ffb640 10 client.4458.objecter ms_dispatch2 0x7fe444000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.795+0000 7fe431ffb640 3 client.4458.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.795+0000 7fe431ffb640 3 client.4458.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.796+0000 7fe431ffb640 20 client.4458.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.796+0000 7fe431ffb640 1 -- 10.20.193.10:0/2388239222 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe43401a360 con 0x7fe42c004900 2026-02-17T11:55:59.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.796+0000 7fe431ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.796+0000 7fe431ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:55:59.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.798+0000 7fd361aea640 1 --2- 10.20.193.10:0/278757626 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd344003bf0 0x7fd344004010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009980 tx=0x7fd34c02ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e72150fadc3b4b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117002 got 115964117000 for osd.6 2026-02-17T11:55:59.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.808+0000 7f0249032640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:55:59.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.808+0000 7f0249032640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:55:59.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.808+0000 7f0249032640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.808+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f0244149cc0 con 0x7f0244156260 2026-02-17T11:55:59.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.812+0000 7f02237fe640 1 -- 10.20.193.10:0/4275763893 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f02340619f0 con 0x7f0244156260 2026-02-17T11:55:59.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.812+0000 7f02237fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:55:59.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.812+0000 7f02237fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.814 INFO:teuthology.orchestra.run.trial010.stdout:120259084290 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 10 librados: watch_flush enter 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 10 librados: watch_flush exit 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 20 client.4522.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 10 client.4522.objecter successfully canceled tick 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0210078e80 msgr2=0x7f021007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0210078e80 0x7f021007b340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f024408f350 tx=0x7f0238031000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 10 monclient: shutdown 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244156260 msgr2=0x7f02440745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244156260 0x7f02440745c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f023400b990 tx=0x7f023400be60 comp rx=0 tx=0).stop 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 shutdown_connections 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0210078e80 0x7f021007b340 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0244156260 0x7f02440745c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0244155e80 0x7f0244158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 --2- 10.20.193.10:0/4275763893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f02440cd2d0 0x7f02441f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 >> 10.20.193.10:0/4275763893 conn(0x7f02440ce2b0 msgr2=0x7f0244152be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 shutdown_connections 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 -- 10.20.193.10:0/4275763893 wait complete. 2026-02-17T11:55:59.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.814+0000 7f0249032640 1 librados: shutdown 2026-02-17T11:55:59.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.13 2026-02-17T11:55:59.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.837+0000 7fc57babf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:55:59.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.837+0000 7fc57babf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:55:59.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.837+0000 7fc57babf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.837+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7fc5741597b0 con 0x7fc574155e80 2026-02-17T11:55:59.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.839+0000 7fae32755640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:55:59.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.839+0000 7fae32755640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:55:59.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.839+0000 7fae32755640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:55:59.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.839+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7fae2c153050 con 0x7fae2c156020 2026-02-17T11:55:59.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fc5627fc640 1 -- 10.20.193.10:0/3876363916 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fc5680878b0 con 0x7fc574155e80 2026-02-17T11:55:59.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fc5627fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:55:59.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fc5627fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.842 INFO:teuthology.orchestra.run.trial010.stdout:94489280517 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c03c070 con 0x7fd344003bf0 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 10 monclient: dump: 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd363d75640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:55:59.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34c02f770 con 0x7fd344003bf0 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 1 -- 10.20.193.10:0/278757626 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c009550 con 0x7fd344003bf0 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd360ae8640 10 monclient: dump: 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd363d75640 10 monclient: get_monmap_and_config success 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.840+0000 7fd363d75640 4 set_mon_vals no callback set 2026-02-17T11:55:59.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 10 monclient: shutdown 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 -- 10.20.193.10:0/278757626 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd344003bf0 msgr2=0x7fd344004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 --2- 10.20.193.10:0/278757626 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd344003bf0 0x7fd344004010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009980 tx=0x7fd34c02ed10 comp rx=0 tx=0).stop 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 -- 10.20.193.10:0/278757626 shutdown_connections 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 --2- 10.20.193.10:0/278757626 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd344003bf0 0x7fd344004010 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 -- 10.20.193.10:0/278757626 >> 10.20.193.10:0/278757626 conn(0x7fd35c0ce2b0 msgr2=0x7fd35c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 -- 10.20.193.10:0/278757626 shutdown_connections 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 -- 10.20.193.10:0/278757626 wait complete. 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 10 monclient: build_initial_monmap 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 10 monclient: monmap: 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:55:59.846 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:55:59.847 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 librados: starting msgr at 2026-02-17T11:55:59.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 librados: starting objecter 2026-02-17T11:55:59.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 Processor -- start 2026-02-17T11:55:59.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 -- start start 2026-02-17T11:55:59.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 librados: setting wanted keys 2026-02-17T11:55:59.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 1 librados: calling monclient init 2026-02-17T11:55:59.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.841+0000 7fd363d75640 10 monclient: init 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 10 librados: watch_flush enter 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 10 librados: watch_flush exit 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 20 client.4519.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 10 client.4519.objecter successfully canceled tick 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc544078e50 msgr2=0x7fc54407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc544078e50 0x7fc54407b310 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc564006fd0 tx=0x7fc564006d40 comp rx=0 tx=0).stop 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 10 monclient: shutdown 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc574155e80 msgr2=0x7fc5741e8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc574155e80 0x7fc5741e8c60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc568009970 tx=0x7fc5680047c0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 shutdown_connections 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc544078e50 0x7fc54407b310 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc574156260 0x7fc5741e91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc574155e80 0x7fc5741e8c60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 --2- 10.20.193.10:0/3876363916 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc574074cd0 0x7fc5741f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 >> 10.20.193.10:0/3876363916 conn(0x7fc5740ce2b0 msgr2=0x7fc5740ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 shutdown_connections 2026-02-17T11:55:59.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 -- 10.20.193.10:0/3876363916 wait complete. 2026-02-17T11:55:59.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient: _reopen_session rank -1 2026-02-17T11:55:59.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:55:59.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fb17effd640 1 -- 10.20.193.10:0/1769594601 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb18c0619b0 con 0x7fb198074cd0 2026-02-17T11:55:59.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fb17effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:55:59.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fb17effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd344003bf0 0x7fd35c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient(hunting): picked mon.noname-b con 0x7fd344003bf0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:55:59.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fc57babf640 1 librados: shutdown 2026-02-17T11:55:59.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd35c1f4fb0 0x7fd35c0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient(hunting): picked mon.noname-c con 0x7fd35c1f4fb0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd35c1f66d0 0x7fd35c1f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient(hunting): picked mon.noname-a con 0x7fd35c1f66d0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c0c4870 con 0x7fd35c1f66d0 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c0740a0 con 0x7fd344003bf0 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient(hunting): start opening mon connection 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c0c49f0 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient(hunting): _renew_subs 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd363d75640 10 monclient(hunting): authenticate will time out at 1029.564373s 2026-02-17T11:55:59.851 INFO:teuthology.orchestra.run.trial010.stdout:115964116997 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd3612e9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd35c1f4fb0 0x7fd35c0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd3612e9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd35c1f4fb0 0x7fd35c0c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35930/0 (socket says 10.20.193.10:35930) 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd3612e9640 1 -- 10.20.193.10:0/4263148855 learned_addr learned my addr 10.20.193.10:0/4263148855 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd3612e9640 10 monclient(hunting): get_auth_request con 0x7fd35c1f4fb0 auth_method 0 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd3612e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd3612e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.842+0000 7fd3612e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.843+0000 7fd3612e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.843+0000 7fd3612e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:55:59.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.843+0000 7fd3612e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 10 librados: watch_flush enter 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 10 librados: watch_flush exit 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 20 client.4452.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 10 client.4452.objecter successfully canceled tick 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb164078e00 msgr2=0x7fb16407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb164078e00 0x7fb16407b2c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb180006fd0 tx=0x7fb180006d40 comp rx=0 tx=0).stop 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 10 monclient: shutdown 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198074cd0 msgr2=0x7fb1981f7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198074cd0 0x7fb1981f7ce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00b5a0 tx=0x7fb18c00ba70 comp rx=0 tx=0).stop 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 10 monclient(hunting): handle_auth_done global_id 4520 payload 824 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 shutdown_connections 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb164078e00 0x7fb16407b2c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb198156260 0x7fb198151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb198155e80 0x7fb1981f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 --2- 10.20.193.10:0/1769594601 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb198074cd0 0x7fb1981f7ce0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 1 -- 10.20.193.10:0/4263148855 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd344003bf0 msgr2=0x7fd35c14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd344003bf0 0x7fd35c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 1 -- 10.20.193.10:0/4263148855 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd35c1f66d0 msgr2=0x7fd35c1f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd35c1f66d0 0x7fd35c1f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 >> 10.20.193.10:0/1769594601 conn(0x7fb1980ce2b0 msgr2=0x7fb1980d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 10 monclient: _finish_hunting 0 2026-02-17T11:55:59.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 1 monclient: found mon.noname-c 2026-02-17T11:55:59.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:55:59.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fd3612e9640 1 -- 10.20.193.10:0/4263148855 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c14aaf0 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 shutdown_connections 2026-02-17T11:55:59.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 -- 10.20.193.10:0/1769594601 wait complete. 2026-02-17T11:55:59.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fae28ff9640 1 -- 10.20.193.10:0/3644012781 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fae200623f0 con 0x7fae2c156020 2026-02-17T11:55:59.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fae28ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:55:59.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fae28ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.844+0000 7fb19cd22640 1 librados: shutdown 2026-02-17T11:55:59.856 INFO:teuthology.orchestra.run.trial010.stdout:120259084292 2026-02-17T11:55:59.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.845+0000 7fd3612e9640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd35c1f4fb0 0x7fd35c0c80c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd35000b970 tx=0x7fd35000be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.845+0000 7fd34a7fc640 10 client.?.objecter ms_handle_connect 0x7fd35c1f4fb0 2026-02-17T11:55:59.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.845+0000 7fd34a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:55:59.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 10 librados: watch_flush enter 2026-02-17T11:55:59.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 10 librados: watch_flush exit 2026-02-17T11:55:59.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 20 client.4531.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 10 client.4531.objecter successfully canceled tick 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadfc078e50 msgr2=0x7fadfc07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadfc078e50 0x7fadfc07b310 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fae18039000 tx=0x7fae18031000 comp rx=0 tx=0).stop 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 10 monclient: shutdown 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c156020 msgr2=0x7fae2c158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c156020 0x7fae2c158030 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae2000cb80 tx=0x7fae2000a430 comp rx=0 tx=0).stop 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 shutdown_connections 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadfc078e50 0x7fadfc07b310 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c156020 0x7fae2c158030 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c0d1710 0x7fae2c144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 --2- 10.20.193.10:0/3644012781 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c0c98f0 0x7fae2c156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 >> 10.20.193.10:0/3644012781 conn(0x7fae2c06d970 msgr2=0x7fae2c06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 shutdown_connections 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 -- 10.20.193.10:0/3644012781 wait complete. 2026-02-17T11:55:59.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fae32755640 1 librados: shutdown 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 1 -- 10.20.193.10:0/4263148855 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350004480 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 10 monclient: dump: 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.859 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 1 -- 10.20.193.10:0/4263148855 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd350010070 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 1 -- 10.20.193.10:0/4263148855 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35000c9d0 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd363d75640 5 monclient: authenticate success, global_id 4520 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34bfff640 4 set_mon_vals no callback set 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd34a7fc640 10 monclient: dump: 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:55:59.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd363d75640 10 monclient: _renew_subs 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd363d75640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35c149230 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd363d75640 10 client.4520.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd363d75640 10 monclient: _renew_subs 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd363d75640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35c1497f0 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.847+0000 7fd363d75640 1 librados: init done 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.848+0000 7fd363d75640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.848+0000 7fd363d75640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.848+0000 7fd363d75640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.848+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35c0ccfe0 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280517 for osd.12 2026-02-17T11:55:59.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116999 got 115964116997 for osd.9 2026-02-17T11:55:59.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084292 for osd.14 2026-02-17T11:55:59.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.859+0000 7fd34a7fc640 1 -- 10.20.193.10:0/4263148855 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fd35000cb70 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.860+0000 7fd34a7fc640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd32c078e00 0x7fd32c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:55:59.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.860+0000 7fd361aea640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd32c078e00 0x7fd32c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:55:59.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.860+0000 7fd361aea640 10 monclient: get_auth_request con 0x7fd32c078e00 auth_method 0 2026-02-17T11:55:59.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.860+0000 7fd34a7fc640 10 client.4520.objecter ms_handle_connect 0x7fd32c078e00 2026-02-17T11:55:59.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.860+0000 7fd361aea640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd32c078e00 0x7fd32c07b2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd34c039000 tx=0x7fd34c031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:55:59.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.861+0000 7fd34a7fc640 1 -- 10.20.193.10:0/4263148855 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fd350012de0 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.861+0000 7fd34a7fc640 10 client.4520.objecter ms_dispatch2 0x7fd35c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:55:59.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.861+0000 7fd34a7fc640 3 client.4520.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:55:59.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.861+0000 7fd34a7fc640 3 client.4520.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:55:59.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.861+0000 7fd34a7fc640 20 client.4520.objecter dump_active .. 0 homeless 2026-02-17T11:55:59.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.864+0000 7f168dda8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:55:59.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.864+0000 7f168dda8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:55:59.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.864+0000 7f168dda8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:55:59.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.864+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f16880c9d30 con 0x7f16880d1710 2026-02-17T11:55:59.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.880+0000 7fc98cb33640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:55:59.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.880+0000 7fc98cb33640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:55:59.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.880+0000 7fc98cb33640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.880+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc98815d4c0 con 0x7fc9740054a0 2026-02-17T11:55:59.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.884+0000 7fe44b666640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:55:59.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.884+0000 7fe44b666640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:55:59.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.884+0000 7fe44b666640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:55:59.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.884+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7fe444143380 con 0x7fe42c004900 2026-02-17T11:55:59.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.897+0000 7fc96effd640 1 -- 10.20.193.10:0/3720678724 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc97c062580 con 0x7fc9740054a0 2026-02-17T11:55:59.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.897+0000 7fc96effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:55:59.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.897+0000 7fc96effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.899 INFO:teuthology.orchestra.run.trial010.stdout:115964116997 2026-02-17T11:55:59.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.898+0000 7fe431ffb640 1 -- 10.20.193.10:0/2388239222 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe434062e60 con 0x7fe42c004900 2026-02-17T11:55:59.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.898+0000 7fe431ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:55:59.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.898+0000 7fe431ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:55:59.900 INFO:teuthology.orchestra.run.trial010.stdout:107374182404 2026-02-17T11:55:59.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 10 librados: watch_flush enter 2026-02-17T11:55:59.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 10 librados: watch_flush exit 2026-02-17T11:55:59.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 20 client.4461.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 10 client.4461.objecter successfully canceled tick 2026-02-17T11:55:59.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc954078e50 msgr2=0x7fc95407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc954078e50 0x7fc95407b310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc970007930 tx=0x7fc9700078c0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 10 monclient: shutdown 2026-02-17T11:55:59.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9740054a0 msgr2=0x7fc9881f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9740054a0 0x7fc9881f2090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00ce00 tx=0x7fc97c0076a0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 shutdown_connections 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc954078e50 0x7fc95407b310 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc988157050 0x7fc9881548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc988156bd0 0x7fc988154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 --2- 10.20.193.10:0/3720678724 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9740054a0 0x7fc9881f2090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 >> 10.20.193.10:0/3720678724 conn(0x7fc9880cf550 msgr2=0x7fc988161c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 shutdown_connections 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 -- 10.20.193.10:0/3720678724 wait complete. 2026-02-17T11:55:59.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.899+0000 7fc98cb33640 1 librados: shutdown 2026-02-17T11:55:59.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 10 librados: watch_flush enter 2026-02-17T11:55:59.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 10 librados: watch_flush exit 2026-02-17T11:55:59.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 20 client.4458.objecter shutdown clearing up homeless session... 2026-02-17T11:55:59.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 10 client.4458.objecter successfully canceled tick 2026-02-17T11:55:59.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe414078e50 msgr2=0x7fe41407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe414078e50 0x7fe41407b310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe438036000 tx=0x7fe438009070 comp rx=0 tx=0).stop 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 10 monclient: shutdown 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 msgr2=0x7fe44413c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe44413c150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe43400d750 tx=0x7fe43400dc20 comp rx=0 tx=0).stop 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 shutdown_connections 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe414078e50 0x7fe41407b310 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4441f43c0 0x7fe4440ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4441f7380 0x7fe4441f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 --2- 10.20.193.10:0/2388239222 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe42c004900 0x7fe44413c150 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 >> 10.20.193.10:0/2388239222 conn(0x7fe4440ce2b0 msgr2=0x7fe444151110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 shutdown_connections 2026-02-17T11:55:59.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 -- 10.20.193.10:0/2388239222 wait complete. 2026-02-17T11:55:59.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.900+0000 7fe44b666640 1 librados: shutdown 2026-02-17T11:55:59.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182405 got 107374182404 for osd.15 2026-02-17T11:55:59.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116999 got 115964116997 for osd.1 2026-02-17T11:55:59.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.995+0000 7fd34a7fc640 1 -- 10.20.193.10:0/4263148855 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd350062230 con 0x7fd35c1f4fb0 2026-02-17T11:55:59.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.995+0000 7fd34a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:55:59.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.995+0000 7fd34a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:00.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.999+0000 7f1663fff640 1 -- 10.20.193.10:0/3437252879 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f1678021020 con 0x7f16880d1710 2026-02-17T11:56:00.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.999+0000 7f1663fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:56:00.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:55:59.999+0000 7f1663fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:00.001 INFO:teuthology.orchestra.run.trial010.stdout:115964116999 2026-02-17T11:56:00.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 10 librados: watch_flush enter 2026-02-17T11:56:00.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 10 librados: watch_flush exit 2026-02-17T11:56:00.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 20 client.4517.objecter shutdown clearing up homeless session... 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 10 client.4517.objecter successfully canceled tick 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1658078e50 msgr2=0x7f165807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1658078e50 0x7f165807b310 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f16740046e0 tx=0x7f16740091c0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 10 monclient: shutdown 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 msgr2=0x7f16881f51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 0x7f16881f51f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f167800e810 tx=0x7f167800ece0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 shutdown_connections 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1658078e50 0x7f165807b310 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1688156020 0x7f16881f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16880d1710 0x7f16881f51f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 --2- 10.20.193.10:0/3437252879 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f16880c98f0 0x7f16880d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 >> 10.20.193.10:0/3437252879 conn(0x7f168806d970 msgr2=0x7f16880cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 shutdown_connections 2026-02-17T11:56:00.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 -- 10.20.193.10:0/3437252879 wait complete. 2026-02-17T11:56:00.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.001+0000 7f168dda8640 1 librados: shutdown 2026-02-17T11:56:00.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964116999 for osd.10 2026-02-17T11:56:00.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.079+0000 7fd363d75640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:56:00.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.079+0000 7fd363d75640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:56:00.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.079+0000 7fd363d75640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.079+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fd35c1597b0 con 0x7fd35c1f4fb0 2026-02-17T11:56:00.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.082+0000 7fd34a7fc640 1 -- 10.20.193.10:0/4263148855 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd350061b30 con 0x7fd35c1f4fb0 2026-02-17T11:56:00.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.082+0000 7fd34a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:56:00.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.082+0000 7fd34a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:00.084 INFO:teuthology.orchestra.run.trial010.stdout:90194313223 2026-02-17T11:56:00.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 10 librados: watch_flush enter 2026-02-17T11:56:00.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 10 librados: watch_flush exit 2026-02-17T11:56:00.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 20 client.4520.objecter shutdown clearing up homeless session... 2026-02-17T11:56:00.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 10 client.4520.objecter successfully canceled tick 2026-02-17T11:56:00.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd32c078e00 msgr2=0x7fd32c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd32c078e00 0x7fd32c07b2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd34c039000 tx=0x7fd34c031000 comp rx=0 tx=0).stop 2026-02-17T11:56:00.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 10 monclient: shutdown 2026-02-17T11:56:00.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd35c1f4fb0 msgr2=0x7fd35c0c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd35c1f4fb0 0x7fd35c0c80c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd35000b970 tx=0x7fd35000be40 comp rx=0 tx=0).stop 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 shutdown_connections 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd32c078e00 0x7fd32c07b2c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd35c1f66d0 0x7fd35c1f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd35c1f4fb0 0x7fd35c0c80c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 --2- 10.20.193.10:0/4263148855 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd344003bf0 0x7fd35c14a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 >> 10.20.193.10:0/4263148855 conn(0x7fd35c0ce2b0 msgr2=0x7fd35c150990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 shutdown_connections 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 -- 10.20.193.10:0/4263148855 wait complete. 2026-02-17T11:56:00.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.083+0000 7fd363d75640 1 librados: shutdown 2026-02-17T11:56:00.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313223 got 90194313223 for osd.8 2026-02-17T11:56:00.094 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:00.434 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T11:56:00.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.501+0000 7f379e20e640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.501+0000 7f379e20e640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.501+0000 7f379e20e640 10 monclient: monmap: 2026-02-17T11:56:00.504 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.504 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.503030+0000 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.503030+0000 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 1 Processor -- start 2026-02-17T11:56:00.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 1 -- start start 2026-02-17T11:56:00.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient: init 2026-02-17T11:56:00.508 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.508 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient: _add_conns ranks=[3,5,1,2,0,4] 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f379815d220 0x7f379815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient(hunting): picked mon.noname-a con 0x7f379815d220 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f3798074920 0x7f37980c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient(hunting): picked mon.noname-c con 0x7f3798074920 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f37980c9120 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37980c95b0 con 0x7f37980c9120 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f37980c58a0 con 0x7f379815d220 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f37980c55c0 con 0x7f3798074920 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.502+0000 7f379e20e640 10 monclient(hunting): authenticate will time out at 1030.224827s 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f37977fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f379815d220 0x7f379815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f3797fff640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f37980c9120 0x7f3798153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:58068/0 (socket says 10.20.193.10:58068) 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f3797fff640 1 -- 10.20.193.10:0/941647484 learned_addr learned my addr 10.20.193.10:0/941647484 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f3796ffd640 1 --2- 10.20.193.10:0/941647484 >> v2:10.20.193.153:3300/0 conn(0x7f3798074920 0x7f37980c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f37977fe640 10 monclient(hunting): get_auth_request con 0x7f379815d220 auth_method 0 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f37977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f37977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f37977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f3796ffd640 10 monclient(hunting): get_auth_request con 0x7f3798074920 auth_method 0 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f3796ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f3796ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f3796ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f37977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f37977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.503+0000 7f37977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f3796ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f3796ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f3796ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f37977fe640 10 monclient(hunting): handle_auth_done global_id 4464 payload 274 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f37977fe640 1 -- 10.20.193.10:0/941647484 >> v2:10.20.193.153:3300/0 conn(0x7f3798074920 msgr2=0x7f37980c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f37977fe640 1 --2- 10.20.193.10:0/941647484 >> v2:10.20.193.153:3300/0 conn(0x7f3798074920 0x7f37980c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f37977fe640 1 -- 10.20.193.10:0/941647484 >> v1:10.20.193.71:6789/0 conn(0x7f37980c9120 legacy=0x7f3798153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f37977fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f37977fe640 1 monclient: found mon.noname-a 2026-02-17T11:56:00.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f37977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f37977fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.504+0000 7f37977fe640 1 -- 10.20.193.10:0/941647484 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37980c7e20 con 0x7f379815d220 2026-02-17T11:56:00.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.505+0000 7f37977fe640 1 --2- 10.20.193.10:0/941647484 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f379815d220 0x7f379815d600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f37840098a0 tx=0x7f378402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f448b0c7cf7e86d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 1 -- 10.20.193.10:0/941647484 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378403c070 con 0x7f379815d220 2026-02-17T11:56:00.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:00.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 10 monclient: dump: 2026-02-17T11:56:00.518 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 1 -- 10.20.193.10:0/941647484 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378402fae0 con 0x7f379815d220 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 5 monclient: authenticate success, global_id 4464 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 1 -- 10.20.193.10:0/941647484 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784037440 con 0x7f379815d220 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f37967fc640 10 monclient: dump: 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.520 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 4 set_mon_vals no callback set 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 10 monclient: shutdown 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 1 -- 10.20.193.10:0/941647484 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f379815d220 msgr2=0x7f379815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 1 --2- 10.20.193.10:0/941647484 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f379815d220 0x7f379815d600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f37840098a0 tx=0x7f378402ee10 comp rx=0 tx=0).stop 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 1 -- 10.20.193.10:0/941647484 shutdown_connections 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 1 --2- 10.20.193.10:0/941647484 >> v2:10.20.193.153:3300/0 conn(0x7f3798074920 0x7f37980c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 1 --2- 10.20.193.10:0/941647484 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f379815d220 0x7f379815d600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 1 -- 10.20.193.10:0/941647484 >> 10.20.193.10:0/941647484 conn(0x7f37980c9d80 msgr2=0x7f37980ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.507+0000 7f379e20e640 1 -- 10.20.193.10:0/941647484 shutdown_connections 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 1 -- 10.20.193.10:0/941647484 wait complete. 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 10 monclient: monmap: 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:00.522 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 1 librados: starting msgr at 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 1 librados: starting objecter 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 1 Processor -- start 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 1 -- start start 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 1 librados: setting wanted keys 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 1 librados: calling monclient init 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.508+0000 7f379e20e640 10 monclient: init 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3798074920 0x7f37981f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient(hunting): picked mon.noname-a con 0x7f3798074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f37980c9120 0x7f379806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient(hunting): picked mon.noname-b con 0x7f37980c9120 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f379815d220 0x7f379806e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient(hunting): picked mon.noname-c con 0x7f379815d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f37980c86c0 con 0x7f3798074920 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37980c83e0 con 0x7f37980c9120 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3798074d70 con 0x7f379815d220 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f379e20e640 10 monclient(hunting): authenticate will time out at 1030.231081s 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3798074920 0x7f37981f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3796ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f37980c9120 0x7f379806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3797fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f379815d220 0x7f379806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3798074920 0x7f37981f6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38516/0 (socket says 10.20.193.10:38516) 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 1 -- 10.20.193.10:0/1592390268 learned_addr learned my addr 10.20.193.10:0/1592390268 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 10 monclient(hunting): get_auth_request con 0x7f3798074920 auth_method 0 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3796ffd640 10 monclient(hunting): get_auth_request con 0x7f37980c9120 auth_method 0 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3796ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3796ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3796ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3797fff640 10 monclient(hunting): get_auth_request con 0x7f379815d220 auth_method 0 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3797fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3797fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3797fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f37977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3796ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.509+0000 7f3796ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.510+0000 7f3796ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.510+0000 7f3797fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.510+0000 7f3797fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.510+0000 7f3797fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 10 monclient(hunting): handle_auth_done global_id 4467 payload 824 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 1 -- 10.20.193.10:0/1592390268 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f379815d220 msgr2=0x7f379806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f379815d220 0x7f379806e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 1 -- 10.20.193.10:0/1592390268 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f37980c9120 msgr2=0x7f379806e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f37980c9120 0x7f379806e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 1 monclient: found mon.noname-a 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.511+0000 7f37977fe640 1 -- 10.20.193.10:0/1592390268 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379815c6a0 con 0x7f3798074920 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.512+0000 7f37977fe640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3798074920 0x7f37981f6f00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f378403a040 tx=0x7f37840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.512+0000 7f3773fff640 10 client.?.objecter ms_handle_connect 0x7f3798074920 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.512+0000 7f3773fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f3773fff640 1 -- 10.20.193.10:0/1592390268 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784046020 con 0x7f3798074920 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f3773fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f3773fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f3773fff640 10 monclient: dump: 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.527 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f3773fff640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f3773fff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f3773fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f379e20e640 5 monclient: authenticate success, global_id 4467 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f379e20e640 10 monclient: _renew_subs 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f379e20e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379806d250 con 0x7f3798074920 2026-02-17T11:56:00.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f379e20e640 10 client.4467.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:00.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f379e20e640 10 monclient: _renew_subs 2026-02-17T11:56:00.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f379e20e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379806d810 con 0x7f3798074920 2026-02-17T11:56:00.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.513+0000 7f379e20e640 1 librados: init done 2026-02-17T11:56:00.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.514+0000 7f379e20e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.514+0000 7f379e20e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.514+0000 7f379e20e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.514+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37980c8be0 con 0x7f3798074920 2026-02-17T11:56:00.564 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T11:56:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.621+0000 7f3773fff640 1 -- 10.20.193.10:0/1592390268 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378402f9a0 con 0x7f3798074920 2026-02-17T11:56:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.621+0000 7f3773fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.621+0000 7f3773fff640 1 -- 10.20.193.10:0/1592390268 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378403c040 con 0x7f3798074920 2026-02-17T11:56:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.621+0000 7f3773fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.621+0000 7f3773fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.621+0000 7f3795ffb640 4 set_mon_vals no callback set 2026-02-17T11:56:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.621+0000 7f3773fff640 10 monclient: dump: 2026-02-17T11:56:00.624 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.622+0000 7f3773fff640 1 -- 10.20.193.10:0/1592390268 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f378404a3b0 con 0x7f3798074920 2026-02-17T11:56:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.622+0000 7f3773fff640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3768078e30 0x7f376807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.622+0000 7f3796ffd640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3768078e30 0x7f376807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.622+0000 7f3796ffd640 10 monclient: get_auth_request con 0x7f3768078e30 auth_method 0 2026-02-17T11:56:00.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.623+0000 7f3773fff640 10 client.4467.objecter ms_handle_connect 0x7f3768078e30 2026-02-17T11:56:00.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.623+0000 7f3796ffd640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3768078e30 0x7f376807b2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f379814dd80 tx=0x7f3788009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.628 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:56:00.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.630+0000 7f3773fff640 1 -- 10.20.193.10:0/1592390268 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f378404ad60 con 0x7f3798074920 2026-02-17T11:56:00.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.630+0000 7f3773fff640 10 client.4467.objecter ms_dispatch2 0x7f3798000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:00.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.630+0000 7f3773fff640 3 client.4467.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:00.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.630+0000 7f3773fff640 3 client.4467.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:00.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.630+0000 7f3773fff640 20 client.4467.objecter dump_active .. 0 homeless 2026-02-17T11:56:00.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.630+0000 7f3773fff640 1 -- 10.20.193.10:0/1592390268 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3784050020 con 0x7f3798074920 2026-02-17T11:56:00.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.631+0000 7f3773fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.631+0000 7f3773fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.631+0000 7ff60fdb4640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.631+0000 7ff60fdb4640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.631+0000 7ff60fdb4640 10 monclient: monmap: 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.633089+0000 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.633089+0000 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.637 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 1 Processor -- start 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 1 -- start start 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient: init 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient: _add_conns ranks=[2,5,4,0,3,1] 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff60815d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff6080c92f0 0x7ff60815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient(hunting): picked mon.noname-c con 0x7ff6080c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff608074920 0x7ff608153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient(hunting): picked mon.noname-b con 0x7ff608074920 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6080c58a0 con 0x7ff60815d220 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff6080c55c0 con 0x7ff608074920 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff6080c7e20 con 0x7ff6080c92f0 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.632+0000 7ff60fdb4640 10 monclient(hunting): authenticate will time out at 1030.354970s 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60d328640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff6080c92f0 0x7ff60815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff608074920 0x7ff608153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff608074920 0x7ff608153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47294/0 (socket says 10.20.193.10:47294) 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 1 -- 10.20.193.10:0/2250721431 learned_addr learned my addr 10.20.193.10:0/2250721431 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 10 monclient(hunting): get_auth_request con 0x7ff608074920 auth_method 0 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60d328640 10 monclient(hunting): get_auth_request con 0x7ff6080c92f0 auth_method 0 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60d328640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60d328640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60d328640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.633+0000 7ff60e32a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60d328640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60d328640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60d328640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60e32a640 10 monclient(hunting): handle_auth_done global_id 4540 payload 274 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60e32a640 1 -- 10.20.193.10:0/2250721431 >> v2:10.20.193.153:3300/0 conn(0x7ff6080c92f0 msgr2=0x7ff60815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60e32a640 1 --2- 10.20.193.10:0/2250721431 >> v2:10.20.193.153:3300/0 conn(0x7ff6080c92f0 0x7ff60815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60e32a640 1 -- 10.20.193.10:0/2250721431 >> v1:10.20.193.153:6789/0 conn(0x7ff60815d220 legacy=0x7ff6080c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60e32a640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60e32a640 1 monclient: found mon.noname-b 2026-02-17T11:56:00.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60e32a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60e32a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.634+0000 7ff60e32a640 1 -- 10.20.193.10:0/2250721431 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6080c8100 con 0x7ff608074920 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.636+0000 7ff60e32a640 1 --2- 10.20.193.10:0/2250721431 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 0x7ff608153650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff604009e50 tx=0x7ff60402f2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=602e60008889ac8c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 1 -- 10.20.193.10:0/2250721431 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60402fd60 con 0x7ff608074920 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 10 monclient: dump: 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.648 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 1 -- 10.20.193.10:0/2250721431 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6040373f0 con 0x7ff608074920 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 1 -- 10.20.193.10:0/2250721431 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6040377c0 con 0x7ff608074920 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60cb27640 10 monclient: dump: 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.649 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 5 monclient: authenticate success, global_id 4540 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 4 set_mon_vals no callback set 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 10 monclient: shutdown 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 1 -- 10.20.193.10:0/2250721431 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 msgr2=0x7ff608153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 1 --2- 10.20.193.10:0/2250721431 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 0x7ff608153650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff604009e50 tx=0x7ff60402f2a0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 1 -- 10.20.193.10:0/2250721431 shutdown_connections 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 1 --2- 10.20.193.10:0/2250721431 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 0x7ff608153650 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 1 --2- 10.20.193.10:0/2250721431 >> v2:10.20.193.153:3300/0 conn(0x7ff6080c92f0 0x7ff60815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 1 -- 10.20.193.10:0/2250721431 >> 10.20.193.10:0/2250721431 conn(0x7ff6080c9d80 msgr2=0x7ff6080ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 1 -- 10.20.193.10:0/2250721431 shutdown_connections 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.638+0000 7ff60fdb4640 1 -- 10.20.193.10:0/2250721431 wait complete. 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient: monmap: 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 librados: starting msgr at 2026-02-17T11:56:00.651 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 librados: starting objecter 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 Processor -- start 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 -- start start 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 librados: setting wanted keys 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 librados: calling monclient init 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient: init 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 0x7ff6080cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient(hunting): picked mon.noname-b con 0x7ff608074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff6080c92f0 0x7ff6080ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient(hunting): picked mon.noname-c con 0x7ff6080c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff60815d220 0x7ff6081f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient(hunting): picked mon.noname-a con 0x7ff60815d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff608074d70 con 0x7ff60815d220 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff6080c86c0 con 0x7ff608074920 2026-02-17T11:56:00.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff608153b90 con 0x7ff6080c92f0 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.639+0000 7ff60fdb4640 10 monclient(hunting): authenticate will time out at 1030.361904s 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 0x7ff6080cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 0x7ff6080cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47304/0 (socket says 10.20.193.10:47304) 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 1 -- 10.20.193.10:0/4266460921 learned_addr learned my addr 10.20.193.10:0/4266460921 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60e32a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff60815d220 0x7ff6081f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 10 monclient(hunting): get_auth_request con 0x7ff608074920 auth_method 0 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60d328640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff6080c92f0 0x7ff6080ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60db29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60e32a640 10 monclient(hunting): get_auth_request con 0x7ff60815d220 auth_method 0 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60e32a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60e32a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60e32a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60d328640 10 monclient(hunting): get_auth_request con 0x7ff6080c92f0 auth_method 0 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60d328640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60d328640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60d328640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60e32a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60e32a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60e32a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60d328640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60d328640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.640+0000 7ff60d328640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 10 monclient(hunting): handle_auth_done global_id 4543 payload 824 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 1 -- 10.20.193.10:0/4266460921 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff6080c92f0 msgr2=0x7ff6080ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff6080c92f0 0x7ff6080ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 1 -- 10.20.193.10:0/4266460921 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff60815d220 msgr2=0x7ff6081f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff60815d220 0x7ff6081f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 1 monclient: found mon.noname-b 2026-02-17T11:56:00.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.641+0000 7ff60db29640 1 -- 10.20.193.10:0/4266460921 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6081f7270 con 0x7ff608074920 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.642+0000 7ff60db29640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 0x7ff6080cc860 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800c700 tx=0x7ff5f800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.642+0000 7ff5f67fc640 10 client.?.objecter ms_handle_connect 0x7ff608074920 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.642+0000 7ff5f67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff5f67fc640 1 -- 10.20.193.10:0/4266460921 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80052d0 con 0x7ff608074920 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff5f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff5f67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff5f67fc640 10 monclient: dump: 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.655 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff5f67fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff5f67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff5f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff60fdb4640 5 monclient: authenticate success, global_id 4543 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff60fdb4640 10 monclient: _renew_subs 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff60fdb4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6081f7530 con 0x7ff608074920 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff60fdb4640 10 client.4543.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff60fdb4640 10 monclient: _renew_subs 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff60fdb4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6081f7af0 con 0x7ff608074920 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.643+0000 7ff60fdb4640 1 librados: init done 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff60fdb4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff60fdb4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff60fdb4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff608153f20 con 0x7ff608074920 2026-02-17T11:56:00.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff5f67fc640 1 -- 10.20.193.10:0/4266460921 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f8005470 con 0x7ff608074920 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff5f67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff5f67fc640 1 -- 10.20.193.10:0/4266460921 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800a840 con 0x7ff608074920 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff5f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff5f67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff5f67fc640 10 monclient: dump: 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.644+0000 7ff5f7fff640 4 set_mon_vals no callback set 2026-02-17T11:56:00.695 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:56:00.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.696+0000 7fb3cb734640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.696+0000 7fb3cb734640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.696+0000 7fb3cb734640 10 monclient: monmap: 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.697893+0000 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.697893+0000 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.699 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.700 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.700 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 1 Processor -- start 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 1 -- start start 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 10 monclient: init 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 10 monclient: _add_conns ranks=[2,3,0,1,4,5] 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb3c41502f0 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fb3c41506d0 0x7fb3c40c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 10 monclient(hunting): picked mon.noname-a con 0x7fb3c41506d0 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb3c40c8eb0 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:00.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c40c5380 con 0x7fb3c40c8eb0 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c40c5660 con 0x7fb3c41502f0 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c4074e80 con 0x7fb3c41506d0 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.697+0000 7fb3cb734640 10 monclient(hunting): authenticate will time out at 1030.419935s 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.698+0000 7fb3c8ca8640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fb3c41506d0 0x7fb3c40c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.698+0000 7fb3c94a9640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fb3c41502f0 0x7fb3c4074770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55350/0 (socket says 10.20.193.10:55350) 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.698+0000 7fb3c94a9640 1 -- 10.20.193.10:0/3526656373 learned_addr learned my addr 10.20.193.10:0/3526656373 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.698+0000 7fb3c8ca8640 10 monclient(hunting): get_auth_request con 0x7fb3c41506d0 auth_method 0 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.698+0000 7fb3c8ca8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.698+0000 7fb3c8ca8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.698+0000 7fb3c8ca8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.699+0000 7fb3c8ca8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.699+0000 7fb3c8ca8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.699+0000 7fb3c8ca8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.699+0000 7fb3b3fff640 1 -- 10.20.193.10:0/3526656373 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314642595 0 0) 0x7fb3c40c5660 con 0x7fb3c41502f0 2026-02-17T11:56:00.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.699+0000 7fb3b3fff640 10 monclient(hunting): _negotiate 2026-02-17T11:56:00.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.699+0000 7fb3b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.699+0000 7fb3b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.699+0000 7fb3b3fff640 10 monclient(hunting): my global_id is 4538 2026-02-17T11:56:00.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.699+0000 7fb3b3fff640 1 -- 10.20.193.10:0/3526656373 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3ac003620 con 0x7fb3c41502f0 2026-02-17T11:56:00.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.700+0000 7fb3c8ca8640 10 monclient(hunting): handle_auth_done global_id 4473 payload 274 2026-02-17T11:56:00.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.700+0000 7fb3c8ca8640 1 -- 10.20.193.10:0/3526656373 >> v1:10.20.193.153:6789/0 conn(0x7fb3c41502f0 legacy=0x7fb3c4074770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.700+0000 7fb3c8ca8640 1 -- 10.20.193.10:0/3526656373 >> v1:10.20.193.10:6789/0 conn(0x7fb3c40c8eb0 legacy=0x7fb3c415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.700+0000 7fb3c8ca8640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.700+0000 7fb3c8ca8640 1 monclient: found mon.noname-a 2026-02-17T11:56:00.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.700+0000 7fb3c8ca8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.700+0000 7fb3c8ca8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.700+0000 7fb3c8ca8640 1 -- 10.20.193.10:0/3526656373 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c40c7e90 con 0x7fb3c41506d0 2026-02-17T11:56:00.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.702+0000 7fb3c8ca8640 1 --2- 10.20.193.10:0/3526656373 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c41506d0 0x7fb3c40c8970 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80098a0 tx=0x7fb3b802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150d868301be421d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 1 -- 10.20.193.10:0/3526656373 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b803c070 con 0x7fb3c41506d0 2026-02-17T11:56:00.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 10 monclient: dump: 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 1 -- 10.20.193.10:0/3526656373 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b802fb70 con 0x7fb3c41506d0 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 1 -- 10.20.193.10:0/3526656373 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8037440 con 0x7fb3c41506d0 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 5 monclient: authenticate success, global_id 4473 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 4 set_mon_vals no callback set 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3b3fff640 10 monclient: dump: 2026-02-17T11:56:00.712 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 10 monclient: shutdown 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.713 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 1 -- 10.20.193.10:0/3526656373 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c41506d0 msgr2=0x7fb3c40c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 1 --2- 10.20.193.10:0/3526656373 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c41506d0 0x7fb3c40c8970 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80098a0 tx=0x7fb3b802ee60 comp rx=0 tx=0).stop 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 1 -- 10.20.193.10:0/3526656373 shutdown_connections 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 1 --2- 10.20.193.10:0/3526656373 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c41506d0 0x7fb3c40c8970 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 1 -- 10.20.193.10:0/3526656373 >> 10.20.193.10:0/3526656373 conn(0x7fb3c40c9d80 msgr2=0x7fb3c40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 1 -- 10.20.193.10:0/3526656373 shutdown_connections 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.705+0000 7fb3cb734640 1 -- 10.20.193.10:0/3526656373 wait complete. 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient: monmap: 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:00.714 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 librados: starting msgr at 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 librados: starting objecter 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 Processor -- start 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 -- start start 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 librados: setting wanted keys 2026-02-17T11:56:00.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 librados: calling monclient init 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient: init 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c40c8eb0 0x7fb3c4142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient(hunting): picked mon.noname-a con 0x7fb3c40c8eb0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3c41502f0 0x7fb3c4156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient(hunting): picked mon.noname-b con 0x7fb3c41502f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3c41506d0 0x7fb3c41f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient(hunting): picked mon.noname-c con 0x7fb3c41506d0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c40c92d0 con 0x7fb3c40c8eb0 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c40c8450 con 0x7fb3c41502f0 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c415d750 con 0x7fb3c41506d0 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.706+0000 7fb3cb734640 10 monclient(hunting): authenticate will time out at 1030.428721s 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c40c8eb0 0x7fb3c4142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c40c8eb0 0x7fb3c4142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38538/0 (socket says 10.20.193.10:38538) 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 1 -- 10.20.193.10:0/1460661981 learned_addr learned my addr 10.20.193.10:0/1460661981 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 10 monclient(hunting): get_auth_request con 0x7fb3c40c8eb0 auth_method 0 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c9caa640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3c41506d0 0x7fb3c41f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c9caa640 10 monclient(hunting): get_auth_request con 0x7fb3c41506d0 auth_method 0 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c9caa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c9caa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c9caa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c94a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c9caa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c9caa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.707+0000 7fb3c9caa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 10 monclient(hunting): handle_auth_done global_id 4541 payload 824 2026-02-17T11:56:00.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 1 -- 10.20.193.10:0/1460661981 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3c41502f0 msgr2=0x7fb3c4156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3c41502f0 0x7fb3c4156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 1 -- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c40c8eb0 msgr2=0x7fb3c4142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c40c8eb0 0x7fb3c4142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 1 monclient: found mon.noname-c 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c9caa640 1 -- 10.20.193.10:0/1460661981 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c41f3e60 con 0x7fb3c41506d0 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.709+0000 7fb3c94a9640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c40c8eb0 0x7fb3c4142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.710+0000 7fb3c9caa640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3c41506d0 0x7fb3c41f3420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000cbf0 tx=0x7fb3c000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.710+0000 7fb3b1ffb640 10 client.?.objecter ms_handle_connect 0x7fb3c41506d0 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.710+0000 7fb3b1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 1 -- 10.20.193.10:0/1460661981 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000ce10 con 0x7fb3c41506d0 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 10 monclient: dump: 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 1 -- 10.20.193.10:0/1460661981 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c0003a30 con 0x7fb3c41506d0 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 1 -- 10.20.193.10:0/1460661981 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0003e00 con 0x7fb3c41506d0 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 5 monclient: authenticate success, global_id 4541 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 10 monclient: _renew_subs 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b37fe640 4 set_mon_vals no callback set 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c41f4140 con 0x7fb3c41506d0 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3b1ffb640 10 monclient: dump: 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.723 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 10 client.4541.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 10 monclient: _renew_subs 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c4142740 con 0x7fb3c41506d0 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 1 librados: init done 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.712+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c40c8970 con 0x7fb3c41506d0 2026-02-17T11:56:00.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.717+0000 7f379e20e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:56:00.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.717+0000 7f379e20e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:56:00.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.717+0000 7f379e20e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.717+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f37980c9b60 con 0x7f3798074920 2026-02-17T11:56:00.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.719+0000 7f3773fff640 1 -- 10.20.193.10:0/1592390268 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3784086a20 con 0x7f3798074920 2026-02-17T11:56:00.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.719+0000 7f3773fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:56:00.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.719+0000 7f3773fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:00.726 INFO:teuthology.orchestra.run.trial010.stdout:115964117000 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 10 librados: watch_flush enter 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 10 librados: watch_flush exit 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 20 client.4467.objecter shutdown clearing up homeless session... 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 10 client.4467.objecter successfully canceled tick 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3768078e30 msgr2=0x7f376807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3768078e30 0x7f376807b2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f379814dd80 tx=0x7f3788009290 comp rx=0 tx=0).stop 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 10 monclient: shutdown 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3798074920 msgr2=0x7f37981f6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3798074920 0x7f37981f6f00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f378403a040 tx=0x7f37840047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 shutdown_connections 2026-02-17T11:56:00.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3768078e30 0x7f376807b2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f379815d220 0x7f379806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f37980c9120 0x7f379806e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 --2- 10.20.193.10:0/1592390268 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3798074920 0x7f37981f6f00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 >> 10.20.193.10:0/1592390268 conn(0x7f37980c9d80 msgr2=0x7f3798152b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 shutdown_connections 2026-02-17T11:56:00.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 -- 10.20.193.10:0/1592390268 wait complete. 2026-02-17T11:56:00.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.721+0000 7f379e20e640 1 librados: shutdown 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.724+0000 7fb3b1ffb640 1 -- 10.20.193.10:0/1460661981 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fb3c00050d0 con 0x7fb3c41506d0 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.724+0000 7fb3b1ffb640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb394078e80 0x7fb39407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.724+0000 7fb3c94a9640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb394078e80 0x7fb39407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.724+0000 7fb3c94a9640 10 monclient: get_auth_request con 0x7fb394078e80 auth_method 0 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.724+0000 7fb3b1ffb640 10 client.4541.objecter ms_handle_connect 0x7fb394078e80 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.724+0000 7fb3c94a9640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb394078e80 0x7fb39407b340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4005980 tx=0x7fb3b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.725+0000 7fb3b1ffb640 1 -- 10.20.193.10:0/1460661981 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fb3c005e6b0 con 0x7fb3c41506d0 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.725+0000 7fb3b1ffb640 10 client.4541.objecter ms_dispatch2 0x7fb3c4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.725+0000 7fb3b1ffb640 3 client.4541.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.725+0000 7fb3b1ffb640 3 client.4541.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:00.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.725+0000 7fb3b1ffb640 20 client.4541.objecter dump_active .. 0 homeless 2026-02-17T11:56:00.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117000 got 115964117000 for osd.4 2026-02-17T11:56:00.731 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:00.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.750+0000 7ff5f67fc640 1 -- 10.20.193.10:0/4266460921 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7ff5f800a9e0 con 0x7ff608074920 2026-02-17T11:56:00.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.750+0000 7ff5f67fc640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff5d8078e30 0x7ff5d807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.750+0000 7ff60d328640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff5d8078e30 0x7ff5d807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.750+0000 7ff60d328640 10 monclient: get_auth_request con 0x7ff5d8078e30 auth_method 0 2026-02-17T11:56:00.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.751+0000 7ff60d328640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff5d8078e30 0x7ff5d807b2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6080c5f40 tx=0x7ff5fc009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.751+0000 7ff5f67fc640 10 client.4543.objecter ms_handle_connect 0x7ff5d8078e30 2026-02-17T11:56:00.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.752+0000 7ff5f67fc640 1 -- 10.20.193.10:0/4266460921 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7ff5f800ad00 con 0x7ff608074920 2026-02-17T11:56:00.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.752+0000 7ff5f67fc640 10 client.4543.objecter ms_dispatch2 0x7ff608000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:00.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.752+0000 7ff5f67fc640 3 client.4543.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:00.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.752+0000 7ff5f67fc640 3 client.4543.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:00.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.752+0000 7ff5f67fc640 20 client.4543.objecter dump_active .. 0 homeless 2026-02-17T11:56:00.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.758+0000 7ff5f67fc640 1 -- 10.20.193.10:0/4266460921 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff5f8061fb0 con 0x7ff608074920 2026-02-17T11:56:00.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.759+0000 7ff5f67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.759+0000 7ff5f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.760+0000 7fcb311fb640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.760+0000 7fcb311fb640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.760+0000 7fcb311fb640 10 monclient: monmap: 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.761990+0000 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.761990+0000 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 1 Processor -- start 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 1 -- start start 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient: init 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient: _add_conns ranks=[2,3,5,4,0,1] 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcb2c155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fcb2c074cd0 0x7fcb2c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient(hunting): picked mon.noname-a con 0x7fcb2c074cd0 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcb2c156260 0x7fcb2c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient(hunting): picked mon.noname-c con 0x7fcb2c156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2c073520 con 0x7fcb2c155e80 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fcb2c0cd840 con 0x7fcb2c074cd0 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcb2c073800 con 0x7fcb2c156260 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.761+0000 7fcb311fb640 10 monclient(hunting): authenticate will time out at 1030.483699s 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fcb2c074cd0 0x7fcb2c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fcb2c074cd0 0x7fcb2c0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38550/0 (socket says 10.20.193.10:38550) 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 1 -- 10.20.193.10:0/2708171528 learned_addr learned my addr 10.20.193.10:0/2708171528 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 10 monclient(hunting): get_auth_request con 0x7fcb2c074cd0 auth_method 0 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.762+0000 7fcb2a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.763+0000 7fcb2a575640 10 monclient(hunting): handle_auth_done global_id 4482 payload 274 2026-02-17T11:56:00.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.763+0000 7fcb2a575640 1 -- 10.20.193.10:0/2708171528 >> v2:10.20.193.153:3300/0 conn(0x7fcb2c156260 msgr2=0x7fcb2c0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.763+0000 7fcb2a575640 1 --2- 10.20.193.10:0/2708171528 >> v2:10.20.193.153:3300/0 conn(0x7fcb2c156260 0x7fcb2c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.763+0000 7fcb2a575640 1 -- 10.20.193.10:0/2708171528 >> v1:10.20.193.153:6789/0 conn(0x7fcb2c155e80 legacy=0x7fcb2c0745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.763+0000 7fcb2a575640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.763+0000 7fcb2a575640 1 monclient: found mon.noname-a 2026-02-17T11:56:00.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.763+0000 7fcb2a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.763+0000 7fcb2a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.763+0000 7fcb2a575640 1 -- 10.20.193.10:0/2708171528 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c073ae0 con 0x7fcb2c074cd0 2026-02-17T11:56:00.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.764+0000 7fcb2a575640 1 --2- 10.20.193.10:0/2708171528 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c074cd0 0x7fcb2c0ccbc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c08f350 tx=0x7fcb1402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da52eb808a7e4514 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 1 -- 10.20.193.10:0/2708171528 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1403c070 con 0x7fcb2c074cd0 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 10 monclient: dump: 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.769 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 1 -- 10.20.193.10:0/2708171528 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1402fb40 con 0x7fcb2c074cd0 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 1 -- 10.20.193.10:0/2708171528 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14037440 con 0x7fcb2c074cd0 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb29d74640 10 monclient: dump: 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb311fb640 5 monclient: authenticate success, global_id 4482 2026-02-17T11:56:00.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb311fb640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.766+0000 7fcb311fb640 4 set_mon_vals no callback set 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 10 monclient: shutdown 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 -- 10.20.193.10:0/2708171528 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c074cd0 msgr2=0x7fcb2c0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 --2- 10.20.193.10:0/2708171528 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c074cd0 0x7fcb2c0ccbc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c08f350 tx=0x7fcb1402eed0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 -- 10.20.193.10:0/2708171528 shutdown_connections 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 --2- 10.20.193.10:0/2708171528 >> v2:10.20.193.153:3300/0 conn(0x7fcb2c156260 0x7fcb2c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 --2- 10.20.193.10:0/2708171528 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c074cd0 0x7fcb2c0ccbc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 -- 10.20.193.10:0/2708171528 >> 10.20.193.10:0/2708171528 conn(0x7fcb2c0ce2b0 msgr2=0x7fcb2c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 -- 10.20.193.10:0/2708171528 shutdown_connections 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 -- 10.20.193.10:0/2708171528 wait complete. 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 10 monclient: monmap: 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:00.771 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 librados: starting msgr at 2026-02-17T11:56:00.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 librados: starting objecter 2026-02-17T11:56:00.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 Processor -- start 2026-02-17T11:56:00.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 -- start start 2026-02-17T11:56:00.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 librados: setting wanted keys 2026-02-17T11:56:00.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 1 librados: calling monclient init 2026-02-17T11:56:00.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.767+0000 7fcb311fb640 10 monclient: init 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcb2c074cd0 0x7fcb2c156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient(hunting): picked mon.noname-b con 0x7fcb2c074cd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c155e80 0x7fcb2c1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient(hunting): picked mon.noname-a con 0x7fcb2c155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcb2c156260 0x7fcb2c1e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient(hunting): picked mon.noname-c con 0x7fcb2c156260 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0c4870 con 0x7fcb2c155e80 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0740a0 con 0x7fcb2c074cd0 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0c49f0 con 0x7fcb2c156260 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb311fb640 10 monclient(hunting): authenticate will time out at 1030.490382s 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb2a575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c155e80 0x7fcb2c1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb2ad76640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcb2c074cd0 0x7fcb2c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb2a575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c155e80 0x7fcb2c1511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38558/0 (socket says 10.20.193.10:38558) 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb2a575640 1 -- 10.20.193.10:0/897223460 learned_addr learned my addr 10.20.193.10:0/897223460 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb2a575640 10 monclient(hunting): get_auth_request con 0x7fcb2c155e80 auth_method 0 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb2a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb2a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.768+0000 7fcb2a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2ad76640 10 monclient(hunting): get_auth_request con 0x7fcb2c074cd0 auth_method 0 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.769+0000 7fcb2ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 10 monclient(hunting): handle_auth_done global_id 4546 payload 824 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 1 -- 10.20.193.10:0/897223460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcb2c156260 msgr2=0x7fcb2c1e9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcb2c156260 0x7fcb2c1e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 1 -- 10.20.193.10:0/897223460 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c155e80 msgr2=0x7fcb2c1511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c155e80 0x7fcb2c1511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 1 monclient: found mon.noname-b 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.770+0000 7fcb2ad76640 1 -- 10.20.193.10:0/897223460 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c1f8010 con 0x7fcb2c074cd0 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.771+0000 7fcb2ad76640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcb2c074cd0 0x7fcb2c156680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000b550 tx=0x7fcb2000ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.771+0000 7fcb0b7fe640 10 client.?.objecter ms_handle_connect 0x7fcb2c074cd0 2026-02-17T11:56:00.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.771+0000 7fcb0b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:00.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 1 -- 10.20.193.10:0/897223460 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20004500 con 0x7fcb2c074cd0 2026-02-17T11:56:00.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 10 monclient: dump: 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 1 -- 10.20.193.10:0/897223460 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb20015070 con 0x7fcb2c074cd0 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb311fb640 5 monclient: authenticate success, global_id 4546 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb311fb640 10 monclient: _renew_subs 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb311fb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c1f3cf0 con 0x7fcb2c074cd0 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 1 -- 10.20.193.10:0/897223460 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb200029c0 con 0x7fcb2c074cd0 2026-02-17T11:56:00.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb29573640 4 set_mon_vals no callback set 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb0b7fe640 10 monclient: dump: 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb311fb640 10 client.4546.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb311fb640 10 monclient: _renew_subs 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb311fb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c1f42b0 con 0x7fcb2c074cd0 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.773+0000 7fcb311fb640 1 librados: init done 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.774+0000 7fcb311fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.774+0000 7fcb311fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.774+0000 7fcb311fb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.774+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2c0745c0 con 0x7fcb2c074cd0 2026-02-17T11:56:00.779 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T11:56:00.779 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T11:56:00.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.784+0000 7fcb0b7fe640 1 -- 10.20.193.10:0/897223460 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fcb20002b60 con 0x7fcb2c074cd0 2026-02-17T11:56:00.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.785+0000 7fcb0b7fe640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcaf8078e30 0x7fcaf807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.785+0000 7fcb2a575640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcaf8078e30 0x7fcaf807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.785+0000 7fcb2a575640 10 monclient: get_auth_request con 0x7fcaf8078e30 auth_method 0 2026-02-17T11:56:00.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.785+0000 7fcb0b7fe640 10 client.4546.objecter ms_handle_connect 0x7fcaf8078e30 2026-02-17T11:56:00.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.785+0000 7fcb2a575640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcaf8078e30 0x7fcaf807b2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c145a50 tx=0x7fcb14033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.787+0000 7fcb0b7fe640 1 -- 10.20.193.10:0/897223460 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fcb20097aa0 con 0x7fcb2c074cd0 2026-02-17T11:56:00.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.787+0000 7fcb0b7fe640 10 client.4546.objecter ms_dispatch2 0x7fcb2c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:00.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.787+0000 7fcb0b7fe640 3 client.4546.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:00.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.787+0000 7fcb0b7fe640 3 client.4546.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:00.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.787+0000 7fcb0b7fe640 20 client.4546.objecter dump_active .. 0 homeless 2026-02-17T11:56:00.793 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:56:00.801 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T11:56:00.825 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T11:56:00.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.830+0000 7fb3b1ffb640 1 -- 10.20.193.10:0/1460661981 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb3c0062d70 con 0x7fb3c41506d0 2026-02-17T11:56:00.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.830+0000 7fb3b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.830+0000 7fb3b1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:00.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.842+0000 7ff60fdb4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:56:00.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.842+0000 7ff60fdb4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:56:00.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.842+0000 7ff60fdb4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.842+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7ff6080ca1f0 con 0x7ff608074920 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.847+0000 7fbaec149640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.847+0000 7fbaec149640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.847+0000 7fbaec149640 10 monclient: monmap: 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.848852+0000 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.848852+0000 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbcda8f1640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbcda8f1640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbcda8f1640 10 monclient: monmap: 2026-02-17T11:56:00.849 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.849455+0000 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.849455+0000 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 1 Processor -- start 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 1 -- start start 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 10 monclient: init 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbcda8f1640 1 Processor -- start 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbcda8f1640 1 -- start start 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbcda8f1640 10 monclient: init 2026-02-17T11:56:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 10 monclient: _add_conns ranks=[4,0,2,1,5,3] 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fbae4153eb0 0x7fbae4068e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 10 monclient(hunting): picked mon.noname-b con 0x7fbae4153eb0 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbae4068480 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbae415bc90 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae4159e90 con 0x7fbae4068480 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae415a170 con 0x7fbae415bc90 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbae415b0f0 con 0x7fbae4153eb0 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.848+0000 7fbaec149640 10 monclient(hunting): authenticate will time out at 1030.570972s 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 10 monclient: _add_conns ranks=[5,2,4,1,0,3] 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fbcd4156020 0x7fbcd40cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 10 monclient(hunting): picked mon.noname-c con 0x7fbcd4156020 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbcd40c98f0 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fbcd40c9d30 0x7fbcd40ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 10 monclient(hunting): picked mon.noname-b con 0x7fbcd40c9d30 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd40c8ba0 con 0x7fbcd40c98f0 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd40c9460 con 0x7fbcd40c9d30 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd415cbf0 con 0x7fbcd4156020 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbcda8f1640 10 monclient(hunting): authenticate will time out at 1030.571264s 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbae96bd640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fbae4068480 0x7fbae415b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:42196/0 (socket says 10.20.193.10:42196) 2026-02-17T11:56:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.849+0000 7fbae96bd640 1 -- 10.20.193.10:0/3185339326 learned_addr learned my addr 10.20.193.10:0/3185339326 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:00.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.850+0000 7fbcd3fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fbcd4156020 0x7fbcd40cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.850+0000 7fbcd37fe640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fbcd40c98f0 0x7fbcd40d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55372/0 (socket says 10.20.193.10:55372) 2026-02-17T11:56:00.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.850+0000 7fbcd37fe640 1 -- 10.20.193.10:0/4109316549 learned_addr learned my addr 10.20.193.10:0/4109316549 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:00.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.850+0000 7fbcd3fff640 10 monclient(hunting): get_auth_request con 0x7fbcd4156020 auth_method 0 2026-02-17T11:56:00.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.850+0000 7fbcd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.850+0000 7fbcd3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.850+0000 7fbcd3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.851+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388450858 0 0) 0x7fbae4159e90 con 0x7fbae4068480 2026-02-17T11:56:00.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.851+0000 7fbae8ebc640 10 monclient(hunting): _negotiate 2026-02-17T11:56:00.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.851+0000 7fbae8ebc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.851+0000 7fbae8ebc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.851+0000 7fbae8ebc640 10 monclient(hunting): my global_id is 4488 2026-02-17T11:56:00.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.851+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbacc003620 con 0x7fbae4068480 2026-02-17T11:56:00.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.851+0000 7fbcd3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.851+0000 7fbcd3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.851+0000 7fbcd3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbcd3fff640 10 monclient(hunting): handle_auth_done global_id 4544 payload 274 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbcd3fff640 1 -- 10.20.193.10:0/4109316549 >> v2:10.20.193.71:3300/0 conn(0x7fbcd40c9d30 msgr2=0x7fbcd40ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbcd3fff640 1 --2- 10.20.193.10:0/4109316549 >> v2:10.20.193.71:3300/0 conn(0x7fbcd40c9d30 0x7fbcd40ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbcd3fff640 1 -- 10.20.193.10:0/4109316549 >> v1:10.20.193.153:6789/0 conn(0x7fbcd40c98f0 legacy=0x7fbcd40d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbcd3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbcd3fff640 1 monclient: found mon.noname-c 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbcd3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbcd3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbcd3fff640 1 -- 10.20.193.10:0/4109316549 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd40d2290 con 0x7fbcd4156020 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3230115677 0 0) 0x7fbacc003620 con 0x7fbae4068480 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 >> v2:10.20.193.71:3300/0 conn(0x7fbae4153eb0 msgr2=0x7fbae4068e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 --2- 10.20.193.10:0/3185339326 >> v2:10.20.193.71:3300/0 conn(0x7fbae4153eb0 0x7fbae4068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 >> v1:10.20.193.153:6789/0 conn(0x7fbae415bc90 legacy=0x7fbae40c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae415a450 con 0x7fbae4068480 2026-02-17T11:56:00.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fbad8002f00 con 0x7fbae4068480 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient: dump: 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 >> v1:10.20.193.10:6789/0 conn(0x7fbae4068480 legacy=0x7fbae415b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbacc003bf0 0x7fbacc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient(hunting): picked mon.a con 0x7fbacc003bf0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc004900 0x7fbacc004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient(hunting): picked mon.c con 0x7fbacc004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbacc009ab0 0x7fbacc00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient(hunting): picked mon.b con 0x7fbacc009ab0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fbae415b0f0 con 0x7fbacc003bf0 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc00c4c0 con 0x7fbacc009ab0 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc00c6c0 con 0x7fbacc004900 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.853+0000 7fbae8ebc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:56:00.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.854+0000 7fbcd3fff640 1 --2- 10.20.193.10:0/4109316549 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd4156020 0x7fbcd40cb590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbcd408ebe0 tx=0x7fbcc002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0bd99e39c91af56 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.856+0000 7fbae9ebe640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbacc003bf0 0x7fbacc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.856+0000 7fbae9ebe640 10 monclient(hunting): get_auth_request con 0x7fbacc003bf0 auth_method 0 2026-02-17T11:56:00.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.856+0000 7fbae9ebe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.856+0000 7fbae9ebe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.856+0000 7fbae9ebe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:00.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.856+0000 7fbae9ebe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.856+0000 7fbae9ebe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.856+0000 7fbae9ebe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:00.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae96bd640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc004900 0x7fbacc004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 10 monclient(hunting): handle_auth_done global_id 4488 payload 293 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 1 -- 10.20.193.10:0/4109316549 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc003c070 con 0x7fbcd4156020 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 1 -- 10.20.193.10:0/3185339326 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc004900 msgr2=0x7fbacc004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc004900 0x7fbacc004d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 10 monclient: dump: 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 1 -- 10.20.193.10:0/3185339326 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbacc009ab0 msgr2=0x7fbacc00bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbacc009ab0 0x7fbacc00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 1 monclient: found mon.a 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 1 -- 10.20.193.10:0/4109316549 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc002fb80 con 0x7fbcd4156020 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 5 monclient: authenticate success, global_id 4544 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 1 -- 10.20.193.10:0/3185339326 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc003620 con 0x7fbacc003bf0 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbae9ebe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbaea6bf640 1 -- 10.20.193.10:0/3185339326 reap_dead start 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbaec149640 5 monclient: authenticate success, global_id 4488 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 1 -- 10.20.193.10:0/4109316549 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0037440 con 0x7fbcd4156020 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 4 set_mon_vals no callback set 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcd2ffd640 10 monclient: dump: 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbaec149640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 10 monclient: shutdown 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 1 -- 10.20.193.10:0/4109316549 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd4156020 msgr2=0x7fbcd40cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 1 --2- 10.20.193.10:0/4109316549 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd4156020 0x7fbcd40cb590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbcd408ebe0 tx=0x7fbcc002eeb0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 1 -- 10.20.193.10:0/4109316549 shutdown_connections 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 1 --2- 10.20.193.10:0/4109316549 >> v2:10.20.193.71:3300/0 conn(0x7fbcd40c9d30 0x7fbcd40ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 1 --2- 10.20.193.10:0/4109316549 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd4156020 0x7fbcd40cb590 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.857+0000 7fbcda8f1640 1 -- 10.20.193.10:0/4109316549 >> 10.20.193.10:0/4109316549 conn(0x7fbcd406d970 msgr2=0x7fbcd406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 1 -- 10.20.193.10:0/4109316549 shutdown_connections 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 1 -- 10.20.193.10:0/4109316549 wait complete. 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbae9ebe640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbacc003bf0 0x7fbacc004010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009980 tx=0x7fbad402ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607500b1412e7159 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 10 monclient: monmap: 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 1 librados: starting msgr at 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 1 librados: starting objecter 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 1 Processor -- start 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 1 -- start start 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 1 librados: setting wanted keys 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 1 librados: calling monclient init 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.858+0000 7fbcda8f1640 10 monclient: init 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbcd40c98f0 0x7fbcd415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient(hunting): picked mon.noname-b con 0x7fbcd40c98f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd40c9d30 0x7fbcd41f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient(hunting): picked mon.noname-c con 0x7fbcd40c9d30 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbcd4156020 0x7fbcd41f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient(hunting): picked mon.noname-a con 0x7fbcd4156020 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40c90f0 con 0x7fbcd4156020 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40c8e10 con 0x7fbcd40c98f0 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40cc120 con 0x7fbcd40c9d30 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcda8f1640 10 monclient(hunting): authenticate will time out at 1030.581345s 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd40c9d30 0x7fbcd41f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd40c9d30 0x7fbcd41f5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:35988/0 (socket says 10.20.193.10:35988) 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 1 -- 10.20.193.10:0/1973197949 learned_addr learned my addr 10.20.193.10:0/1973197949 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 10 monclient(hunting): get_auth_request con 0x7fbcd40c9d30 auth_method 0 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad403c070 con 0x7fbacc003bf0 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbae8ebc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbae8ebc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbae8ebc640 10 monclient: dump: 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbaec149640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.859+0000 7fbcd37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7f9fe86a0640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7f9fe86a0640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7f9fe86a0640 10 monclient: monmap: 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.861361+0000 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.861361+0000 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.863 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad402f7b0 con 0x7fbacc003bf0 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbae8ebc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbae8ebc640 1 -- 10.20.193.10:0/3185339326 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4009550 con 0x7fbacc003bf0 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 4 set_mon_vals no callback set 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbae8ebc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbae8ebc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbae8ebc640 10 monclient: dump: 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.864 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.864 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-17T11:56:00.864 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T11:56:00.865 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7f9fe86a0640 1 Processor -- start 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7f9fe86a0640 1 -- start start 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7f9fe86a0640 10 monclient: init 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbcd8e67640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbcd4156020 0x7fbcd41f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbcd8e67640 10 monclient(hunting): get_auth_request con 0x7fbcd4156020 auth_method 0 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbcd8e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbcd8e67640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbcd8e67640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 10 monclient: shutdown 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 1 -- 10.20.193.10:0/3185339326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbacc003bf0 msgr2=0x7fbacc004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbacc003bf0 0x7fbacc004010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009980 tx=0x7fbad402ed50 comp rx=0 tx=0).stop 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 1 -- 10.20.193.10:0/3185339326 shutdown_connections 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 1 --2- 10.20.193.10:0/3185339326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbacc003bf0 0x7fbacc004010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 1 -- 10.20.193.10:0/3185339326 >> 10.20.193.10:0/3185339326 conn(0x7fbae4074090 msgr2=0x7fbae40744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 1 -- 10.20.193.10:0/3185339326 shutdown_connections 2026-02-17T11:56:00.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.860+0000 7fbaec149640 1 -- 10.20.193.10:0/3185339326 wait complete. 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 10 monclient: _add_conns ranks=[0,1,5,4,3,2] 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9fe0155e80 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9fe0074cd0 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd8e67640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd8e67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f9fe0156260 0x7f9fe0166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 10 monclient(hunting): picked mon.noname-c con 0x7f9fe0156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe0073520 con 0x7f9fe0155e80 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe0073800 con 0x7f9fe0074cd0 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe00cd840 con 0x7f9fe0156260 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd8e67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7f9fe86a0640 10 monclient(hunting): authenticate will time out at 1030.583105s 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 10 monclient(hunting): handle_auth_done global_id 4547 payload 824 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 1 -- 10.20.193.10:0/1973197949 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbcd40c98f0 msgr2=0x7fbcd415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbcd40c98f0 0x7fbcd415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 1 -- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbcd4156020 msgr2=0x7fbcd41f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbcd4156020 0x7fbcd41f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 1 monclient: found mon.noname-c 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbcd37fe640 1 -- 10.20.193.10:0/1973197949 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd40c7820 con 0x7fbcd40c9d30 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbaec149640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbaec149640 10 monclient: monmap: 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbaec149640 1 librados: starting msgr at 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbaec149640 1 librados: starting objecter 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbaec149640 1 Processor -- start 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbaec149640 1 -- start start 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbaec149640 1 librados: setting wanted keys 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbaec149640 1 librados: calling monclient init 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.861+0000 7fbaec149640 10 monclient: init 2026-02-17T11:56:00.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbcd37fe640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd40c9d30 0x7fbcd41f5900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400c4d0 tx=0x7fbcc400c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbcd0ff9640 10 client.?.objecter ms_handle_connect 0x7fbcd40c9d30 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbcd0ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc003bf0 0x7fbae41f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient(hunting): picked mon.noname-c con 0x7fbacc003bf0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbae4151b10 0x7fbae40c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient(hunting): picked mon.noname-b con 0x7fbae4151b10 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbae4151f90 0x7fbae40c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient(hunting): picked mon.noname-a con 0x7fbae4151f90 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fbae4074d20 con 0x7fbae4151f90 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbae415aa10 con 0x7fbae4151b10 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbae4074ea0 con 0x7fbacc003bf0 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.862+0000 7fbaec149640 10 monclient(hunting): authenticate will time out at 1030.584552s 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.863+0000 7f9fe6415640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f9fe0155e80 0x7f9fe00745c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:42200/0 (socket says 10.20.193.10:42200) 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.863+0000 7f9fe6415640 1 -- 10.20.193.10:0/1505156451 learned_addr learned my addr 10.20.193.10:0/1505156451 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.863+0000 7f9fe6c16640 1 --2- 10.20.193.10:0/1505156451 >> v2:10.20.193.153:3300/0 conn(0x7f9fe0156260 0x7f9fe0166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7f9fe6c16640 10 monclient(hunting): get_auth_request con 0x7f9fe0156260 auth_method 0 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7f9fe6c16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7f9fe6c16640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7f9fe6c16640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbae9ebe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc003bf0 0x7fbae41f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7f9fe6c16640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7f9fe6c16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7f9fe6c16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 1 -- 10.20.193.10:0/1973197949 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4017070 con 0x7fbcd40c9d30 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 10 monclient: dump: 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.869 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 1 -- 10.20.193.10:0/1973197949 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc4005de0 con 0x7fbcd40c9d30 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcda8f1640 5 monclient: authenticate success, global_id 4547 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcda8f1640 10 monclient: _renew_subs 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcda8f1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd40c7b00 con 0x7fbcd40c9d30 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 1 -- 10.20.193.10:0/1973197949 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4007290 con 0x7fbcd40c9d30 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd0ff9640 10 monclient: dump: 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcd27fc640 4 set_mon_vals no callback set 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcda8f1640 10 client.4547.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcda8f1640 10 monclient: _renew_subs 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcda8f1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd40c80c0 con 0x7fbcd40c9d30 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.864+0000 7fbcda8f1640 1 librados: init done 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbae9ebe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc003bf0 0x7fbae41f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36008/0 (socket says 10.20.193.10:36008) 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbae9ebe640 1 -- 10.20.193.10:0/2982124969 learned_addr learned my addr 10.20.193.10:0/2982124969 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbae9ebe640 10 monclient(hunting): get_auth_request con 0x7fbacc003bf0 auth_method 0 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbae9ebe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbae9ebe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbae9ebe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbcda8f1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbcda8f1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbcda8f1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd40cb590 con 0x7fbcd40c9d30 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7f9fe6c16640 10 monclient(hunting): handle_auth_done global_id 4550 payload 274 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7f9fe6c16640 1 -- 10.20.193.10:0/1505156451 >> v1:10.20.193.71:6789/0 conn(0x7f9fe0074cd0 legacy=0x7f9fe00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7f9fe6c16640 1 -- 10.20.193.10:0/1505156451 >> v1:10.20.193.10:6789/0 conn(0x7f9fe0155e80 legacy=0x7f9fe00745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7f9fe6c16640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7f9fe6c16640 1 monclient: found mon.noname-c 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7f9fe6c16640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7f9fe6c16640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.865+0000 7f9fe6c16640 1 -- 10.20.193.10:0/1505156451 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe0073ae0 con 0x7f9fe0156260 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.866+0000 7fbaea6bf640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbae4151f90 0x7fbae40c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.866+0000 7fbae9ebe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.866+0000 7fbae9ebe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.866+0000 7fbae9ebe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.866+0000 7fbaea6bf640 10 monclient(hunting): get_auth_request con 0x7fbae4151f90 auth_method 0 2026-02-17T11:56:00.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.866+0000 7fbaea6bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.866+0000 7fbaea6bf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.866+0000 7fbaea6bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.867+0000 7fbaea6bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.867+0000 7fbaea6bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.867+0000 7fbaea6bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 10 monclient(hunting): handle_auth_done global_id 4497 payload 824 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 1 -- 10.20.193.10:0/2982124969 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc003bf0 msgr2=0x7fbae41f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc003bf0 0x7fbae41f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 1 -- 10.20.193.10:0/2982124969 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbae4151b10 msgr2=0x7fbae40c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbae4151b10 0x7fbae40c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 1 monclient: found mon.noname-a 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.868+0000 7fbaea6bf640 1 -- 10.20.193.10:0/2982124969 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae41e8010 con 0x7fbae4151f90 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.869+0000 7fbaea6bf640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbae4151f90 0x7fbae40c3530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbae415c070 tx=0x7fbae000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.869+0000 7fbad27fc640 10 client.?.objecter ms_handle_connect 0x7fbae4151f90 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.869+0000 7fbad27fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 1 -- 10.20.193.10:0/2982124969 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0017070 con 0x7fbae4151f90 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 10 monclient: dump: 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 1 -- 10.20.193.10:0/2982124969 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae000abb0 con 0x7fbae4151f90 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 1 -- 10.20.193.10:0/2982124969 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae00070d0 con 0x7fbae4151f90 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad27fc640 10 monclient: dump: 2026-02-17T11:56:00.873 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbad3fff640 4 set_mon_vals no callback set 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 5 monclient: authenticate success, global_id 4497 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 10 monclient: _renew_subs 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae40c2230 con 0x7fbae4151f90 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 10 client.4497.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 10 monclient: _renew_subs 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae40c27f0 con 0x7fbae4151f90 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 1 librados: init done 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.871+0000 7fbaec149640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.872+0000 7fbaec149640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.872+0000 7fbaec149640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:00.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.872+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae4154290 con 0x7fbae4151f90 2026-02-17T11:56:00.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.889+0000 7fcb0b7fe640 1 -- 10.20.193.10:0/897223460 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcb200628c0 con 0x7fcb2c074cd0 2026-02-17T11:56:00.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.890+0000 7fcb0b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.890+0000 7fcb0b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:00.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.897+0000 7ff5f67fc640 1 -- 10.20.193.10:0/4266460921 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff5f80662b0 con 0x7ff608074920 2026-02-17T11:56:00.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.897+0000 7ff5f67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:56:00.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.897+0000 7ff5f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:00.899 INFO:teuthology.orchestra.run.trial010.stdout:103079215110 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.898+0000 7f120f891640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.898+0000 7f120f891640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.898+0000 7f120f891640 10 monclient: monmap: 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.899751+0000 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.899751+0000 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.898+0000 7f2f2d185640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.898+0000 7f2f2d185640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.898+0000 7f2f2d185640 10 monclient: monmap: 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.899846+0000 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.899846+0000 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.900 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 1 Processor -- start 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 1 Processor -- start 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 1 -- start start 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 10 monclient: init 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 1 -- start start 2026-02-17T11:56:00.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient: init 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 10 librados: watch_flush enter 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 10 librados: watch_flush exit 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 20 client.4543.objecter shutdown clearing up homeless session... 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 10 client.4543.objecter successfully canceled tick 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff5d8078e30 msgr2=0x7ff5d807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff5d8078e30 0x7ff5d807b2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6080c5f40 tx=0x7ff5fc009290 comp rx=0 tx=0).stop 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 10 monclient: shutdown 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 msgr2=0x7ff6080cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 0x7ff6080cc860 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800c700 tx=0x7ff5f800cbd0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 shutdown_connections 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff5d8078e30 0x7ff5d807b2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff60815d220 0x7ff6081f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff6080c92f0 0x7ff6080ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 --2- 10.20.193.10:0/4266460921 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff608074920 0x7ff6080cc860 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 >> 10.20.193.10:0/4266460921 conn(0x7ff6080c9d80 msgr2=0x7ff608149380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 shutdown_connections 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 -- 10.20.193.10:0/4266460921 wait complete. 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7ff60fdb4640 1 librados: shutdown 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 10 monclient: _add_conns ranks=[0,2,4,1,3,5] 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient: _add_conns ranks=[2,5,4,3,0,1] 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1208155e80 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1208074cd0 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2f28155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1208156260 0x7f1208166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 10 monclient(hunting): picked mon.noname-b con 0x7f1208156260 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f2f28074cd0 0x7f2f280ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient(hunting): picked mon.noname-c con 0x7f2f28074cd0 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1208073520 con 0x7f1208155e80 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1208073800 con 0x7f1208074cd0 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f12080cd840 con 0x7f1208156260 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f2f28156260 0x7f2f280cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient(hunting): picked mon.noname-b con 0x7f2f28156260 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:00.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f120f891640 10 monclient(hunting): authenticate will time out at 1030.621717s 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f28073520 con 0x7f2f28155e80 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2f280cd840 con 0x7f2f28156260 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2f28073800 con 0x7f2f28074cd0 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.899+0000 7f2f2d185640 10 monclient(hunting): authenticate will time out at 1030.621741s 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1208156260 0x7f1208166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1208156260 0x7f1208166710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47356/0 (socket says 10.20.193.10:47356) 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 1 -- 10.20.193.10:0/401087301 learned_addr learned my addr 10.20.193.10:0/401087301 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 10 monclient(hunting): get_auth_request con 0x7f1208156260 auth_method 0 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.900+0000 7f120de07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f120de07640 10 monclient(hunting): handle_auth_done global_id 4549 payload 274 2026-02-17T11:56:00.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f120de07640 1 -- 10.20.193.10:0/401087301 >> v1:10.20.193.153:6789/0 conn(0x7f1208074cd0 legacy=0x7f12080ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f120de07640 1 -- 10.20.193.10:0/401087301 >> v1:10.20.193.10:6789/0 conn(0x7f1208155e80 legacy=0x7f12080745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f120de07640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f120de07640 1 monclient: found mon.noname-b 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f120de07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f120de07640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f120de07640 1 -- 10.20.193.10:0/401087301 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1208073ae0 con 0x7f1208156260 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f2f27577640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f2f28156260 0x7f2f280cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f2f27577640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f2f28156260 0x7f2f280cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47368/0 (socket says 10.20.193.10:47368) 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f2f27577640 1 -- 10.20.193.10:0/1031776602 learned_addr learned my addr 10.20.193.10:0/1031776602 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f2f27577640 10 monclient(hunting): get_auth_request con 0x7f2f28156260 auth_method 0 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f2f27577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f2f27577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.901+0000 7f2f27577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 10 monclient(hunting): handle_auth_done global_id 4552 payload 274 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 1 -- 10.20.193.10:0/1031776602 >> v2:10.20.193.153:3300/0 conn(0x7f2f28074cd0 msgr2=0x7f2f280ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 1 --2- 10.20.193.10:0/1031776602 >> v2:10.20.193.153:3300/0 conn(0x7f2f28074cd0 0x7f2f280ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 1 -- 10.20.193.10:0/1031776602 >> v1:10.20.193.153:6789/0 conn(0x7f2f28155e80 legacy=0x7f2f280745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 1 monclient: found mon.noname-b 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.902+0000 7f2f27577640 1 -- 10.20.193.10:0/1031776602 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f28073ae0 con 0x7f2f28156260 2026-02-17T11:56:00.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.904+0000 7f120de07640 1 --2- 10.20.193.10:0/401087301 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 0x7f1208166710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1204009e50 tx=0x7f120402f2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1256fb2bcfd5395 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.904+0000 7f2f27577640 1 --2- 10.20.193.10:0/1031776602 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 0x7f2f280cd100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2f2808f5e0 tx=0x7f2f1802f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a2bfc5f32dd459c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 1 -- 10.20.193.10:0/401087301 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120402fd00 con 0x7f1208156260 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 10 monclient: dump: 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 1 -- 10.20.193.10:0/401087301 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12040373f0 con 0x7f1208156260 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f120f891640 5 monclient: authenticate success, global_id 4549 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f120f891640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f120f891640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 1 -- 10.20.193.10:0/401087301 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12040377c0 con 0x7f1208156260 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f120f891640 4 set_mon_vals no callback set 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f11f7fff640 10 monclient: dump: 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.908 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f120f891640 10 monclient: shutdown 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f120f891640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f120f891640 1 -- 10.20.193.10:0/401087301 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 msgr2=0x7f1208166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7fbad27fc640 1 -- 10.20.193.10:0/2982124969 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fbae0007270 con 0x7fbae4151f90 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.906+0000 7f120f891640 1 --2- 10.20.193.10:0/401087301 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 0x7f1208166710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1204009e50 tx=0x7f120402f2a0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f120f891640 1 -- 10.20.193.10:0/401087301 shutdown_connections 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f120f891640 1 --2- 10.20.193.10:0/401087301 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 0x7f1208166710 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f120f891640 1 -- 10.20.193.10:0/401087301 >> 10.20.193.10:0/401087301 conn(0x7f12080ce2b0 msgr2=0x7f12080ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f120f891640 1 -- 10.20.193.10:0/401087301 shutdown_connections 2026-02-17T11:56:00.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f120f891640 1 -- 10.20.193.10:0/401087301 wait complete. 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7fbad27fc640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbab4078e30 0x7fbab407b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7fbae9ebe640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbab4078e30 0x7fbab407b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7fbae9ebe640 10 monclient: get_auth_request con 0x7fbab4078e30 auth_method 0 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7fbad27fc640 10 client.4497.objecter ms_handle_connect 0x7fbab4078e30 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7fbae9ebe640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbab4078e30 0x7fbab407b2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbae415d120 tx=0x7fbad4033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f120f891640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f120f891640 10 monclient: monmap: 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 1 -- 10.20.193.10:0/1031776602 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1802fcd0 con 0x7f2f28156260 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 10 monclient: dump: 2026-02-17T11:56:00.910 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 1 -- 10.20.193.10:0/1031776602 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f180373f0 con 0x7f2f28156260 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 1 -- 10.20.193.10:0/1031776602 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f180377c0 con 0x7f2f28156260 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f2d185640 5 monclient: authenticate success, global_id 4552 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f2d185640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f2d185640 4 set_mon_vals no callback set 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.907+0000 7f2f25d74640 10 monclient: dump: 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 librados: starting msgr at 2026-02-17T11:56:00.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 librados: starting objecter 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 Processor -- start 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 -- start start 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 librados: setting wanted keys 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 librados: calling monclient init 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient: init 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 10 monclient: shutdown 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 1 -- 10.20.193.10:0/1031776602 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 msgr2=0x7f2f280cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 1 --2- 10.20.193.10:0/1031776602 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 0x7f2f280cd100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2f2808f5e0 tx=0x7f2f1802f270 comp rx=0 tx=0).stop 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 1 -- 10.20.193.10:0/1031776602 shutdown_connections 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 1 --2- 10.20.193.10:0/1031776602 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 0x7f2f280cd100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 1 --2- 10.20.193.10:0/1031776602 >> v2:10.20.193.153:3300/0 conn(0x7f2f28074cd0 0x7f2f280ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 1 -- 10.20.193.10:0/1031776602 >> 10.20.193.10:0/1031776602 conn(0x7f2f280ce2b0 msgr2=0x7f2f280ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 1 -- 10.20.193.10:0/1031776602 shutdown_connections 2026-02-17T11:56:00.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 1 -- 10.20.193.10:0/1031776602 wait complete. 2026-02-17T11:56:00.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215110 got 103079215110 for osd.11 2026-02-17T11:56:00.913 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1208074cd0 0x7f12081540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient(hunting): picked mon.noname-a con 0x7f1208074cd0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1208155e80 0x7f12080ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient(hunting): picked mon.noname-c con 0x7f1208155e80 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 0x7f12080ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient(hunting): picked mon.noname-b con 0x7f1208156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f12080c4870 con 0x7f1208074cd0 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12080740a0 con 0x7f1208156260 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12080c49f0 con 0x7f1208155e80 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f120f891640 10 monclient(hunting): authenticate will time out at 1030.630661s 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.908+0000 7f2f2d185640 10 monclient: monmap: 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 librados: starting msgr at 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 librados: starting objecter 2026-02-17T11:56:00.914 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T11:56:00.914 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:56:00.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 0x7f12080ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 Processor -- start 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 -- start start 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 librados: setting wanted keys 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 librados: calling monclient init 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient: init 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 0x7f12080ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47384/0 (socket says 10.20.193.10:47384) 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 1 -- 10.20.193.10:0/2119997595 learned_addr learned my addr 10.20.193.10:0/2119997595 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 10 monclient(hunting): get_auth_request con 0x7f1208156260 auth_method 0 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2f28074cd0 0x7f2f28147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient(hunting): picked mon.noname-a con 0x7f2f28074cd0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2f28155e80 0x7f2f281f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient(hunting): picked mon.noname-c con 0x7f2f28155e80 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 0x7f2f281f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f120de07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient(hunting): picked mon.noname-b con 0x7f2f28156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f2f280c4870 con 0x7f2f28074cd0 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2f280740a0 con 0x7f2f28156260 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f280c49f0 con 0x7f2f28155e80 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.909+0000 7f2f2d185640 10 monclient(hunting): authenticate will time out at 1030.631676s 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 10 monclient(hunting): handle_auth_done global_id 4555 payload 824 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 1 -- 10.20.193.10:0/2119997595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1208155e80 msgr2=0x7f12080ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1208155e80 0x7f12080ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 1 -- 10.20.193.10:0/2119997595 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1208074cd0 msgr2=0x7f12081540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1208074cd0 0x7f12081540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 1 monclient: found mon.noname-b 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.910+0000 7f120de07640 1 -- 10.20.193.10:0/2119997595 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12081548e0 con 0x7f1208156260 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.911+0000 7fbad27fc640 1 -- 10.20.193.10:0/2982124969 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fbae005dbc0 con 0x7fbae4151f90 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.911+0000 7fbad27fc640 10 client.4497.objecter ms_dispatch2 0x7fbae4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.911+0000 7fbad27fc640 3 client.4497.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.911+0000 7fbad27fc640 3 client.4497.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.911+0000 7fbad27fc640 20 client.4497.objecter dump_active .. 0 homeless 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.912+0000 7f120de07640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 0x7f12080ca880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1204009e50 tx=0x7f1204004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.912+0000 7f11f5ffb640 10 client.?.objecter ms_handle_connect 0x7f1208156260 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.912+0000 7f11f5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f11f5ffb640 1 -- 10.20.193.10:0/2119997595 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204046020 con 0x7f1208156260 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f11f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f11f5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f11f5ffb640 10 monclient: dump: 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f11f5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f11f5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f11f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 5 monclient: authenticate success, global_id 4555 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 10 monclient: _renew_subs 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12080c9580 con 0x7f1208156260 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 10 client.4555.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 10 monclient: _renew_subs 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12080c9b40 con 0x7f1208156260 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 1 librados: init done 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.913+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12080745c0 con 0x7f1208156260 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f11f5ffb640 1 -- 10.20.193.10:0/2119997595 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12040373f0 con 0x7f1208156260 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f11f5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f11f5ffb640 1 -- 10.20.193.10:0/2119997595 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204041450 con 0x7f1208156260 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f11f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f11f5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f11f77fe640 4 set_mon_vals no callback set 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f11f5ffb640 10 monclient: dump: 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.918 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f2f27577640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 0x7f2f281f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f2f27577640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 0x7f2f281f6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47398/0 (socket says 10.20.193.10:47398) 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f2f27577640 1 -- 10.20.193.10:0/2596376579 learned_addr learned my addr 10.20.193.10:0/2596376579 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f2f27577640 10 monclient(hunting): get_auth_request con 0x7f2f28156260 auth_method 0 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f2f27577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f2f27577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f2f27577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.914+0000 7f2f27577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.915+0000 7f2f27577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.915+0000 7f2f27577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 10 monclient(hunting): handle_auth_done global_id 4558 payload 824 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 1 -- 10.20.193.10:0/2596376579 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2f28155e80 msgr2=0x7f2f281f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2f28155e80 0x7f2f281f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 1 -- 10.20.193.10:0/2596376579 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2f28074cd0 msgr2=0x7f2f28147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2f28074cd0 0x7f2f28147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 10 monclient: _finish_hunting 0 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 1 monclient: found mon.noname-b 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.916+0000 7f2f27577640 1 -- 10.20.193.10:0/2596376579 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f281f4e70 con 0x7f2f28156260 2026-02-17T11:56:00.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.920+0000 7fb3cb734640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:56:00.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.920+0000 7fb3cb734640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:56:00.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.920+0000 7fb3cb734640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:00.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.920+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb3c414f0e0 con 0x7fb3c41506d0 2026-02-17T11:56:00.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fdc79f11640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fdc79f11640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fdc79f11640 10 monclient: monmap: 2026-02-17T11:56:00.938 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.938 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.938 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.938299+0000 2026-02-17T11:56:00.938 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.938299+0000 2026-02-17T11:56:00.938 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.938 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7f5dc52e8640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7f5dc52e8640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7f5dc52e8640 10 monclient: monmap: 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.938311+0000 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.938311+0000 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fc1ac6b7640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fc1ac6b7640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fc1ac6b7640 10 monclient: monmap: 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.939 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.938509+0000 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.938509+0000 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fdc79f11640 1 Processor -- start 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7f5dc52e8640 1 Processor -- start 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fdc79f11640 1 -- start start 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fdc79f11640 10 monclient: init 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7f5dc52e8640 1 -- start start 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7f5dc52e8640 10 monclient: init 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fc1ac6b7640 1 Processor -- start 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fc1ac6b7640 1 -- start start 2026-02-17T11:56:00.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.937+0000 7fc1ac6b7640 10 monclient: init 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 10 monclient: _add_conns ranks=[0,1,3,2,4,5] 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdc74156020 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fdc740c98f0 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fdc740c9d30 0x7fdc740ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 10 monclient(hunting): picked mon.noname-a con 0x7fdc740c9d30 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc740c8ba0 con 0x7fdc74156020 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc7415cbf0 con 0x7fdc740c98f0 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fdc740c9460 con 0x7fdc740c9d30 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 10 monclient: _add_conns ranks=[1,2,5,0,4,3] 2026-02-17T11:56:00.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fdc79f11640 10 monclient(hunting): authenticate will time out at 1030.660188s 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5dc0155e80 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5dc0074cd0 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5dc0156260 0x7f5dc0166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 10 monclient(hunting): picked mon.noname-c con 0x7f5dc0156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc0073520 con 0x7f5dc0155e80 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc0073800 con 0x7f5dc0074cd0 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc00cd840 con 0x7f5dc0156260 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7f5dc52e8640 10 monclient(hunting): authenticate will time out at 1030.660258s 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 10 monclient: _add_conns ranks=[5,3,0,1,2,4] 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc1a4155d60 0x7fc1a40ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 10 monclient(hunting): picked mon.noname-c con 0x7fc1a4155d60 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc1a406f560 0x7fc1a415c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 10 monclient(hunting): picked mon.noname-a con 0x7fc1a406f560 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc1a415d5b0 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:00.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a415cda0 con 0x7fc1a415d5b0 2026-02-17T11:56:00.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a406fa90 con 0x7fc1a406f560 2026-02-17T11:56:00.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a406fd70 con 0x7fc1a4155d60 2026-02-17T11:56:00.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.938+0000 7fc1ac6b7640 10 monclient(hunting): authenticate will time out at 1030.660389s 2026-02-17T11:56:00.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.978+0000 7f9fe6c16640 1 --2- 10.20.193.10:0/1505156451 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0156260 0x7f9fe0166710 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009d90 tx=0x7f9fdc02f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=546b17cf34256dac server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.978+0000 7fbcd0ff9640 1 -- 10.20.193.10:0/1973197949 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fbcc4007430 con 0x7fbcd40c9d30 2026-02-17T11:56:00.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.978+0000 7fbcd0ff9640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbca4078e50 0x7fbca407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.979+0000 7fbcd3fff640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbca4078e50 0x7fbca407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.979+0000 7fbcd3fff640 10 monclient: get_auth_request con 0x7fbca4078e50 auth_method 0 2026-02-17T11:56:00.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.979+0000 7fcb311fb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:56:00.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.979+0000 7fcb311fb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:56:00.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.979+0000 7fcb311fb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:00.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.979+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcb2c159790 con 0x7fcb2c074cd0 2026-02-17T11:56:00.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.979+0000 7fbcd3fff640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbca4078e50 0x7fbca407b310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0039000 tx=0x7fbcc0031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:00.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.979+0000 7fbcd0ff9640 10 client.4547.objecter ms_handle_connect 0x7fbca4078e50 2026-02-17T11:56:00.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.980+0000 7fbcd0ff9640 1 -- 10.20.193.10:0/1973197949 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fbcc4007750 con 0x7fbcd40c9d30 2026-02-17T11:56:00.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.980+0000 7fbcd0ff9640 10 client.4547.objecter ms_dispatch2 0x7fbcd4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:00.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.980+0000 7fbcd0ff9640 3 client.4547.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:00.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.980+0000 7fbcd0ff9640 3 client.4547.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.980+0000 7fbcd0ff9640 20 client.4547.objecter dump_active .. 0 homeless 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.980+0000 7f6f88da7640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.980+0000 7f6f88da7640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.980+0000 7f6f88da7640 10 monclient: monmap: 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.982234+0000 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.982234+0000 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.983 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.981+0000 7ff74fc7c640 10 monclient: get_monmap_and_config 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.981+0000 7ff74fc7c640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.981+0000 7ff74fc7c640 10 monclient: monmap: 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:00.982302+0000 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:00.982302+0000 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:00.984 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.981+0000 7ff74fc7c640 1 Processor -- start 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.981+0000 7ff74fc7c640 1 -- start start 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.981+0000 7ff74fc7c640 10 monclient: init 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.981+0000 7f6f88da7640 1 Processor -- start 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.981+0000 7f6f88da7640 1 -- start start 2026-02-17T11:56:00.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.981+0000 7f6f88da7640 10 monclient: init 2026-02-17T11:56:00.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 10 monclient: _add_conns ranks=[2,1,5,0,3,4] 2026-02-17T11:56:00.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff748155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:00.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 10 monclient: _add_conns ranks=[5,4,1,0,2,3] 2026-02-17T11:56:00.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff748074cd0 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:00.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff748156260 0x7ff748166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 10 monclient(hunting): picked mon.noname-c con 0x7ff748156260 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6f84155e80 0x7f6f840745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 10 monclient(hunting): picked mon.noname-c con 0x7f6f84155e80 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:00.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6f84156260 0x7f6f84074b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff748073520 con 0x7ff748074cd0 2026-02-17T11:56:00.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 10 monclient(hunting): picked mon.noname-b con 0x7f6f84156260 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:00.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff748073800 con 0x7ff748155e80 2026-02-17T11:56:00.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff7480cd840 con 0x7ff748156260 2026-02-17T11:56:00.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6f840ccbc0 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:00.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f84073520 con 0x7f6f840ccbc0 2026-02-17T11:56:00.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6f840cd840 con 0x7f6f84156260 2026-02-17T11:56:00.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7ff74fc7c640 10 monclient(hunting): authenticate will time out at 1030.704236s 2026-02-17T11:56:00.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6f84073800 con 0x7f6f84155e80 2026-02-17T11:56:00.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.982+0000 7f6f88da7640 10 monclient(hunting): authenticate will time out at 1030.704242s 2026-02-17T11:56:00.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.987+0000 7fbcd0ff9640 1 -- 10.20.193.10:0/1973197949 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbcc4021020 con 0x7fbcd40c9d30 2026-02-17T11:56:00.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.987+0000 7fbcd0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:00.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.987+0000 7fbcd0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:00.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 1 -- 10.20.193.10:0/1505156451 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc03c070 con 0x7f9fe0156260 2026-02-17T11:56:00.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:00.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 10 monclient: dump: 2026-02-17T11:56:00.992 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.992 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.992 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.992 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 10 monclient: _finish_auth 0 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 10 monclient: _check_auth_tickets 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 1 -- 10.20.193.10:0/1505156451 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc037440 con 0x7f9fe0156260 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 1 -- 10.20.193.10:0/1505156451 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc037810 con 0x7f9fe0156260 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe5413640 10 monclient: dump: 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.993 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:00.994 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:00.994 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.994 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:00.994 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:00.994 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:00.994 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe86a0640 5 monclient: authenticate success, global_id 4550 2026-02-17T11:56:00.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe86a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:00.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.990+0000 7f9fe86a0640 4 set_mon_vals no callback set 2026-02-17T11:56:00.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 10 monclient: shutdown 2026-02-17T11:56:00.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 1 -- 10.20.193.10:0/1505156451 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0156260 msgr2=0x7f9fe0166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 1 --2- 10.20.193.10:0/1505156451 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0156260 0x7f9fe0166710 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009d90 tx=0x7f9fdc02f1e0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 1 -- 10.20.193.10:0/1505156451 shutdown_connections 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 1 --2- 10.20.193.10:0/1505156451 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0156260 0x7f9fe0166710 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 1 -- 10.20.193.10:0/1505156451 >> 10.20.193.10:0/1505156451 conn(0x7f9fe00ce2b0 msgr2=0x7f9fe00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 1 -- 10.20.193.10:0/1505156451 shutdown_connections 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 1 -- 10.20.193.10:0/1505156451 wait complete. 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 10 monclient: build_initial_monmap 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.991+0000 7f9fe86a0640 10 monclient: monmap: 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:00.996 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 librados: starting msgr at 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 librados: starting objecter 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 Processor -- start 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 -- start start 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 librados: setting wanted keys 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 librados: calling monclient init 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient: init 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:00.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0074cd0 0x7f9fe01e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient(hunting): picked mon.noname-c con 0x7f9fe0074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9fe0155e80 0x7f9fe01e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient(hunting): picked mon.noname-a con 0x7f9fe0155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9fe0156260 0x7f9fe00c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient(hunting): picked mon.noname-b con 0x7f9fe0156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00c4870 con 0x7f9fe0155e80 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00740a0 con 0x7f9fe0156260 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00c49f0 con 0x7f9fe0074cd0 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.992+0000 7f9fe86a0640 10 monclient(hunting): authenticate will time out at 1030.714551s 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.993+0000 7fb3b1ffb640 1 -- 10.20.193.10:0/1460661981 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3c0062670 con 0x7fb3c41506d0 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.993+0000 7fb3b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.993+0000 7fb3b1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:00.998 INFO:teuthology.orchestra.run.trial010.stdout:98784247813 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.993+0000 7fc1aa42c640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc1a4155d60 0x7fc1a40ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fc1aa42c640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc1a4155d60 0x7fc1a40ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36058/0 (socket says 10.20.193.10:36058) 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fc1aa42c640 1 -- 10.20.193.10:0/1838877693 learned_addr learned my addr 10.20.193.10:0/1838877693 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fc1aa42c640 10 monclient(hunting): get_auth_request con 0x7fc1a4155d60 auth_method 0 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fc1aa42c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fc1aa42c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fc1aa42c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7f5dbf7fe640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5dc0156260 0x7f5dc0166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fc1aa42c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fc1aa42c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fc1aa42c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fbad27fc640 1 -- 10.20.193.10:0/2982124969 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbae0021020 con 0x7fbae4151f90 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fbad27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7fbad27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7f5dbf7fe640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5dc0156260 0x7f5dc0166710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36056/0 (socket says 10.20.193.10:36056) 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7f5dbf7fe640 1 -- 10.20.193.10:0/2587158465 learned_addr learned my addr 10.20.193.10:0/2587158465 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7f5dbf7fe640 10 monclient(hunting): get_auth_request con 0x7f5dc0156260 auth_method 0 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7f5dbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7f5dbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.994+0000 7f5dbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 10 librados: watch_flush enter 2026-02-17T11:56:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 10 librados: watch_flush exit 2026-02-17T11:56:01.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 20 client.4541.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 10 client.4541.objecter successfully canceled tick 2026-02-17T11:56:01.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fdc737fe640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fdc74156020 0x7fdc740cb590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:42220/0 (socket says 10.20.193.10:42220) 2026-02-17T11:56:01.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fdc737fe640 1 -- 10.20.193.10:0/1661161369 learned_addr learned my addr 10.20.193.10:0/1661161369 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:01.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7f5dbf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7f5dbf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7f5dbf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb394078e80 msgr2=0x7fb39407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb394078e80 0x7fb39407b340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4005980 tx=0x7fb3b4009040 comp rx=0 tx=0).stop 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 10 monclient: shutdown 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3c41506d0 msgr2=0x7fb3c41f3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3c41506d0 0x7fb3c41f3420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000cbf0 tx=0x7fb3c000a430 comp rx=0 tx=0).stop 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 shutdown_connections 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb394078e80 0x7fb39407b340 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3c41506d0 0x7fb3c41f3420 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3c41502f0 0x7fb3c4156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 --2- 10.20.193.10:0/1460661981 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3c40c8eb0 0x7fb3c4142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.995+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 >> 10.20.193.10:0/1460661981 conn(0x7fb3c40c9d80 msgr2=0x7fb3c414a720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 shutdown_connections 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fb3cb734640 1 -- 10.20.193.10:0/1460661981 wait complete. 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fb3cb734640 1 librados: shutdown 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fc1aa42c640 10 monclient(hunting): handle_auth_done global_id 4556 payload 274 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fc1aa42c640 1 -- 10.20.193.10:0/1838877693 >> v2:10.20.193.10:3300/0 conn(0x7fc1a406f560 msgr2=0x7fc1a415c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fc1aa42c640 1 --2- 10.20.193.10:0/1838877693 >> v2:10.20.193.10:3300/0 conn(0x7fc1a406f560 0x7fc1a415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fc1aa42c640 1 -- 10.20.193.10:0/1838877693 >> v1:10.20.193.10:6789/0 conn(0x7fc1a415d5b0 legacy=0x7fc1a415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fc1aa42c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fc1aa42c640 1 monclient: found mon.noname-c 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fc1aa42c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fc1aa42c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.996+0000 7fc1aa42c640 1 -- 10.20.193.10:0/1838877693 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a4070050 con 0x7fc1a4155d60 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.997+0000 7f5dbf7fe640 10 monclient(hunting): handle_auth_done global_id 4559 payload 274 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.997+0000 7f5dbf7fe640 1 -- 10.20.193.10:0/2587158465 >> v1:10.20.193.153:6789/0 conn(0x7f5dc0074cd0 legacy=0x7f5dc00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.997+0000 7f5dbf7fe640 1 -- 10.20.193.10:0/2587158465 >> v1:10.20.193.71:6789/0 conn(0x7f5dc0155e80 legacy=0x7f5dc00745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.997+0000 7f5dbf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.997+0000 7f5dbf7fe640 1 monclient: found mon.noname-c 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.997+0000 7f5dbf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.997+0000 7f5dbf7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.997+0000 7f5dbf7fe640 1 -- 10.20.193.10:0/2587158465 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc0073ae0 con 0x7f5dc0156260 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.997+0000 7f6f82575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6f84155e80 0x7f6f840745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.998+0000 7f6f82575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6f84155e80 0x7f6f840745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36072/0 (socket says 10.20.193.10:36072) 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.998+0000 7f6f82575640 1 -- 10.20.193.10:0/1186130078 learned_addr learned my addr 10.20.193.10:0/1186130078 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.998+0000 7f6f82575640 10 monclient(hunting): get_auth_request con 0x7f6f84155e80 auth_method 0 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.998+0000 7f6f82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.998+0000 7f6f82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.998+0000 7f6f82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.998+0000 7fc1aa42c640 1 --2- 10.20.193.10:0/1838877693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 0x7fc1a40ccb40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4074710 tx=0x7fc19402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d98c1059925917 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.998+0000 7f5dbf7fe640 1 --2- 10.20.193.10:0/2587158465 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0156260 0x7f5dc0166710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009e50 tx=0x7f5db002f2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7f6642c627f17f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.999+0000 7f6f82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.999+0000 7f6f82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:00.999+0000 7f6f82575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.001+0000 7f6f82575640 10 monclient(hunting): handle_auth_done global_id 4562 payload 274 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.001+0000 7f6f82575640 1 -- 10.20.193.10:0/1186130078 >> v2:10.20.193.71:3300/0 conn(0x7f6f84156260 msgr2=0x7f6f84074b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.001+0000 7f6f82575640 1 --2- 10.20.193.10:0/1186130078 >> v2:10.20.193.71:3300/0 conn(0x7f6f84156260 0x7f6f84074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.001+0000 7f6f82575640 1 -- 10.20.193.10:0/1186130078 >> v1:10.20.193.71:6789/0 conn(0x7f6f840ccbc0 legacy=0x7f6f840ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.001+0000 7f6f82575640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.001+0000 7f6f82575640 1 monclient: found mon.noname-c 2026-02-17T11:56:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.001+0000 7f6f82575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.001+0000 7f6f82575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.001+0000 7f6f82575640 1 -- 10.20.193.10:0/1186130078 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84073ae0 con 0x7f6f84155e80 2026-02-17T11:56:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.002+0000 7f9fe6415640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0074cd0 0x7f9fe01e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7f9fe6415640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0074cd0 0x7f9fe01e92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36092/0 (socket says 10.20.193.10:36092) 2026-02-17T11:56:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7f9fe6415640 1 -- 10.20.193.10:0/3389063796 learned_addr learned my addr 10.20.193.10:0/3389063796 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7f9fe6415640 10 monclient(hunting): get_auth_request con 0x7f9fe0074cd0 auth_method 0 2026-02-17T11:56:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7f9fe6415640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7f9fe6415640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7f9fe6415640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7ff74e1f2640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff748156260 0x7ff748166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7f6f82575640 1 --2- 10.20.193.10:0/1186130078 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 0x7f6f840745c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f8406cfa0 tx=0x7f6f7802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10fba9133043eb90 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7ff74e1f2640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff748156260 0x7ff748166710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36084/0 (socket says 10.20.193.10:36084) 2026-02-17T11:56:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7ff74e1f2640 1 -- 10.20.193.10:0/444498596 learned_addr learned my addr 10.20.193.10:0/444498596 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7ff74e1f2640 10 monclient(hunting): get_auth_request con 0x7ff748156260 auth_method 0 2026-02-17T11:56:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7ff74e1f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7ff74e1f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.004+0000 7ff74e1f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.005+0000 7f9fe6415640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.005+0000 7f9fe6415640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.005+0000 7f9fe6415640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247813 for osd.2 2026-02-17T11:56:01.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.005+0000 7ff74e1f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.005+0000 7ff74e1f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.005+0000 7ff74e1f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.007 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 10 monclient(hunting): handle_auth_done global_id 4565 payload 824 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 1 -- 10.20.193.10:0/3389063796 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9fe0156260 msgr2=0x7f9fe00c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9fe0156260 0x7f9fe00c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 1 -- 10.20.193.10:0/3389063796 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9fe0155e80 msgr2=0x7f9fe01e75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9fe0155e80 0x7f9fe01e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 1 monclient: found mon.noname-c 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.007+0000 7f9fe6415640 1 -- 10.20.193.10:0/3389063796 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe01e99a0 con 0x7f9fe0074cd0 2026-02-17T11:56:01.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.009+0000 7ff74e1f2640 10 monclient(hunting): handle_auth_done global_id 4568 payload 274 2026-02-17T11:56:01.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.009+0000 7ff74e1f2640 1 -- 10.20.193.10:0/444498596 >> v1:10.20.193.153:6789/0 conn(0x7ff748155e80 legacy=0x7ff7480745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.009+0000 7ff74e1f2640 1 -- 10.20.193.10:0/444498596 >> v1:10.20.193.71:6789/0 conn(0x7ff748074cd0 legacy=0x7ff7480ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.009+0000 7ff74e1f2640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.009+0000 7ff74e1f2640 1 monclient: found mon.noname-c 2026-02-17T11:56:01.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.009+0000 7ff74e1f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.009+0000 7ff74e1f2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.009+0000 7ff74e1f2640 1 -- 10.20.193.10:0/444498596 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff748073ae0 con 0x7ff748156260 2026-02-17T11:56:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.010+0000 7f9fe6415640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0074cd0 0x7f9fe01e92b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c730 tx=0x7f9fd000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.010+0000 7f9fc6ffd640 10 client.?.objecter ms_handle_connect 0x7f9fe0074cd0 2026-02-17T11:56:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.010+0000 7f9fc6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.012 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T11:56:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.010+0000 7fdc727fc640 1 -- 10.20.193.10:0/1661161369 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073143022 0 0) 0x7fdc740c8ba0 con 0x7fdc74156020 2026-02-17T11:56:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.010+0000 7fdc727fc640 10 monclient(hunting): _negotiate 2026-02-17T11:56:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.010+0000 7fdc727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.010+0000 7fdc727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.010+0000 7fdc727fc640 10 monclient(hunting): my global_id is 4500 2026-02-17T11:56:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.010+0000 7fdc727fc640 1 -- 10.20.193.10:0/1661161369 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc58003620 con 0x7fdc74156020 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 1 -- 10.20.193.10:0/1186130078 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7803c070 con 0x7f6f84155e80 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 10 monclient: dump: 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.014 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 1 -- 10.20.193.10:0/1186130078 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7802fb40 con 0x7f6f84155e80 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 1 -- 10.20.193.10:0/1186130078 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78037440 con 0x7f6f84155e80 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f88da7640 5 monclient: authenticate success, global_id 4562 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f88da7640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f88da7640 4 set_mon_vals no callback set 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f81573640 10 monclient: dump: 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f88da7640 10 monclient: shutdown 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f88da7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f88da7640 1 -- 10.20.193.10:0/1186130078 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 msgr2=0x7f6f840745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.011+0000 7f6f88da7640 1 --2- 10.20.193.10:0/1186130078 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 0x7f6f840745c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f8406cfa0 tx=0x7f6f7802eed0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.012+0000 7f6f88da7640 1 -- 10.20.193.10:0/1186130078 shutdown_connections 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.012+0000 7f6f88da7640 1 --2- 10.20.193.10:0/1186130078 >> v2:10.20.193.71:3300/0 conn(0x7f6f84156260 0x7f6f84074b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.012+0000 7f6f88da7640 1 --2- 10.20.193.10:0/1186130078 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 0x7f6f840745c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.012+0000 7f6f88da7640 1 -- 10.20.193.10:0/1186130078 >> 10.20.193.10:0/1186130078 conn(0x7f6f840ce2b0 msgr2=0x7f6f840ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.012+0000 7f6f88da7640 1 -- 10.20.193.10:0/1186130078 shutdown_connections 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.012+0000 7fdc73fff640 1 --2- 10.20.193.10:0/1661161369 >> v2:10.20.193.10:3300/0 conn(0x7fdc740c9d30 0x7fdc740ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.012+0000 7f6f88da7640 1 -- 10.20.193.10:0/1186130078 wait complete. 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient: monmap: 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.016 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 librados: starting msgr at 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 librados: starting objecter 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 Processor -- start 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fdc73fff640 10 monclient(hunting): get_auth_request con 0x7fdc740c9d30 auth_method 0 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fdc73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fdc73fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 -- start start 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 librados: setting wanted keys 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 librados: calling monclient init 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient: init 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fdc73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 1 -- 10.20.193.10:0/1838877693 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19403c070 con 0x7fc1a4155d60 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 10 monclient: dump: 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.018 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 1 -- 10.20.193.10:0/1838877693 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19402fb40 con 0x7fc1a4155d60 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 1 -- 10.20.193.10:0/1838877693 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194037440 con 0x7fc1a4155d60 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1ac6b7640 5 monclient: authenticate success, global_id 4556 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1ac6b7640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1ac6b7640 4 set_mon_vals no callback set 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7fc1a942a640 10 monclient: dump: 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.019 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6f840ccbc0 0x7f6f84144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient(hunting): picked mon.noname-a con 0x7f6f840ccbc0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 0x7f6f84156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient(hunting): picked mon.noname-c con 0x7f6f84155e80 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6f84156260 0x7f6f840c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient(hunting): picked mon.noname-b con 0x7f6f84156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840c4870 con 0x7f6f840ccbc0 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840740a0 con 0x7f6f84156260 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840c49f0 con 0x7f6f84155e80 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.013+0000 7f6f88da7640 10 monclient(hunting): authenticate will time out at 1030.735853s 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 10 monclient: shutdown 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/1838877693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 msgr2=0x7fc1a40ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 --2- 10.20.193.10:0/1838877693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 0x7fc1a40ccb40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4074710 tx=0x7fc19402eed0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/1838877693 shutdown_connections 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 --2- 10.20.193.10:0/1838877693 >> v2:10.20.193.10:3300/0 conn(0x7fc1a406f560 0x7fc1a415c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 --2- 10.20.193.10:0/1838877693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 0x7fc1a40ccb40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/1838877693 >> 10.20.193.10:0/1838877693 conn(0x7fc1a40cc020 msgr2=0x7fc1a40cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/1838877693 shutdown_connections 2026-02-17T11:56:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/1838877693 wait complete. 2026-02-17T11:56:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fdc73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fdc73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fdc73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 10 monclient: monmap: 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 librados: starting msgr at 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 librados: starting objecter 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.014+0000 7fc1ac6b7640 1 Processor -- start 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 1 -- start start 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 1 librados: setting wanted keys 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 1 librados: calling monclient init 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient: init 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc1a406f560 0x7fc1a414de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient(hunting): picked mon.noname-a con 0x7fc1a406f560 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 0x7fc1a41f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient(hunting): picked mon.noname-c con 0x7fc1a4155d60 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc1a415d5b0 0x7fc1a41f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient(hunting): picked mon.noname-b con 0x7fc1a415d5b0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a40708f0 con 0x7fc1a406f560 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a4070610 con 0x7fc1a415d5b0 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a40cbd10 con 0x7fc1a4155d60 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fc1ac6b7640 10 monclient(hunting): authenticate will time out at 1030.737441s 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fdc73fff640 10 monclient(hunting): handle_auth_done global_id 4503 payload 274 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fdc73fff640 1 -- 10.20.193.10:0/1661161369 >> v1:10.20.193.71:6789/0 conn(0x7fdc740c98f0 legacy=0x7fdc740d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fdc73fff640 1 -- 10.20.193.10:0/1661161369 >> v1:10.20.193.10:6789/0 conn(0x7fdc74156020 legacy=0x7fdc740cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fdc73fff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fdc73fff640 1 monclient: found mon.noname-a 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fdc73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fdc73fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.015+0000 7fdc73fff640 1 -- 10.20.193.10:0/1661161369 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc740d2290 con 0x7fdc740c9d30 2026-02-17T11:56:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.016+0000 7f2f27577640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 0x7f2f281f6710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2f18039040 tx=0x7f2f18004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.016+0000 7f2f077fe640 10 client.?.objecter ms_handle_connect 0x7f2f28156260 2026-02-17T11:56:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.016+0000 7f2f077fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.016+0000 7f6f81d74640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 0x7f6f84156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.017+0000 7ff74e1f2640 1 --2- 10.20.193.10:0/444498596 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff748156260 0x7ff748166710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff744009e50 tx=0x7ff74402f2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5185391ebcf38dd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.019+0000 7f6f81d74640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 0x7f6f84156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36100/0 (socket says 10.20.193.10:36100) 2026-02-17T11:56:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.019+0000 7f6f81d74640 1 -- 10.20.193.10:0/4288105178 learned_addr learned my addr 10.20.193.10:0/4288105178 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.019+0000 7f6f81d74640 10 monclient(hunting): get_auth_request con 0x7f6f84155e80 auth_method 0 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.019+0000 7f6f81d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.019+0000 7f6f81d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.019+0000 7f6f81d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f6f81d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f6f81d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f6f81d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7fcb0b7fe640 1 -- 10.20.193.10:0/897223460 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcb200621c0 con 0x7fcb2c074cd0 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7fcb0b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7fcb0b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 1 -- 10.20.193.10:0/2587158465 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db002fd00 con 0x7f5dc0156260 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 10 monclient: dump: 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 1 -- 10.20.193.10:0/2587158465 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db00373f0 con 0x7f5dc0156260 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 1 -- 10.20.193.10:0/2587158465 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db00377c0 con 0x7f5dc0156260 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dc52e8640 5 monclient: authenticate success, global_id 4559 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dc52e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dc52e8640 4 set_mon_vals no callback set 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.020+0000 7f5dbdffb640 10 monclient: dump: 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.027 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stdout:124554051590 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.021+0000 7f5dc52e8640 10 monclient: shutdown 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.021+0000 7f5dc52e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.021+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2587158465 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0156260 msgr2=0x7f5dc0166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.021+0000 7f5dc52e8640 1 --2- 10.20.193.10:0/2587158465 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0156260 0x7f5dc0166710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009e50 tx=0x7f5db002f2a0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.021+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2587158465 shutdown_connections 2026-02-17T11:56:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.021+0000 7f5dc52e8640 1 --2- 10.20.193.10:0/2587158465 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0156260 0x7f5dc0166710 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.021+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2587158465 >> 10.20.193.10:0/2587158465 conn(0x7f5dc00ce2b0 msgr2=0x7f5dc00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.021+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2587158465 shutdown_connections 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.021+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2587158465 wait complete. 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 10 monclient(hunting): handle_auth_done global_id 4571 payload 824 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 1 -- 10.20.193.10:0/4288105178 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6f84156260 msgr2=0x7f6f840c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6f84156260 0x7f6f840c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 1 -- 10.20.193.10:0/4288105178 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6f840ccbc0 msgr2=0x7f6f84144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6f840ccbc0 0x7f6f84144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 1 monclient: found mon.noname-c 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f6f81d74640 1 -- 10.20.193.10:0/4288105178 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f841570a0 con 0x7f6f84155e80 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient: monmap: 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 librados: starting msgr at 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 librados: starting objecter 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 Processor -- start 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 -- start start 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 librados: setting wanted keys 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 librados: calling monclient init 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient: init 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5dc0074cd0 0x7f5dc00c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient(hunting): picked mon.noname-b con 0x7f5dc0074cd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0155e80 0x7f5dc00c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient(hunting): picked mon.noname-c con 0x7f5dc0155e80 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5dc0156260 0x7f5dc0144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient(hunting): picked mon.noname-a con 0x7f5dc0156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc00c4870 con 0x7f5dc0156260 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc00740a0 con 0x7f5dc0074cd0 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc00c49f0 con 0x7f5dc0155e80 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7f5dc52e8640 10 monclient(hunting): authenticate will time out at 1030.744826s 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7fcb311fb640 10 librados: watch_flush enter 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7fcb311fb640 10 librados: watch_flush exit 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7fcb311fb640 20 client.4546.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7fcb311fb640 10 client.4546.objecter successfully canceled tick 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.022+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcaf8078e30 msgr2=0x7fcaf807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcaf8078e30 0x7fcaf807b2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c145a50 tx=0x7fcb14033000 comp rx=0 tx=0).stop 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 10 monclient: shutdown 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcb2c074cd0 msgr2=0x7fcb2c156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcb2c074cd0 0x7fcb2c156680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000b550 tx=0x7fcb2000ba20 comp rx=0 tx=0).stop 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 shutdown_connections 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcaf8078e30 0x7fcaf807b2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcb2c156260 0x7fcb2c1e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcb2c155e80 0x7fcb2c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 --2- 10.20.193.10:0/897223460 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcb2c074cd0 0x7fcb2c156680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 >> 10.20.193.10:0/897223460 conn(0x7fcb2c0ce2b0 msgr2=0x7fcb2c0cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 shutdown_connections 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 -- 10.20.193.10:0/897223460 wait complete. 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.023+0000 7fcb311fb640 1 librados: shutdown 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 1 -- 10.20.193.10:0/3389063796 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0017070 con 0x7f9fe0074cd0 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 10 monclient: dump: 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.033 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 1 -- 10.20.193.10:0/3389063796 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd0005b90 con 0x7f9fe0074cd0 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 5 monclient: authenticate success, global_id 4565 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 10 monclient: _renew_subs 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe01e9c80 con 0x7f9fe0074cd0 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 1 -- 10.20.193.10:0/3389063796 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0007070 con 0x7f9fe0074cd0 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fc6ffd640 10 monclient: dump: 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe4c12640 4 set_mon_vals no callback set 2026-02-17T11:56:01.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 10 client.4565.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 10 monclient: _renew_subs 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe01ea240 con 0x7f9fe0074cd0 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 1 librados: init done 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.024+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe00c8d00 con 0x7f9fe0074cd0 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.025+0000 7f6f81d74640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 0x7f6f84156680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00b530 tx=0x7f6f6c00ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.025+0000 7f6f6affd640 10 client.?.objecter ms_handle_connect 0x7f6f84155e80 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.025+0000 7f6f6affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.027+0000 7fc1a9c2b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 0x7fc1a41f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7f5dbe7fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0155e80 0x7f5dc00c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7fc1a9c2b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 0x7fc1a41f5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36104/0 (socket says 10.20.193.10:36104) 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7fc1a9c2b640 1 -- 10.20.193.10:0/778343789 learned_addr learned my addr 10.20.193.10:0/778343789 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7fc1a9c2b640 10 monclient(hunting): get_auth_request con 0x7fc1a4155d60 auth_method 0 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7fc1a9c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7fc1a9c2b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7fc1a9c2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7f5dbe7fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0155e80 0x7f5dc00c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36116/0 (socket says 10.20.193.10:36116) 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7f5dbe7fc640 1 -- 10.20.193.10:0/2538009481 learned_addr learned my addr 10.20.193.10:0/2538009481 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7f5dbe7fc640 10 monclient(hunting): get_auth_request con 0x7f5dc0155e80 auth_method 0 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7f5dbe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7f5dbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7f5dbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7fc1a9c2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7fc1a9c2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7fc1a9c2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.028+0000 7f11f5ffb640 1 -- 10.20.193.10:0/2119997595 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f12040415f0 con 0x7f1208156260 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.029+0000 7f11f5ffb640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f11d8078e00 0x7f11d807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.029+0000 7f120d606640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f11d8078e00 0x7f11d807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.029+0000 7f120d606640 10 monclient: get_auth_request con 0x7f11d8078e00 auth_method 0 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.029+0000 7f120d606640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f11d8078e00 0x7f11d807b2c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f11f8006fd0 tx=0x7f11f8006d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.029+0000 7f11f5ffb640 10 client.4555.objecter ms_handle_connect 0x7f11d8078e00 2026-02-17T11:56:01.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051590 got 124554051590 for osd.3 2026-02-17T11:56:01.037 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.032+0000 7f11f5ffb640 1 -- 10.20.193.10:0/2119997595 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f1204083af0 con 0x7f1208156260 2026-02-17T11:56:01.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.032+0000 7f11f5ffb640 10 client.4555.objecter ms_dispatch2 0x7f1208000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.032+0000 7f11f5ffb640 3 client.4555.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.032+0000 7f11f5ffb640 3 client.4555.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.032+0000 7f11f5ffb640 20 client.4555.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.039+0000 7f11f5ffb640 1 -- 10.20.193.10:0/2119997595 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1204050030 con 0x7f1208156260 2026-02-17T11:56:01.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.039+0000 7f11f5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.039+0000 7f11f5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.043+0000 7f5dbeffd640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5dc0074cd0 0x7f5dc00c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.044+0000 7f5dbeffd640 10 monclient(hunting): get_auth_request con 0x7f5dc0074cd0 auth_method 0 2026-02-17T11:56:01.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.044+0000 7f5dbeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.044+0000 7f5dbeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.044+0000 7f5dbeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.045+0000 7fc1aac2d640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc1a415d5b0 0x7fc1a41f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.047+0000 7fdc73fff640 1 --2- 10.20.193.10:0/1661161369 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc740c9d30 0x7fdc740ce1b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009d90 tx=0x7fdc6802f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bf1fba4a7d0c6d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.050+0000 7fc1aa42c640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc1a406f560 0x7fc1a414de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.050+0000 7fc1aa42c640 10 monclient(hunting): get_auth_request con 0x7fc1a406f560 auth_method 0 2026-02-17T11:56:01.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.050+0000 7fc1aa42c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.050+0000 7fc1aa42c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.050+0000 7fc1aa42c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.052+0000 7fc1aa42c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.052+0000 7fc1aa42c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.052+0000 7fc1aa42c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 10 monclient(hunting): handle_auth_done global_id 4506 payload 824 2026-02-17T11:56:01.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 1 -- 10.20.193.10:0/778343789 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 msgr2=0x7fc1a41f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 0x7fc1a41f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 1 -- 10.20.193.10:0/778343789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc1a415d5b0 msgr2=0x7fc1a41f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc1a415d5b0 0x7fc1a41f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 1 monclient: found mon.noname-a 2026-02-17T11:56:01.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.054+0000 7fc1aa42c640 1 -- 10.20.193.10:0/778343789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a415e530 con 0x7fc1a406f560 2026-02-17T11:56:01.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.056+0000 7fc1aa42c640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc1a406f560 0x7fc1a414de20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4071380 tx=0x7fc1940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.056+0000 7fc18affd640 10 client.?.objecter ms_handle_connect 0x7fc1a406f560 2026-02-17T11:56:01.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.056+0000 7fc18affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 1 -- 10.20.193.10:0/1661161369 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6803c070 con 0x7fdc740c9d30 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 10 monclient: dump: 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 1 -- 10.20.193.10:0/1661161369 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc68037440 con 0x7fdc740c9d30 2026-02-17T11:56:01.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 5 monclient: authenticate success, global_id 4503 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 1 -- 10.20.193.10:0/1661161369 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68037810 con 0x7fdc740c9d30 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 4 set_mon_vals no callback set 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc727fc640 10 monclient: dump: 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7f5dbf7fe640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5dc0156260 0x7f5dc0144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 10 monclient: shutdown 2026-02-17T11:56:01.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 1 -- 10.20.193.10:0/1661161369 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc740c9d30 msgr2=0x7fdc740ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 1 --2- 10.20.193.10:0/1661161369 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc740c9d30 0x7fdc740ce1b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009d90 tx=0x7fdc6802f270 comp rx=0 tx=0).stop 2026-02-17T11:56:01.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 1 -- 10.20.193.10:0/1661161369 shutdown_connections 2026-02-17T11:56:01.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 1 --2- 10.20.193.10:0/1661161369 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc740c9d30 0x7fdc740ce1b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 1 -- 10.20.193.10:0/1661161369 >> 10.20.193.10:0/1661161369 conn(0x7fdc7406d970 msgr2=0x7fdc7406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 1 -- 10.20.193.10:0/1661161369 shutdown_connections 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.057+0000 7fdc79f11640 1 -- 10.20.193.10:0/1661161369 wait complete. 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7fdc79f11640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7fdc79f11640 10 monclient: monmap: 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7fdc79f11640 1 librados: starting msgr at 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7fdc79f11640 1 librados: starting objecter 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7fdc79f11640 1 Processor -- start 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7fdc79f11640 1 -- start start 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7fdc79f11640 1 librados: setting wanted keys 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7fdc79f11640 1 librados: calling monclient init 2026-02-17T11:56:01.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7fdc79f11640 10 monclient: init 2026-02-17T11:56:01.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7f5dbe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7f5dbe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7f5dbe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7f5dbf7fe640 10 monclient(hunting): get_auth_request con 0x7f5dc0156260 auth_method 0 2026-02-17T11:56:01.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7f5dbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7f5dbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.058+0000 7f5dbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdc740c98f0 0x7fdc741f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient(hunting): picked mon.noname-b con 0x7fdc740c98f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdc740c9d30 0x7fdc740d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient(hunting): picked mon.noname-c con 0x7fdc740c9d30 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc74156020 0x7fdc741f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient(hunting): picked mon.noname-a con 0x7fdc74156020 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fdc740c90f0 con 0x7fdc74156020 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdc740c8e10 con 0x7fdc740c98f0 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc740cc120 con 0x7fdc740c9d30 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.059+0000 7fdc79f11640 10 monclient(hunting): authenticate will time out at 1030.781158s 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.060+0000 7f5dbf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.060+0000 7f5dbf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.060+0000 7f5dbf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 1 -- 10.20.193.10:0/778343789 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194044070 con 0x7fc1a406f560 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 10 monclient: dump: 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.065 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 1 -- 10.20.193.10:0/778343789 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc194040610 con 0x7fc1a406f560 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 1 -- 10.20.193.10:0/778343789 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19403c040 con 0x7fc1a406f560 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1ac6b7640 5 monclient: authenticate success, global_id 4506 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc18affd640 10 monclient: dump: 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1a8c29640 4 set_mon_vals no callback set 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1ac6b7640 10 monclient: _renew_subs 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1ac6b7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a415e810 con 0x7fc1a406f560 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1ac6b7640 10 client.4506.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1ac6b7640 10 monclient: _renew_subs 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1ac6b7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a415edd0 con 0x7fc1a406f560 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.061+0000 7fc1ac6b7640 1 librados: init done 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.062+0000 7fc1ac6b7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.062+0000 7fc1ac6b7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.062+0000 7fc1ac6b7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.062+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a4156140 con 0x7fc1a406f560 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 10 monclient(hunting): handle_auth_done global_id 4509 payload 824 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 1 -- 10.20.193.10:0/2538009481 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0155e80 msgr2=0x7f5dc00c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0155e80 0x7f5dc00c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 1 -- 10.20.193.10:0/2538009481 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5dc0074cd0 msgr2=0x7f5dc00c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5dc0074cd0 0x7f5dc00c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 1 monclient: found mon.noname-a 2026-02-17T11:56:01.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7f5dbf7fe640 1 -- 10.20.193.10:0/2538009481 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc01f5330 con 0x7f5dc0156260 2026-02-17T11:56:01.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.063+0000 7fdc73fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc74156020 0x7fdc741f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.068+0000 7f5dbf7fe640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5dc0156260 0x7f5dc0144ae0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5db0035000 tx=0x7f5db0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.068+0000 7f5d9f7fe640 10 client.?.objecter ms_handle_connect 0x7f5dc0156260 2026-02-17T11:56:01.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.068+0000 7f5d9f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.079 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.077+0000 7fbcda8f1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:56:01.079 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.078+0000 7fbcda8f1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:56:01.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.078+0000 7fbcda8f1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.078+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbcd4155840 con 0x7fbcd40c9d30 2026-02-17T11:56:01.082 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 1 -- 10.20.193.10:0/2596376579 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18046020 con 0x7f2f28156260 2026-02-17T11:56:01.082 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.082 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:01.082 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 10 monclient: dump: 2026-02-17T11:56:01.082 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.082 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 1 -- 10.20.193.10:0/2596376579 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f18041450 con 0x7f2f28156260 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 1 -- 10.20.193.10:0/2596376579 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18037e60 con 0x7f2f28156260 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f2d185640 5 monclient: authenticate success, global_id 4558 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f25573640 4 set_mon_vals no callback set 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f2d185640 10 monclient: _renew_subs 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f2d185640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f281f5130 con 0x7f2f28156260 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f077fe640 10 monclient: dump: 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.083 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f2d185640 10 client.4558.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f2d185640 10 monclient: _renew_subs 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f2d185640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f281f56f0 con 0x7f2f28156260 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.080+0000 7f2f2d185640 1 librados: init done 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.081+0000 7f2f2d185640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.081+0000 7f2f2d185640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.081+0000 7f2f2d185640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.081+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f280745c0 con 0x7f2f28156260 2026-02-17T11:56:01.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.082+0000 7fae471a8640 10 monclient: get_monmap_and_config 2026-02-17T11:56:01.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.082+0000 7fae471a8640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.082+0000 7fae471a8640 10 monclient: monmap: 2026-02-17T11:56:01.085 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.085 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:01.083465+0000 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:01.083465+0000 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.082+0000 7fae471a8640 1 Processor -- start 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.082+0000 7fae471a8640 1 -- start start 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.082+0000 7fae471a8640 10 monclient: init 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 10 monclient: _add_conns ranks=[2,0,1,4,5,3] 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fae40152660 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fae4015b030 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fae400c6ce0 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae400c71e0 con 0x7fae4015b030 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae400c74c0 con 0x7fae400c6ce0 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae40159e40 con 0x7fae40152660 2026-02-17T11:56:01.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.083+0000 7fae471a8640 10 monclient(hunting): authenticate will time out at 1030.805288s 2026-02-17T11:56:01.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.084+0000 7fdc737fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdc740c98f0 0x7fdc741f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.085+0000 7fdc737fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdc740c98f0 0x7fdc741f7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47454/0 (socket says 10.20.193.10:47454) 2026-02-17T11:56:01.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.085+0000 7fdc737fe640 1 -- 10.20.193.10:0/4293261586 learned_addr learned my addr 10.20.193.10:0/4293261586 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.085+0000 7fdc737fe640 10 monclient(hunting): get_auth_request con 0x7fdc740c98f0 auth_method 0 2026-02-17T11:56:01.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.085+0000 7fdc737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.085+0000 7fdc737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.085+0000 7fdc737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.086+0000 7fbaec149640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:56:01.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.086+0000 7fbaec149640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:56:01.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.086+0000 7fbaec149640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.086+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbae4152d00 con 0x7fbae4151f90 2026-02-17T11:56:01.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.127+0000 7f120f891640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:56:01.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.127+0000 7f120f891640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:56:01.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.127+0000 7f120f891640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.127+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f1208150500 con 0x7f1208156260 2026-02-17T11:56:01.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.163+0000 7fdc73fff640 10 monclient(hunting): get_auth_request con 0x7fdc74156020 auth_method 0 2026-02-17T11:56:01.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.163+0000 7fdc73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.163+0000 7fdc73fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.163+0000 7fdc73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 1 -- 10.20.193.10:0/4288105178 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c013020 con 0x7f6f84155e80 2026-02-17T11:56:01.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:01.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 10 monclient: dump: 2026-02-17T11:56:01.168 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.168 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.168 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.168 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 1 -- 10.20.193.10:0/4288105178 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f6c004480 con 0x7f6f84155e80 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 1 -- 10.20.193.10:0/4288105178 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c002920 con 0x7f6f84155e80 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f88da7640 5 monclient: authenticate success, global_id 4571 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f80d72640 4 set_mon_vals no callback set 2026-02-17T11:56:01.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f6affd640 10 monclient: dump: 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f88da7640 10 monclient: _renew_subs 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f88da7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.165+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f84157380 con 0x7f6f84155e80 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.166+0000 7f6f88da7640 10 client.4571.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.166+0000 7f6f88da7640 10 monclient: _renew_subs 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.166+0000 7f6f88da7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.166+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f84157940 con 0x7f6f84155e80 2026-02-17T11:56:01.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.166+0000 7f6f88da7640 1 librados: init done 2026-02-17T11:56:01.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.166+0000 7f6f88da7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.166+0000 7f6f88da7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.166+0000 7f6f88da7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.166+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f840ccfe0 con 0x7f6f84155e80 2026-02-17T11:56:01.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.171+0000 7fdc73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.171+0000 7fdc73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.171+0000 7fdc73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.172+0000 7fc18affd640 1 -- 10.20.193.10:0/778343789 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc19403f050 con 0x7fc1a406f560 2026-02-17T11:56:01.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.172+0000 7fc18affd640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc174078e50 0x7fc17407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.172+0000 7fc1a9c2b640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc174078e50 0x7fc17407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.172+0000 7fc1a9c2b640 10 monclient: get_auth_request con 0x7fc174078e50 auth_method 0 2026-02-17T11:56:01.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.172+0000 7fc18affd640 10 client.4506.objecter ms_handle_connect 0x7fc174078e50 2026-02-17T11:56:01.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.172+0000 7fc1a9c2b640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc174078e50 0x7fc17407b310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc1a414c7e0 tx=0x7fc198009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.175+0000 7f9fc6ffd640 1 -- 10.20.193.10:0/3389063796 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f9fd0007210 con 0x7f9fe0074cd0 2026-02-17T11:56:01.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.176+0000 7f9fc6ffd640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9fb0078e80 0x7f9fb007b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.176+0000 7f9fe5c14640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9fb0078e80 0x7f9fb007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.176+0000 7f9fe5c14640 10 monclient: get_auth_request con 0x7f9fb0078e80 auth_method 0 2026-02-17T11:56:01.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.176+0000 7f9fe5c14640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9fb0078e80 0x7f9fb007b340 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4006fd0 tx=0x7f9fd4006d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.176+0000 7f9fc6ffd640 10 client.4565.objecter ms_handle_connect 0x7f9fb0078e80 2026-02-17T11:56:01.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.177+0000 7f9fc6ffd640 1 -- 10.20.193.10:0/3389063796 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f9fd005d420 con 0x7f9fe0074cd0 2026-02-17T11:56:01.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.177+0000 7f9fc6ffd640 10 client.4565.objecter ms_dispatch2 0x7f9fe0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.177+0000 7f9fc6ffd640 3 client.4565.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.177+0000 7f9fc6ffd640 3 client.4565.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.177+0000 7f9fc6ffd640 20 client.4565.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.180+0000 7fc18affd640 1 -- 10.20.193.10:0/778343789 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fc194082dd0 con 0x7fc1a406f560 2026-02-17T11:56:01.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.180+0000 7fc18affd640 10 client.4506.objecter ms_dispatch2 0x7fc1a4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.180+0000 7fc18affd640 3 client.4506.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.180+0000 7fc18affd640 3 client.4506.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.180+0000 7fc18affd640 20 client.4506.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.180+0000 7fc18affd640 1 -- 10.20.193.10:0/778343789 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc1a415cda0 con 0x7fc1a406f560 2026-02-17T11:56:01.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.181+0000 7fc18affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.181+0000 7fc18affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 1 -- 10.20.193.10:0/444498596 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74402fd00 con 0x7ff748156260 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 10 monclient: dump: 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.186 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 1 -- 10.20.193.10:0/444498596 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7440373f0 con 0x7ff748156260 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 1 -- 10.20.193.10:0/444498596 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7440377c0 con 0x7ff748156260 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74c9ef640 10 monclient: dump: 2026-02-17T11:56:01.187 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74fc7c640 5 monclient: authenticate success, global_id 4568 2026-02-17T11:56:01.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74fc7c640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:01.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7ff74fc7c640 4 set_mon_vals no callback set 2026-02-17T11:56:01.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7f9fc6ffd640 1 -- 10.20.193.10:0/3389063796 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9fd0021020 con 0x7f9fe0074cd0 2026-02-17T11:56:01.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7f9fc6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.183+0000 7f9fc6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 10 monclient: shutdown 2026-02-17T11:56:01.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 1 -- 10.20.193.10:0/444498596 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff748156260 msgr2=0x7ff748166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 1 --2- 10.20.193.10:0/444498596 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff748156260 0x7ff748166710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff744009e50 tx=0x7ff74402f2a0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 1 -- 10.20.193.10:0/444498596 shutdown_connections 2026-02-17T11:56:01.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 1 --2- 10.20.193.10:0/444498596 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff748156260 0x7ff748166710 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 1 -- 10.20.193.10:0/444498596 >> 10.20.193.10:0/444498596 conn(0x7ff7480ce2b0 msgr2=0x7ff7480ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 1 -- 10.20.193.10:0/444498596 shutdown_connections 2026-02-17T11:56:01.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 1 -- 10.20.193.10:0/444498596 wait complete. 2026-02-17T11:56:01.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc72ffd640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdc740c9d30 0x7fdc740d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 10 monclient(hunting): handle_auth_done global_id 4512 payload 824 2026-02-17T11:56:01.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 1 -- 10.20.193.10:0/4293261586 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdc740c9d30 msgr2=0x7fdc740d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdc740c9d30 0x7fdc740d0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 1 -- 10.20.193.10:0/4293261586 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdc740c98f0 msgr2=0x7fdc741f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdc740c98f0 0x7fdc741f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 1 monclient: found mon.noname-a 2026-02-17T11:56:01.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7ff74fc7c640 10 monclient: monmap: 2026-02-17T11:56:01.192 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.192 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.193 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.194 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.184+0000 7fdc73fff640 1 -- 10.20.193.10:0/4293261586 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7415d530 con 0x7fdc74156020 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 librados: starting msgr at 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 librados: starting objecter 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 Processor -- start 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 -- start start 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 librados: setting wanted keys 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 librados: calling monclient init 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient: init 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff748074cd0 0x7ff7481f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient(hunting): picked mon.noname-b con 0x7ff748074cd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff748155e80 0x7ff7481f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient(hunting): picked mon.noname-a con 0x7ff748155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:01.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff748156260 0x7ff748151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient(hunting): picked mon.noname-c con 0x7ff748156260 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480c4870 con 0x7ff748155e80 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480740a0 con 0x7ff748074cd0 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480c49f0 con 0x7ff748156260 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.185+0000 7ff74fc7c640 10 monclient(hunting): authenticate will time out at 1030.907833s 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.186+0000 7fae44f1d640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fae40152660 0x7fae4015a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55422/0 (socket says 10.20.193.10:55422) 2026-02-17T11:56:01.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.186+0000 7fae44f1d640 1 -- 10.20.193.10:0/1839499632 learned_addr learned my addr 10.20.193.10:0/1839499632 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:01.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.187+0000 7f2f077fe640 1 -- 10.20.193.10:0/2596376579 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f2f18041820 con 0x7f2f28156260 2026-02-17T11:56:01.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.187+0000 7f2f077fe640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2ef4078e50 0x7f2ef407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.187+0000 7f2f26d76640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2ef4078e50 0x7f2ef407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.187+0000 7f2f26d76640 10 monclient: get_auth_request con 0x7f2ef4078e50 auth_method 0 2026-02-17T11:56:01.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.187+0000 7f2f26d76640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2ef4078e50 0x7f2ef407b310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c006fd0 tx=0x7f2f1c006d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.187+0000 7f2f077fe640 10 client.4558.objecter ms_handle_connect 0x7f2ef4078e50 2026-02-17T11:56:01.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.189+0000 7f2f077fe640 1 -- 10.20.193.10:0/2596376579 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f2f18083b40 con 0x7f2f28156260 2026-02-17T11:56:01.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.189+0000 7f2f077fe640 10 client.4558.objecter ms_dispatch2 0x7f2f28000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.189+0000 7f2f077fe640 3 client.4558.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.189+0000 7f2f077fe640 3 client.4558.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.189+0000 7f2f077fe640 20 client.4558.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 1 -- 10.20.193.10:0/2538009481 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0046030 con 0x7f5dc0156260 2026-02-17T11:56:01.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 10 monclient: dump: 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 1 -- 10.20.193.10:0/2538009481 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db0041450 con 0x7f5dc0156260 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 5 monclient: authenticate success, global_id 4509 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 10 monclient: _renew_subs 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc01f5610 con 0x7f5dc0156260 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 1 -- 10.20.193.10:0/2538009481 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0037e60 con 0x7f5dc0156260 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5d9f7fe640 10 monclient: dump: 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.201 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dbd7fa640 4 set_mon_vals no callback set 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 10 client.4509.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 10 monclient: _renew_subs 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc01f5bd0 con 0x7f5dc0156260 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 1 librados: init done 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7fdc73fff640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc74156020 0x7fdc741f3a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc68036000 tx=0x7fdc68004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7fdc4ffff640 10 client.?.objecter ms_handle_connect 0x7fdc74156020 2026-02-17T11:56:01.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7fdc4ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.190+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc00745c0 con 0x7f5dc0156260 2026-02-17T11:56:01.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.191+0000 7fbad27fc640 1 -- 10.20.193.10:0/2982124969 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbae0061b80 con 0x7fbae4151f90 2026-02-17T11:56:01.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.191+0000 7fbad27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:56:01.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.191+0000 7fbad27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.204 INFO:teuthology.orchestra.run.trial010.stdout:103079215110 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 10 librados: watch_flush enter 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 10 librados: watch_flush exit 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 20 client.4497.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 10 client.4497.objecter successfully canceled tick 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbab4078e30 msgr2=0x7fbab407b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbab4078e30 0x7fbab407b2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbae415d120 tx=0x7fbad4033000 comp rx=0 tx=0).stop 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 10 monclient: shutdown 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbae4151f90 msgr2=0x7fbae40c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbae4151f90 0x7fbae40c3530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbae415c070 tx=0x7fbae000cef0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 shutdown_connections 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbab4078e30 0x7fbab407b2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbae4151f90 0x7fbae40c3530 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbae4151b10 0x7fbae40c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 --2- 10.20.193.10:0/2982124969 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbacc003bf0 0x7fbae41f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 >> 10.20.193.10:0/2982124969 conn(0x7fbae4074090 msgr2=0x7fbae415dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.193+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 shutdown_connections 2026-02-17T11:56:01.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.194+0000 7fbaec149640 1 -- 10.20.193.10:0/2982124969 wait complete. 2026-02-17T11:56:01.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.194+0000 7fbaec149640 1 librados: shutdown 2026-02-17T11:56:01.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.195+0000 7f2f077fe640 1 -- 10.20.193.10:0/2596376579 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2f18050030 con 0x7f2f28156260 2026-02-17T11:56:01.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.195+0000 7f2f077fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.195+0000 7f2f077fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.207 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.196+0000 7ff74d9f1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff748074cd0 0x7ff7481f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.207 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.197+0000 7ff74d9f1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff748074cd0 0x7ff7481f7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47464/0 (socket says 10.20.193.10:47464) 2026-02-17T11:56:01.207 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.197+0000 7ff74d9f1640 1 -- 10.20.193.10:0/1195252146 learned_addr learned my addr 10.20.193.10:0/1195252146 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.207 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.197+0000 7ff74d9f1640 10 monclient(hunting): get_auth_request con 0x7ff748074cd0 auth_method 0 2026-02-17T11:56:01.207 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.197+0000 7ff74d9f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.207 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.197+0000 7ff74d9f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.207 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.197+0000 7ff74d9f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.207 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.198+0000 7ff74d9f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.207 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.198+0000 7ff74d9f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.198+0000 7ff74d9f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 10 monclient(hunting): handle_auth_done global_id 4567 payload 824 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 1 -- 10.20.193.10:0/1195252146 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff748156260 msgr2=0x7ff748151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff748156260 0x7ff748151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 1 -- 10.20.193.10:0/1195252146 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff748155e80 msgr2=0x7ff7481f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff748155e80 0x7ff7481f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 1 monclient: found mon.noname-b 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7ff74d9f1640 1 -- 10.20.193.10:0/1195252146 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7481f4380 con 0x7ff748074cd0 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7f11f5ffb640 1 -- 10.20.193.10:0/2119997595 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f12040881b0 con 0x7f1208156260 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7f11f5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.201+0000 7f11f5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.208 INFO:teuthology.orchestra.run.trial010.stdout:120259084291 2026-02-17T11:56:01.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215110 got 103079215110 for osd.7 2026-02-17T11:56:01.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.203+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481515283 0 0) 0x7fae400c74c0 con 0x7fae400c6ce0 2026-02-17T11:56:01.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.203+0000 7fae377fe640 10 monclient(hunting): _negotiate 2026-02-17T11:56:01.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.203+0000 7fae377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.203+0000 7fae377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.203+0000 7fae377fe640 10 monclient(hunting): my global_id is 4570 2026-02-17T11:56:01.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.203+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae2c0058b0 con 0x7fae400c6ce0 2026-02-17T11:56:01.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.203+0000 7ff74d9f1640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff748074cd0 0x7ff7481f7ce0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff73800b570 tx=0x7ff73800ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.203+0000 7ff7367fc640 10 client.?.objecter ms_handle_connect 0x7ff748074cd0 2026-02-17T11:56:01.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.203+0000 7ff7367fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.210 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 10 librados: watch_flush enter 2026-02-17T11:56:01.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 10 librados: watch_flush exit 2026-02-17T11:56:01.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 20 client.4555.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 10 client.4555.objecter successfully canceled tick 2026-02-17T11:56:01.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f11d8078e00 msgr2=0x7f11d807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f11d8078e00 0x7f11d807b2c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f11f8006fd0 tx=0x7f11f8006d40 comp rx=0 tx=0).stop 2026-02-17T11:56:01.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 10 monclient: shutdown 2026-02-17T11:56:01.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 msgr2=0x7f12080ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 0x7f12080ca880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1204009e50 tx=0x7f1204004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 shutdown_connections 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f11d8078e00 0x7f11d807b2c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1208156260 0x7f12080ca880 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1208155e80 0x7f12080ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 --2- 10.20.193.10:0/2119997595 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1208074cd0 0x7f12081540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 >> 10.20.193.10:0/2119997595 conn(0x7f12080ce2b0 msgr2=0x7f12080cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 shutdown_connections 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 -- 10.20.193.10:0/2119997595 wait complete. 2026-02-17T11:56:01.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.204+0000 7f120f891640 1 librados: shutdown 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 997686534 0 0) 0x7fae2c0058b0 con 0x7fae400c6ce0 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 >> v1:10.20.193.153:6789/0 conn(0x7fae40152660 legacy=0x7fae4015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 >> v1:10.20.193.10:6789/0 conn(0x7fae4015b030 legacy=0x7fae400c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4015a120 con 0x7fae400c6ce0 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fae3c003280 con 0x7fae400c6ce0 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient: dump: 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.213 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 >> v1:10.20.193.71:6789/0 conn(0x7fae400c6ce0 legacy=0x7fae401631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c005e60 0x7fae2c006280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient(hunting): picked mon.b con 0x7fae2c005e60 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c006b90 0x7fae2c007010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient(hunting): picked mon.a con 0x7fae2c006b90 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c00bd40 0x7fae2c00e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient(hunting): picked mon.c con 0x7fae2c00bd40 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c00e720 con 0x7fae2c006b90 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c00e8d0 con 0x7fae2c005e60 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c00ead0 con 0x7fae2c00bd40 2026-02-17T11:56:01.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7fae377fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 1 -- 10.20.193.10:0/1195252146 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738013020 con 0x7ff748074cd0 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 10 monclient: dump: 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.215 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 1 -- 10.20.193.10:0/1195252146 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7380044a0 con 0x7ff748074cd0 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 1 -- 10.20.193.10:0/1195252146 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380029c0 con 0x7ff748074cd0 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff74fc7c640 5 monclient: authenticate success, global_id 4567 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff74fc7c640 10 monclient: _renew_subs 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff74fc7c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff737fff640 4 set_mon_vals no callback set 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7481f4660 con 0x7ff748074cd0 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff7367fc640 10 monclient: dump: 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.216 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff74fc7c640 10 client.4567.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff74fc7c640 10 monclient: _renew_subs 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff74fc7c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7481e75d0 con 0x7ff748074cd0 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.207+0000 7ff74fc7c640 1 librados: init done 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.208+0000 7fae44f1d640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c005e60 0x7fae2c006280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.208+0000 7ff74fc7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.208+0000 7ff74fc7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.208+0000 7ff74fc7c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.208+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7481e73c0 con 0x7ff748074cd0 2026-02-17T11:56:01.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.209+0000 7fae44f1d640 10 monclient(hunting): get_auth_request con 0x7fae2c005e60 auth_method 0 2026-02-17T11:56:01.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.209+0000 7fae44f1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.209+0000 7fae44f1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.209+0000 7fae44f1d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:01.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084291 for osd.13 2026-02-17T11:56:01.218 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.267+0000 7fc1ac6b7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:56:01.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.267+0000 7fc1ac6b7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:56:01.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.267+0000 7fc1ac6b7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.267+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7fc1a4072f60 con 0x7fc1a406f560 2026-02-17T11:56:01.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.267+0000 7f9fe86a0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:56:01.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.267+0000 7f9fe86a0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:56:01.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.267+0000 7f9fe86a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.267+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9fe00748f0 con 0x7f9fe0074cd0 2026-02-17T11:56:01.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.280+0000 7f2f2d185640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:56:01.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.280+0000 7f2f2d185640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:56:01.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.280+0000 7f2f2d185640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.280+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2f281597b0 con 0x7f2f28156260 2026-02-17T11:56:01.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.289+0000 7fbcd0ff9640 1 -- 10.20.193.10:0/1973197949 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbcc40613e0 con 0x7fbcd40c9d30 2026-02-17T11:56:01.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.289+0000 7fbcd0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:56:01.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.289+0000 7fbcd0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.292 INFO:teuthology.orchestra.run.trial010.stdout:115964117000 2026-02-17T11:56:01.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 10 librados: watch_flush enter 2026-02-17T11:56:01.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 10 librados: watch_flush exit 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 20 client.4547.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 10 client.4547.objecter successfully canceled tick 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbca4078e50 msgr2=0x7fbca407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbca4078e50 0x7fbca407b310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0039000 tx=0x7fbcc0031000 comp rx=0 tx=0).stop 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 10 monclient: shutdown 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd40c9d30 msgr2=0x7fbcd41f5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd40c9d30 0x7fbcd41f5900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400c4d0 tx=0x7fbcc400c9a0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 shutdown_connections 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbca4078e50 0x7fbca407b310 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbcd4156020 0x7fbcd41f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbcd40c9d30 0x7fbcd41f5900 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 --2- 10.20.193.10:0/1973197949 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbcd40c98f0 0x7fbcd415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 >> 10.20.193.10:0/1973197949 conn(0x7fbcd406d970 msgr2=0x7fbcd4073070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 shutdown_connections 2026-02-17T11:56:01.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 -- 10.20.193.10:0/1973197949 wait complete. 2026-02-17T11:56:01.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.291+0000 7fbcda8f1640 1 librados: shutdown 2026-02-17T11:56:01.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.296+0000 7f6f6affd640 1 -- 10.20.193.10:0/4288105178 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6f6c002ac0 con 0x7f6f84155e80 2026-02-17T11:56:01.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.296+0000 7f6f6affd640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6f50078e50 0x7f6f5007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.297+0000 7f6f82575640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6f50078e50 0x7f6f5007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.297+0000 7f6f82575640 10 monclient: get_auth_request con 0x7f6f50078e50 auth_method 0 2026-02-17T11:56:01.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.297+0000 7f6f6affd640 10 client.4571.objecter ms_handle_connect 0x7f6f50078e50 2026-02-17T11:56:01.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.297+0000 7f6f82575640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6f50078e50 0x7f6f5007b310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f8408f350 tx=0x7f6f78031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.297+0000 7f6f6affd640 1 -- 10.20.193.10:0/4288105178 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f6f6c05df40 con 0x7f6f84155e80 2026-02-17T11:56:01.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.297+0000 7f6f6affd640 10 client.4571.objecter ms_dispatch2 0x7f6f84000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.297+0000 7f6f6affd640 3 client.4571.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.297+0000 7f6f6affd640 3 client.4571.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.297+0000 7f6f6affd640 20 client.4571.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117000 got 115964117000 for osd.5 2026-02-17T11:56:01.302 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.302+0000 7f5d9f7fe640 1 -- 10.20.193.10:0/2538009481 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5db0041660 con 0x7f5dc0156260 2026-02-17T11:56:01.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.303+0000 7f5d9f7fe640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d8c078e00 0x7f5d8c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.303+0000 7f5dbeffd640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d8c078e00 0x7f5d8c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.303+0000 7f5dbeffd640 10 monclient: get_auth_request con 0x7f5d8c078e00 auth_method 0 2026-02-17T11:56:01.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.303+0000 7f5d9f7fe640 10 client.4509.objecter ms_handle_connect 0x7f5d8c078e00 2026-02-17T11:56:01.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.303+0000 7f5dbeffd640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d8c078e00 0x7f5d8c07b2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006fd0 tx=0x7f5db4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.305+0000 7f6f6affd640 1 -- 10.20.193.10:0/4288105178 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6f6c01d020 con 0x7f6f84155e80 2026-02-17T11:56:01.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.305+0000 7f6f6affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.305+0000 7f6f6affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.306+0000 7fae4571e640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c00bd40 0x7fae2c00e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.306+0000 7fae4571e640 10 monclient(hunting): get_auth_request con 0x7fae2c00bd40 auth_method 0 2026-02-17T11:56:01.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.306+0000 7fae4571e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.306+0000 7fae4571e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.306+0000 7fae4571e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:01.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.307+0000 7fae4571e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.307+0000 7fae4571e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.307+0000 7fae4571e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:01.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 10 monclient(hunting): handle_auth_done global_id 4570 payload 293 2026-02-17T11:56:01.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 1 -- 10.20.193.10:0/1839499632 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c005e60 msgr2=0x7fae2c006280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2c005e60 0x7fae2c006280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 1 -- 10.20.193.10:0/1839499632 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c006b90 msgr2=0x7fae2c007010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c006b90 0x7fae2c007010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 1 monclient: found mon.c 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 1 -- 10.20.193.10:0/1839499632 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c0058b0 con 0x7fae2c00bd40 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae471a8640 5 monclient: authenticate success, global_id 4570 2026-02-17T11:56:01.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae471a8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:01.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.310+0000 7fae4571e640 1 -- 10.20.193.10:0/1839499632 reap_dead start 2026-02-17T11:56:01.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.311+0000 7f9fc6ffd640 1 -- 10.20.193.10:0/3389063796 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9fe00748f0 con 0x7f9fe0074cd0 2026-02-17T11:56:01.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.311+0000 7f9fc6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:56:01.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.311+0000 7f9fc6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.315 INFO:teuthology.orchestra.run.trial010.stdout:94489280519 2026-02-17T11:56:01.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.312+0000 7f5d9f7fe640 1 -- 10.20.193.10:0/2538009481 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f5db00838e0 con 0x7f5dc0156260 2026-02-17T11:56:01.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.312+0000 7f5d9f7fe640 10 client.4509.objecter ms_dispatch2 0x7f5dc0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.312+0000 7f5d9f7fe640 3 client.4509.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.312+0000 7f5d9f7fe640 3 client.4509.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.312+0000 7f5d9f7fe640 20 client.4509.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.312+0000 7f5d9f7fe640 1 -- 10.20.193.10:0/2538009481 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5db0050070 con 0x7f5dc0156260 2026-02-17T11:56:01.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.312+0000 7f5d9f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.312+0000 7f5d9f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7fae4571e640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c00bd40 0x7fae2c00e130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00a810 tx=0x7fae3c02fbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1556246f3fb809d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 10 librados: watch_flush enter 2026-02-17T11:56:01.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 10 librados: watch_flush exit 2026-02-17T11:56:01.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 20 client.4565.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 10 client.4565.objecter successfully canceled tick 2026-02-17T11:56:01.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9fb0078e80 msgr2=0x7f9fb007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9fb0078e80 0x7f9fb007b340 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4006fd0 tx=0x7f9fd4006d40 comp rx=0 tx=0).stop 2026-02-17T11:56:01.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 10 monclient: shutdown 2026-02-17T11:56:01.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0074cd0 msgr2=0x7f9fe01e92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0074cd0 0x7f9fe01e92b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c730 tx=0x7f9fd000cc00 comp rx=0 tx=0).stop 2026-02-17T11:56:01.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 shutdown_connections 2026-02-17T11:56:01.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9fb0078e80 0x7f9fb007b340 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9fe0156260 0x7f9fe00c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9fe0155e80 0x7f9fe01e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 --2- 10.20.193.10:0/3389063796 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9fe0074cd0 0x7f9fe01e92b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 >> 10.20.193.10:0/3389063796 conn(0x7f9fe00ce2b0 msgr2=0x7f9fe0154700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 shutdown_connections 2026-02-17T11:56:01.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.313+0000 7f9fe86a0640 1 -- 10.20.193.10:0/3389063796 wait complete. 2026-02-17T11:56:01.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.314+0000 7f9fe86a0640 1 librados: shutdown 2026-02-17T11:56:01.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c00a430 con 0x7fae2c00bd40 2026-02-17T11:56:01.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 10 monclient: dump: 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3c031660 con 0x7fae2c00bd40 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 4 set_mon_vals no callback set 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 1 -- 10.20.193.10:0/1839499632 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c031a50 con 0x7fae2c00bd40 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae377fe640 10 monclient: dump: 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.323 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 10 monclient: shutdown 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 1 -- 10.20.193.10:0/1839499632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c00bd40 msgr2=0x7fae2c00e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c00bd40 0x7fae2c00e130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00a810 tx=0x7fae3c02fbd0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 1 -- 10.20.193.10:0/1839499632 shutdown_connections 2026-02-17T11:56:01.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 1 --2- 10.20.193.10:0/1839499632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae2c00bd40 0x7fae2c00e130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 1 -- 10.20.193.10:0/1839499632 >> 10.20.193.10:0/1839499632 conn(0x7fae400c9d80 msgr2=0x7fae400ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 1 -- 10.20.193.10:0/1839499632 shutdown_connections 2026-02-17T11:56:01.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.315+0000 7fae471a8640 1 -- 10.20.193.10:0/1839499632 wait complete. 2026-02-17T11:56:01.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7ff7367fc640 1 -- 10.20.193.10:0/1195252146 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7ff738002b60 con 0x7ff748074cd0 2026-02-17T11:56:01.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7fae471a8640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7fae471a8640 10 monclient: monmap: 2026-02-17T11:56:01.326 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.326 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:01.326 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:01.326 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7fae471a8640 1 librados: starting msgr at 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7fae471a8640 1 librados: starting objecter 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7fae471a8640 1 Processor -- start 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7fae471a8640 1 -- start start 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7fae471a8640 1 librados: setting wanted keys 2026-02-17T11:56:01.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7fae471a8640 1 librados: calling monclient init 2026-02-17T11:56:01.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.316+0000 7fae471a8640 10 monclient: init 2026-02-17T11:56:01.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7ff7367fc640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff718078e00 0x7ff71807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7ff74d1f0640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff718078e00 0x7ff71807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7ff74d1f0640 10 monclient: get_auth_request con 0x7ff718078e00 auth_method 0 2026-02-17T11:56:01.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:01.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c00bd40 0x7fae401f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient(hunting): picked mon.noname-a con 0x7fae2c00bd40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:01.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae4014bcf0 0x7fae401ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient(hunting): picked mon.noname-c con 0x7fae4014bcf0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae401edea0 0x7fae401f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient(hunting): picked mon.noname-b con 0x7fae401edea0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fae40152a40 con 0x7fae2c00bd40 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae400c77a0 con 0x7fae401edea0 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae40152bc0 con 0x7fae4014bcf0 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae471a8640 10 monclient(hunting): authenticate will time out at 1031.039436s 2026-02-17T11:56:01.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7ff7367fc640 10 client.4567.objecter ms_handle_connect 0x7ff718078e00 2026-02-17T11:56:01.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7ff74d1f0640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff718078e00 0x7ff71807b2c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff73c006fd0 tx=0x7ff73c006d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae37fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae4014bcf0 0x7fae401ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae37fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae4014bcf0 0x7fae401ed960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36148/0 (socket says 10.20.193.10:36148) 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.317+0000 7fae37fff640 1 -- 10.20.193.10:0/1821472197 learned_addr learned my addr 10.20.193.10:0/1821472197 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.318+0000 7fae37fff640 10 monclient(hunting): get_auth_request con 0x7fae4014bcf0 auth_method 0 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.318+0000 7fae37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.318+0000 7fae37fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.318+0000 7fae37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.318+0000 7fae37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.318+0000 7fae37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.318+0000 7fae37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7ff7367fc640 1 -- 10.20.193.10:0/1195252146 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7ff73805e0f0 con 0x7ff748074cd0 2026-02-17T11:56:01.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7ff7367fc640 10 client.4567.objecter ms_dispatch2 0x7ff748000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7ff7367fc640 3 client.4567.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7ff7367fc640 3 client.4567.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7ff7367fc640 20 client.4567.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 10 monclient(hunting): handle_auth_done global_id 4583 payload 824 2026-02-17T11:56:01.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 1 -- 10.20.193.10:0/1821472197 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae401edea0 msgr2=0x7fae401f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae401edea0 0x7fae401f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 1 -- 10.20.193.10:0/1821472197 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c00bd40 msgr2=0x7fae401f1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c00bd40 0x7fae401f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 1 monclient: found mon.noname-c 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.319+0000 7fae37fff640 1 -- 10.20.193.10:0/1821472197 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae401ee320 con 0x7fae4014bcf0 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.320+0000 7fae37fff640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae4014bcf0 0x7fae401ed960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b5a0 tx=0x7fae2800ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.320+0000 7fae357fa640 10 client.?.objecter ms_handle_connect 0x7fae4014bcf0 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.320+0000 7fae357fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 1 -- 10.20.193.10:0/1821472197 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28012070 con 0x7fae4014bcf0 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 10 monclient: dump: 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.335 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 1 -- 10.20.193.10:0/1821472197 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae28004500 con 0x7fae4014bcf0 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 1 -- 10.20.193.10:0/1821472197 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae280046b0 con 0x7fae4014bcf0 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae357fa640 10 monclient: dump: 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.336 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae36ffd640 4 set_mon_vals no callback set 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 5 monclient: authenticate success, global_id 4583 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 10 monclient: _renew_subs 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae401f15b0 con 0x7fae4014bcf0 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 10 client.4583.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 10 monclient: _renew_subs 2026-02-17T11:56:01.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae401f1b60 con 0x7fae4014bcf0 2026-02-17T11:56:01.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 1 librados: init done 2026-02-17T11:56:01.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.322+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae4015a920 con 0x7fae4014bcf0 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 1 -- 10.20.193.10:0/4293261586 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6803c050 con 0x7fdc74156020 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 10 monclient: dump: 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.339 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 1 -- 10.20.193.10:0/4293261586 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc68048070 con 0x7fdc74156020 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 1 -- 10.20.193.10:0/4293261586 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68041a50 con 0x7fdc74156020 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc79f11640 5 monclient: authenticate success, global_id 4512 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc79f11640 10 monclient: _renew_subs 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc71ffb640 4 set_mon_vals no callback set 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc79f11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc741f4500 con 0x7fdc74156020 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc4ffff640 10 monclient: dump: 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.340 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc79f11640 10 client.4512.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc79f11640 10 monclient: _renew_subs 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc79f11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7415d7d0 con 0x7fdc74156020 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fdc79f11640 1 librados: init done 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fc18affd640 1 -- 10.20.193.10:0/778343789 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fc194086d90 con 0x7fc1a406f560 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fc18affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:56:01.341 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.324+0000 7fc18affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.342 INFO:teuthology.orchestra.run.trial010.stdout:94489280518 2026-02-17T11:56:01.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.325+0000 7fdc79f11640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.325+0000 7fdc79f11640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.325+0000 7fdc79f11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.325+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc740ca860 con 0x7fdc74156020 2026-02-17T11:56:01.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280519 got 94489280519 for osd.0 2026-02-17T11:56:01.343 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.326+0000 7ff7367fc640 1 -- 10.20.193.10:0/1195252146 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff73801d020 con 0x7ff748074cd0 2026-02-17T11:56:01.343 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.326+0000 7ff7367fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.343 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.326+0000 7ff7367fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.343 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.326+0000 7fc1ac6b7640 10 librados: watch_flush enter 2026-02-17T11:56:01.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 10 librados: watch_flush exit 2026-02-17T11:56:01.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 20 client.4506.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 10 client.4506.objecter successfully canceled tick 2026-02-17T11:56:01.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc174078e50 msgr2=0x7fc17407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc174078e50 0x7fc17407b310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc1a414c7e0 tx=0x7fc198009240 comp rx=0 tx=0).stop 2026-02-17T11:56:01.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 10 monclient: shutdown 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc1a406f560 msgr2=0x7fc1a414de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc1a406f560 0x7fc1a414de20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4071380 tx=0x7fc1940047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 shutdown_connections 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc174078e50 0x7fc17407b310 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc1a415d5b0 0x7fc1a41f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1a4155d60 0x7fc1a41f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 --2- 10.20.193.10:0/778343789 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc1a406f560 0x7fc1a414de20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 >> 10.20.193.10:0/778343789 conn(0x7fc1a40cc020 msgr2=0x7fc1a4070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 shutdown_connections 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 -- 10.20.193.10:0/778343789 wait complete. 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.327+0000 7fc1ac6b7640 1 librados: shutdown 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.330+0000 7f2f077fe640 1 -- 10.20.193.10:0/2596376579 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2f18053390 con 0x7f2f28156260 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.330+0000 7f2f077fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:56:01.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.330+0000 7f2f077fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.346 INFO:teuthology.orchestra.run.trial010.stdout:115964117002 2026-02-17T11:56:01.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 10 librados: watch_flush enter 2026-02-17T11:56:01.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 10 librados: watch_flush exit 2026-02-17T11:56:01.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 20 client.4558.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 10 client.4558.objecter successfully canceled tick 2026-02-17T11:56:01.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2ef4078e50 msgr2=0x7f2ef407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2ef4078e50 0x7f2ef407b310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c006fd0 tx=0x7f2f1c006d40 comp rx=0 tx=0).stop 2026-02-17T11:56:01.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 10 monclient: shutdown 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 msgr2=0x7f2f281f6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 0x7f2f281f6710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2f18039040 tx=0x7f2f18004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 shutdown_connections 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2ef4078e50 0x7f2ef407b310 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2f28156260 0x7f2f281f6710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2f28155e80 0x7f2f281f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 --2- 10.20.193.10:0/2596376579 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2f28074cd0 0x7f2f28147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 >> 10.20.193.10:0/2596376579 conn(0x7f2f280ce2b0 msgr2=0x7f2f280cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 shutdown_connections 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 -- 10.20.193.10:0/2596376579 wait complete. 2026-02-17T11:56:01.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.332+0000 7f2f2d185640 1 librados: shutdown 2026-02-17T11:56:01.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.12 2026-02-17T11:56:01.348 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117002 got 115964117002 for osd.6 2026-02-17T11:56:01.348 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.353+0000 7fae357fa640 1 -- 10.20.193.10:0/1821472197 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fae28002a70 con 0x7fae4014bcf0 2026-02-17T11:56:01.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.354+0000 7fae357fa640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae10078e30 0x7fae1007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.354+0000 7fae44f1d640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae10078e30 0x7fae1007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.354+0000 7fae44f1d640 10 monclient: get_auth_request con 0x7fae10078e30 auth_method 0 2026-02-17T11:56:01.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.354+0000 7fae357fa640 10 client.4583.objecter ms_handle_connect 0x7fae10078e30 2026-02-17T11:56:01.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.354+0000 7fae44f1d640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae10078e30 0x7fae1007b2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae30007fd0 tx=0x7fae30007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.393+0000 7f6f88da7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:56:01.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.393+0000 7f6f88da7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:56:01.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.393+0000 7f6f88da7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.393+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f6f841597b0 con 0x7f6f84155e80 2026-02-17T11:56:01.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.399+0000 7f5dc52e8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:56:01.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.399+0000 7f5dc52e8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:56:01.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.399+0000 7f5dc52e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.399+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f5dc00d04a0 con 0x7f5dc0156260 2026-02-17T11:56:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.412+0000 7ff74fc7c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:56:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.412+0000 7ff74fc7c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:56:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.412+0000 7ff74fc7c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.412+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff7480745c0 con 0x7ff748074cd0 2026-02-17T11:56:01.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.414+0000 7ff7367fc640 1 -- 10.20.193.10:0/1195252146 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff7380627b0 con 0x7ff748074cd0 2026-02-17T11:56:01.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.414+0000 7ff7367fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:56:01.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.414+0000 7ff7367fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.417 INFO:teuthology.orchestra.run.trial010.stdout:115964116999 2026-02-17T11:56:01.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 10 librados: watch_flush enter 2026-02-17T11:56:01.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 10 librados: watch_flush exit 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 20 client.4567.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 10 client.4567.objecter successfully canceled tick 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff718078e00 msgr2=0x7ff71807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff718078e00 0x7ff71807b2c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff73c006fd0 tx=0x7ff73c006d40 comp rx=0 tx=0).stop 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 10 monclient: shutdown 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff748074cd0 msgr2=0x7ff7481f7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff748074cd0 0x7ff7481f7ce0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff73800b570 tx=0x7ff73800ba40 comp rx=0 tx=0).stop 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 shutdown_connections 2026-02-17T11:56:01.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff718078e00 0x7ff71807b2c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff748156260 0x7ff748151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff748155e80 0x7ff7481f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 --2- 10.20.193.10:0/1195252146 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff748074cd0 0x7ff7481f7ce0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 >> 10.20.193.10:0/1195252146 conn(0x7ff7480ce2b0 msgr2=0x7ff7480d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 shutdown_connections 2026-02-17T11:56:01.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 -- 10.20.193.10:0/1195252146 wait complete. 2026-02-17T11:56:01.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.415+0000 7ff74fc7c640 1 librados: shutdown 2026-02-17T11:56:01.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116999 got 115964116999 for osd.1 2026-02-17T11:56:01.426 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.438 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.436+0000 7fae357fa640 1 -- 10.20.193.10:0/1821472197 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fae28002d90 con 0x7fae4014bcf0 2026-02-17T11:56:01.438 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.436+0000 7fae357fa640 10 client.4583.objecter ms_dispatch2 0x7fae40000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.438 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.436+0000 7fae357fa640 3 client.4583.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.438 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.436+0000 7fae357fa640 3 client.4583.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.436+0000 7fae357fa640 20 client.4583.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.439+0000 7fdc4ffff640 1 -- 10.20.193.10:0/4293261586 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fdc68041bf0 con 0x7fdc74156020 2026-02-17T11:56:01.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.439+0000 7fdc4ffff640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc44078e50 0x7fdc4407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.440+0000 7fdc737fe640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc44078e50 0x7fdc4407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.440+0000 7fdc737fe640 10 monclient: get_auth_request con 0x7fdc44078e50 auth_method 0 2026-02-17T11:56:01.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.440+0000 7fdc737fe640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc44078e50 0x7fdc4407b310 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdc60007c20 tx=0x7fdc60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.440+0000 7fdc4ffff640 10 client.4512.objecter ms_handle_connect 0x7fdc44078e50 2026-02-17T11:56:01.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.442+0000 7fae357fa640 1 -- 10.20.193.10:0/1821472197 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fae401ee320 con 0x7fae4014bcf0 2026-02-17T11:56:01.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.442+0000 7fae357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.442+0000 7fae357fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.448 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.447+0000 7f6f6affd640 1 -- 10.20.193.10:0/4288105178 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6f6c062600 con 0x7f6f84155e80 2026-02-17T11:56:01.449 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.447+0000 7f6f6affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:56:01.449 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.447+0000 7f6f6affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.449 INFO:teuthology.orchestra.run.trial010.stdout:107374182405 2026-02-17T11:56:01.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.448+0000 7fdc4ffff640 1 -- 10.20.193.10:0/4293261586 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fdc68084570 con 0x7fdc74156020 2026-02-17T11:56:01.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.448+0000 7fdc4ffff640 10 client.4512.objecter ms_dispatch2 0x7fdc74000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.448+0000 7fdc4ffff640 3 client.4512.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.448+0000 7fdc4ffff640 3 client.4512.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.448+0000 7fdc4ffff640 20 client.4512.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.448+0000 7fdc4ffff640 1 -- 10.20.193.10:0/4293261586 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdc740ca860 con 0x7fdc74156020 2026-02-17T11:56:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.448+0000 7fdc4ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.448+0000 7fdc4ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 10 librados: watch_flush enter 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 10 librados: watch_flush exit 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 20 client.4571.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 10 client.4571.objecter successfully canceled tick 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6f50078e50 msgr2=0x7f6f5007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6f50078e50 0x7f6f5007b310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f8408f350 tx=0x7f6f78031000 comp rx=0 tx=0).stop 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 10 monclient: shutdown 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 msgr2=0x7f6f84156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 0x7f6f84156680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00b530 tx=0x7f6f6c00ba00 comp rx=0 tx=0).stop 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 shutdown_connections 2026-02-17T11:56:01.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6f50078e50 0x7f6f5007b310 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6f84156260 0x7f6f840c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f84155e80 0x7f6f84156680 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 --2- 10.20.193.10:0/4288105178 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6f840ccbc0 0x7f6f84144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 >> 10.20.193.10:0/4288105178 conn(0x7f6f840ce2b0 msgr2=0x7f6f841516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 shutdown_connections 2026-02-17T11:56:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 -- 10.20.193.10:0/4288105178 wait complete. 2026-02-17T11:56:01.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.449+0000 7f6f88da7640 1 librados: shutdown 2026-02-17T11:56:01.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.456+0000 7f5d9f7fe640 1 -- 10.20.193.10:0/2538009481 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5db0087fa0 con 0x7f5dc0156260 2026-02-17T11:56:01.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.456+0000 7f5d9f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:56:01.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.456+0000 7f5d9f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.459 INFO:teuthology.orchestra.run.trial010.stdout:120259084294 2026-02-17T11:56:01.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182405 got 107374182405 for osd.15 2026-02-17T11:56:01.460 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 10 librados: watch_flush enter 2026-02-17T11:56:01.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 10 librados: watch_flush exit 2026-02-17T11:56:01.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 20 client.4509.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 10 client.4509.objecter successfully canceled tick 2026-02-17T11:56:01.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d8c078e00 msgr2=0x7f5d8c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d8c078e00 0x7f5d8c07b2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006fd0 tx=0x7f5db4008040 comp rx=0 tx=0).stop 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 10 monclient: shutdown 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5dc0156260 msgr2=0x7f5dc0144ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5dc0156260 0x7f5dc0144ae0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5db0035000 tx=0x7f5db0004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 shutdown_connections 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d8c078e00 0x7f5d8c07b2c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5dc0156260 0x7f5dc0144ae0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5dc0155e80 0x7f5dc00c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 --2- 10.20.193.10:0/2538009481 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5dc0074cd0 0x7f5dc00c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 >> 10.20.193.10:0/2538009481 conn(0x7f5dc00ce2b0 msgr2=0x7f5dc00d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 shutdown_connections 2026-02-17T11:56:01.464 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 -- 10.20.193.10:0/2538009481 wait complete. 2026-02-17T11:56:01.464 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.459+0000 7f5dc52e8640 1 librados: shutdown 2026-02-17T11:56:01.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084294 for osd.14 2026-02-17T11:56:01.470 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.527+0000 7fae471a8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:56:01.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.527+0000 7fae471a8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:56:01.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.527+0000 7fae471a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:01.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.527+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fae4014f8a0 con 0x7fae4014bcf0 2026-02-17T11:56:01.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.530+0000 7fae357fa640 1 -- 10.20.193.10:0/1821472197 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fae28062080 con 0x7fae4014bcf0 2026-02-17T11:56:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.530+0000 7fae357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:56:01.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.530+0000 7fae357fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.532 INFO:teuthology.orchestra.run.trial010.stdout:115964117001 2026-02-17T11:56:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 10 librados: watch_flush enter 2026-02-17T11:56:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 10 librados: watch_flush exit 2026-02-17T11:56:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 20 client.4583.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 10 client.4583.objecter successfully canceled tick 2026-02-17T11:56:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae10078e30 msgr2=0x7fae1007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae10078e30 0x7fae1007b2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae30007fd0 tx=0x7fae30007ca0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 10 monclient: shutdown 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae4014bcf0 msgr2=0x7fae401ed960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae4014bcf0 0x7fae401ed960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b5a0 tx=0x7fae2800ba70 comp rx=0 tx=0).stop 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 shutdown_connections 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae10078e30 0x7fae1007b2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae401edea0 0x7fae401f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae4014bcf0 0x7fae401ed960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 --2- 10.20.193.10:0/1821472197 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2c00bd40 0x7fae401f1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 >> 10.20.193.10:0/1821472197 conn(0x7fae400c9d80 msgr2=0x7fae4006b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 shutdown_connections 2026-02-17T11:56:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 -- 10.20.193.10:0/1821472197 wait complete. 2026-02-17T11:56:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.532+0000 7fae471a8640 1 librados: shutdown 2026-02-17T11:56:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.533+0000 7fdc79f11640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:56:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.533+0000 7fdc79f11640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:56:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.533+0000 7fdc79f11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.533+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fdc740cb590 con 0x7fdc74156020 2026-02-17T11:56:01.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.536+0000 7fdc4ffff640 1 -- 10.20.193.10:0/4293261586 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdc68088c30 con 0x7fdc74156020 2026-02-17T11:56:01.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.536+0000 7fdc4ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:56:01.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.536+0000 7fdc4ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:01.538 INFO:teuthology.orchestra.run.trial010.stdout:115964116999 2026-02-17T11:56:01.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 10 librados: watch_flush enter 2026-02-17T11:56:01.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 10 librados: watch_flush exit 2026-02-17T11:56:01.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 20 client.4512.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 10 client.4512.objecter successfully canceled tick 2026-02-17T11:56:01.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc44078e50 msgr2=0x7fdc4407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc44078e50 0x7fdc4407b310 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdc60007c20 tx=0x7fdc60009040 comp rx=0 tx=0).stop 2026-02-17T11:56:01.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 10 monclient: shutdown 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc74156020 msgr2=0x7fdc741f3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc74156020 0x7fdc741f3a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc68036000 tx=0x7fdc68004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 shutdown_connections 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc44078e50 0x7fdc4407b310 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdc74156020 0x7fdc741f3a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdc740c9d30 0x7fdc740d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 --2- 10.20.193.10:0/4293261586 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdc740c98f0 0x7fdc741f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 >> 10.20.193.10:0/4293261586 conn(0x7fdc7406d970 msgr2=0x7fdc7406dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 shutdown_connections 2026-02-17T11:56:01.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 -- 10.20.193.10:0/4293261586 wait complete. 2026-02-17T11:56:01.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.539+0000 7fdc79f11640 1 librados: shutdown 2026-02-17T11:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117001 for osd.10 2026-02-17T11:56:01.544 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116999 got 115964116999 for osd.9 2026-02-17T11:56:01.549 DEBUG:teuthology.parallel:result is None 2026-02-17T11:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:56:01.549 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.654+0000 7efe57d5e640 10 monclient: get_monmap_and_config 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.654+0000 7efe57d5e640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.654+0000 7efe57d5e640 10 monclient: monmap: 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:01.655390+0000 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:01.655390+0000 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:01.656 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.654+0000 7efe57d5e640 1 Processor -- start 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.654+0000 7efe57d5e640 1 -- start start 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.654+0000 7efe57d5e640 10 monclient: init 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 10 monclient: _add_conns ranks=[3,1,2,5,4,0] 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7efe5015d220 0x7efe5015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 10 monclient(hunting): picked mon.noname-a con 0x7efe5015d220 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7efe50074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7efe500c92f0 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe500c58a0 con 0x7efe50074920 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe500c55c0 con 0x7efe500c92f0 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7efe500c7e20 con 0x7efe5015d220 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe57d5e640 10 monclient(hunting): authenticate will time out at 1031.377096s 2026-02-17T11:56:01.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe552d2640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7efe50074920 0x7efe500c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:58128/0 (socket says 10.20.193.10:58128) 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe552d2640 1 -- 10.20.193.10:0/99333185 learned_addr learned my addr 10.20.193.10:0/99333185 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe55ad3640 1 --2- 10.20.193.10:0/99333185 >> v2:10.20.193.10:3300/0 conn(0x7efe5015d220 0x7efe5015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe55ad3640 10 monclient(hunting): get_auth_request con 0x7efe5015d220 auth_method 0 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe55ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe55ad3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.656+0000 7efe55ad3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.657+0000 7efe55ad3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.657+0000 7efe55ad3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.657+0000 7efe55ad3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe55ad3640 10 monclient(hunting): handle_auth_done global_id 4515 payload 274 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe55ad3640 1 -- 10.20.193.10:0/99333185 >> v1:10.20.193.153:6789/0 conn(0x7efe500c92f0 legacy=0x7efe50153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe55ad3640 1 -- 10.20.193.10:0/99333185 >> v1:10.20.193.71:6789/0 conn(0x7efe50074920 legacy=0x7efe500c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe55ad3640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe55ad3640 1 monclient: found mon.noname-a 2026-02-17T11:56:01.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe54ad1640 1 -- 10.20.193.10:0/99333185 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087192702 0 0) 0x7efe500c58a0 con 0x7efe50074920 2026-02-17T11:56:01.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe55ad3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe55ad3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe55ad3640 1 -- 10.20.193.10:0/99333185 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe500c8100 con 0x7efe5015d220 2026-02-17T11:56:01.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.658+0000 7efe54ad1640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T11:56:01.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.659+0000 7efe55ad3640 1 --2- 10.20.193.10:0/99333185 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe5015d220 0x7efe5015d600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe400098d0 tx=0x7efe4002ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac5bc08cc641470 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 1 -- 10.20.193.10:0/99333185 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4003c070 con 0x7efe5015d220 2026-02-17T11:56:01.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:01.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 10 monclient: dump: 2026-02-17T11:56:01.666 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.666 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.666 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.666 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.666 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.666 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 1 -- 10.20.193.10:0/99333185 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4002fb60 con 0x7efe5015d220 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 1 -- 10.20.193.10:0/99333185 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40037440 con 0x7efe5015d220 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe57d5e640 5 monclient: authenticate success, global_id 4515 2026-02-17T11:56:01.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe57d5e640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe57d5e640 4 set_mon_vals no callback set 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.660+0000 7efe54ad1640 10 monclient: dump: 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.668 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 10 monclient: shutdown 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 -- 10.20.193.10:0/99333185 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe5015d220 msgr2=0x7efe5015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 --2- 10.20.193.10:0/99333185 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe5015d220 0x7efe5015d600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe400098d0 tx=0x7efe4002ee90 comp rx=0 tx=0).stop 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 -- 10.20.193.10:0/99333185 shutdown_connections 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 --2- 10.20.193.10:0/99333185 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe5015d220 0x7efe5015d600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 -- 10.20.193.10:0/99333185 >> 10.20.193.10:0/99333185 conn(0x7efe500c9d80 msgr2=0x7efe500ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 -- 10.20.193.10:0/99333185 shutdown_connections 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 -- 10.20.193.10:0/99333185 wait complete. 2026-02-17T11:56:01.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 10 monclient: monmap: 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 librados: starting msgr at 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 librados: starting objecter 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 Processor -- start 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 -- start start 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 librados: setting wanted keys 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 1 librados: calling monclient init 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.661+0000 7efe57d5e640 10 monclient: init 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe50074920 0x7efe5015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient(hunting): picked mon.noname-b con 0x7efe50074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe500c92f0 0x7efe501f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient(hunting): picked mon.noname-a con 0x7efe500c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:01.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efe5015d220 0x7efe5015adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient(hunting): picked mon.noname-c con 0x7efe5015d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7efe50074d70 con 0x7efe500c92f0 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7efe500c86c0 con 0x7efe50074920 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe50153d60 con 0x7efe5015d220 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe57d5e640 10 monclient(hunting): authenticate will time out at 1031.383291s 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe55ad3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe50074920 0x7efe5015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe55ad3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe50074920 0x7efe5015c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:47482/0 (socket says 10.20.193.10:47482) 2026-02-17T11:56:01.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe55ad3640 1 -- 10.20.193.10:0/1456228713 learned_addr learned my addr 10.20.193.10:0/1456228713 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe55ad3640 10 monclient(hunting): get_auth_request con 0x7efe50074920 auth_method 0 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe55ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe55ad3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe55ad3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.662+0000 7efe562d4640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efe5015d220 0x7efe5015adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe562d4640 10 monclient(hunting): get_auth_request con 0x7efe5015d220 auth_method 0 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe562d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe562d4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe562d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe55ad3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe55ad3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe55ad3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe562d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe562d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.663+0000 7efe562d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 10 monclient(hunting): handle_auth_done global_id 4576 payload 824 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 1 -- 10.20.193.10:0/1456228713 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efe5015d220 msgr2=0x7efe5015adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efe5015d220 0x7efe5015adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 1 -- 10.20.193.10:0/1456228713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe500c92f0 msgr2=0x7efe501f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe500c92f0 0x7efe501f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 1 monclient: found mon.noname-b 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.664+0000 7efe55ad3640 1 -- 10.20.193.10:0/1456228713 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5015b650 con 0x7efe50074920 2026-02-17T11:56:01.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.665+0000 7efe55ad3640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe50074920 0x7efe5015c990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe40009130 tx=0x7efe400047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.665+0000 7efe3e7fc640 10 client.?.objecter ms_handle_connect 0x7efe50074920 2026-02-17T11:56:01.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.665+0000 7efe3e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 1 -- 10.20.193.10:0/1456228713 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4003c040 con 0x7efe50074920 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 10 monclient: dump: 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.677 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 5 monclient: authenticate success, global_id 4576 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 10 monclient: _renew_subs 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5015b930 con 0x7efe50074920 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 10 client.4576.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 10 monclient: _renew_subs 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe50157a80 con 0x7efe50074920 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 1 librados: init done 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 1 -- 10.20.193.10:0/1456228713 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4002fb60 con 0x7efe50074920 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 1 -- 10.20.193.10:0/1456228713 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40041670 con 0x7efe50074920 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3e7fc640 10 monclient: dump: 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.679 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe3ffff640 4 set_mon_vals no callback set 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:01.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.667+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe5015d600 con 0x7efe50074920 2026-02-17T11:56:01.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.774+0000 7efe3e7fc640 1 -- 10.20.193.10:0/1456228713 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7efe40041810 con 0x7efe50074920 2026-02-17T11:56:01.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.774+0000 7efe3e7fc640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efe20078e00 0x7efe2007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.774+0000 7efe552d2640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efe20078e00 0x7efe2007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.774+0000 7efe552d2640 10 monclient: get_auth_request con 0x7efe20078e00 auth_method 0 2026-02-17T11:56:01.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.775+0000 7efe3e7fc640 10 client.4576.objecter ms_handle_connect 0x7efe20078e00 2026-02-17T11:56:01.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.775+0000 7efe552d2640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efe20078e00 0x7efe2007b2c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe501ef5b0 tx=0x7efe440079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.776+0000 7efe3e7fc640 1 -- 10.20.193.10:0/1456228713 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7efe400bce40 con 0x7efe50074920 2026-02-17T11:56:01.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.776+0000 7efe3e7fc640 10 client.4576.objecter ms_dispatch2 0x7efe50000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:01.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.776+0000 7efe3e7fc640 3 client.4576.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:01.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.776+0000 7efe3e7fc640 3 client.4576.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:01.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.776+0000 7efe3e7fc640 20 client.4576.objecter dump_active .. 0 homeless 2026-02-17T11:56:01.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.782+0000 7efe3e7fc640 1 -- 10.20.193.10:0/1456228713 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efe40087d70 con 0x7efe50074920 2026-02-17T11:56:01.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.782+0000 7efe3e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.782+0000 7efe3e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:01.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.864+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe500c5130 con 0x7efe20078e00 2026-02-17T11:56:01.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.865+0000 7efe3e7fc640 1 -- 10.20.193.10:0/1456228713 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44548 (secure 0 0 0) 0x7efe500c5130 con 0x7efe20078e00 2026-02-17T11:56:01.867 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:01.869 INFO:teuthology.orchestra.run.trial010.stderr:dumped all 2026-02-17T11:56:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 10 librados: watch_flush enter 2026-02-17T11:56:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 10 librados: watch_flush exit 2026-02-17T11:56:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 20 client.4576.objecter shutdown clearing up homeless session... 2026-02-17T11:56:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 10 client.4576.objecter successfully canceled tick 2026-02-17T11:56:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efe20078e00 msgr2=0x7efe2007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efe20078e00 0x7efe2007b2c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe501ef5b0 tx=0x7efe440079d0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 10 monclient: shutdown 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe50074920 msgr2=0x7efe5015c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe50074920 0x7efe5015c990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe40009130 tx=0x7efe400047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 shutdown_connections 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efe20078e00 0x7efe2007b2c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efe5015d220 0x7efe5015adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe500c92f0 0x7efe501f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 --2- 10.20.193.10:0/1456228713 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe50074920 0x7efe5015c990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 >> 10.20.193.10:0/1456228713 conn(0x7efe500c9d80 msgr2=0x7efe5014e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 shutdown_connections 2026-02-17T11:56:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 -- 10.20.193.10:0/1456228713 wait complete. 2026-02-17T11:56:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.866+0000 7efe57d5e640 1 librados: shutdown 2026-02-17T11:56:01.875 INFO:teuthology.orchestra.run.trial010.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2026-02-17T11:56:01.767082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438032,"kb_used_data":6536,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511408,"statfs":{"total":1546188226560,"available":1545739681792,"internally_reserved":0,"allocated":6692864,"data_stored":3314964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25500,"internal_metadata":441424996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.506621"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.532493+0000","last_change":"2026-02-17T11:55:57.532493+0000","last_active":"2026-02-17T11:55:57.532493+0000","last_peered":"2026-02-17T11:55:57.532493+0000","last_clean":"2026-02-17T11:55:57.532493+0000","last_became_active":"2026-02-17T11:55:55.658594+0000","last_became_peered":"2026-02-17T11:55:55.658594+0000","last_unstale":"2026-02-17T11:55:57.532493+0000","last_undegraded":"2026-02-17T11:55:57.532493+0000","last_fullsized":"2026-02-17T11:55:57.532493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:26:38.378508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042345316000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.565000+0000","last_change":"2026-02-17T11:55:57.587525+0000","last_active":"2026-02-17T11:55:57.565000+0000","last_peered":"2026-02-17T11:55:57.565000+0000","last_clean":"2026-02-17T11:55:57.565000+0000","last_became_active":"2026-02-17T11:55:55.781344+0000","last_became_peered":"2026-02-17T11:55:55.781344+0000","last_unstale":"2026-02-17T11:55:57.565000+0000","last_undegraded":"2026-02-17T11:55:57.565000+0000","last_fullsized":"2026-02-17T11:55:57.565000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:52.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037397883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.503086+0000","last_change":"2026-02-17T11:55:57.503086+0000","last_active":"2026-02-17T11:55:57.503086+0000","last_peered":"2026-02-17T11:55:57.503086+0000","last_clean":"2026-02-17T11:55:57.503086+0000","last_became_active":"2026-02-17T11:55:55.451241+0000","last_became_peered":"2026-02-17T11:55:55.451241+0000","last_unstale":"2026-02-17T11:55:57.503086+0000","last_undegraded":"2026-02-17T11:55:57.503086+0000","last_fullsized":"2026-02-17T11:55:57.503086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:35:03.971846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037882574000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.580958+0000","last_change":"2026-02-17T11:55:57.580958+0000","last_active":"2026-02-17T11:55:57.580958+0000","last_peered":"2026-02-17T11:55:57.580958+0000","last_clean":"2026-02-17T11:55:57.580958+0000","last_became_active":"2026-02-17T11:55:55.648482+0000","last_became_peered":"2026-02-17T11:55:55.648482+0000","last_unstale":"2026-02-17T11:55:57.580958+0000","last_undegraded":"2026-02-17T11:55:57.580958+0000","last_fullsized":"2026-02-17T11:55:57.580958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:44:03.363850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037738756999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.569398+0000","last_change":"2026-02-17T11:55:57.569398+0000","last_active":"2026-02-17T11:55:57.569398+0000","last_peered":"2026-02-17T11:55:57.569398+0000","last_clean":"2026-02-17T11:55:57.569398+0000","last_became_active":"2026-02-17T11:55:55.640831+0000","last_became_peered":"2026-02-17T11:55:55.640831+0000","last_unstale":"2026-02-17T11:55:57.569398+0000","last_undegraded":"2026-02-17T11:55:57.569398+0000","last_fullsized":"2026-02-17T11:55:57.569398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:53:48.237641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056907020000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,12],"acting":[2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.559248+0000","last_change":"2026-02-17T11:55:57.578304+0000","last_active":"2026-02-17T11:55:57.559248+0000","last_peered":"2026-02-17T11:55:57.559248+0000","last_clean":"2026-02-17T11:55:57.559248+0000","last_became_active":"2026-02-17T11:55:55.453952+0000","last_became_peered":"2026-02-17T11:55:55.453952+0000","last_unstale":"2026-02-17T11:55:57.559248+0000","last_undegraded":"2026-02-17T11:55:57.559248+0000","last_fullsized":"2026-02-17T11:55:57.559248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:34:50.379105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034638460000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.539100+0000","last_change":"2026-02-17T11:55:57.561696+0000","last_active":"2026-02-17T11:55:57.539100+0000","last_peered":"2026-02-17T11:55:57.539100+0000","last_clean":"2026-02-17T11:55:57.539100+0000","last_became_active":"2026-02-17T11:55:55.508618+0000","last_became_peered":"2026-02-17T11:55:55.508618+0000","last_unstale":"2026-02-17T11:55:57.539100+0000","last_undegraded":"2026-02-17T11:55:57.539100+0000","last_fullsized":"2026-02-17T11:55:57.539100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:29:21.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055960348,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"32'1","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.580322+0000","last_change":"2026-02-17T11:55:57.580322+0000","last_active":"2026-02-17T11:55:57.580322+0000","last_peered":"2026-02-17T11:55:57.580322+0000","last_clean":"2026-02-17T11:55:57.580322+0000","last_became_active":"2026-02-17T11:55:55.408633+0000","last_became_peered":"2026-02-17T11:55:55.408633+0000","last_unstale":"2026-02-17T11:55:57.580322+0000","last_undegraded":"2026-02-17T11:55:57.580322+0000","last_fullsized":"2026-02-17T11:55:57.580322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:37:04.068558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027166316999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"29'32","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.543067+0000","last_change":"2026-02-17T11:55:50.153568+0000","last_active":"2026-02-17T11:55:57.543067+0000","last_peered":"2026-02-17T11:55:57.543067+0000","last_clean":"2026-02-17T11:55:57.543067+0000","last_became_active":"2026-02-17T11:55:49.807188+0000","last_became_peered":"2026-02-17T11:55:49.807188+0000","last_unstale":"2026-02-17T11:55:57.543067+0000","last_undegraded":"2026-02-17T11:55:57.543067+0000","last_fullsized":"2026-02-17T11:55:57.543067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_clean_scrub_stamp":"2026-02-17T11:55:42.183447+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:38:58.356098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[2,4,5,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":28,"seq":120259084292,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,5,6,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":28,"seq":120259084294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313224,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":372736,"data_stored":158068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":22,"seq":94489280519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247813,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":372736,"data_stored":158068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,6,7,8,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":25,"seq":107374182406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,4,5,6,7,8,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":24,"seq":103079215110,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":24,"seq":103079215110,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":770048,"data_stored":555889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[2,4,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":27,"seq":115964116999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":352256,"data_stored":148511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,5,6,7,8,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,3,5,6,7,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":27,"seq":115964117000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":770048,"data_stored":555889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":27,"seq":115964117002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":27,"seq":115964116999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,2,4,6,7,8,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":27,"seq":115964117001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,2,3,4,5,7,9,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:56:01.877 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:56:01.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.944+0000 7f6a18de6640 10 monclient: get_monmap_and_config 2026-02-17T11:56:01.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.944+0000 7f6a18de6640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.944+0000 7f6a18de6640 10 monclient: monmap: 2026-02-17T11:56:01.946 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.946 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.946 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:01.944723+0000 2026-02-17T11:56:01.946 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:01.944723+0000 2026-02-17T11:56:01.946 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.946 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.944+0000 7f6a18de6640 1 Processor -- start 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.944+0000 7f6a18de6640 1 -- start start 2026-02-17T11:56:01.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.944+0000 7f6a18de6640 10 monclient: init 2026-02-17T11:56:01.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 10 monclient: _add_conns ranks=[2,3,5,0,1,4] 2026-02-17T11:56:01.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6a1415d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:01.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f6a140c92f0 0x7f6a1415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 10 monclient(hunting): picked mon.noname-a con 0x7f6a140c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6a14074920 0x7f6a14153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 10 monclient(hunting): picked mon.noname-c con 0x7f6a14074920 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a140c58a0 con 0x7f6a1415d220 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f6a140c55c0 con 0x7f6a140c92f0 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6a140c7e20 con 0x7f6a14074920 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a18de6640 10 monclient(hunting): authenticate will time out at 1031.666399s 2026-02-17T11:56:01.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a11d74640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f6a140c92f0 0x7f6a1415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.945+0000 7f6a12d76640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6a14074920 0x7f6a14153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a12575640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f6a1415d220 0x7f6a140c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:55438/0 (socket says 10.20.193.10:55438) 2026-02-17T11:56:01.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a12575640 1 -- 10.20.193.10:0/1892423046 learned_addr learned my addr 10.20.193.10:0/1892423046 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:01.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a11d74640 10 monclient(hunting): get_auth_request con 0x7f6a140c92f0 auth_method 0 2026-02-17T11:56:01.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a11d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a11d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a11d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a12d76640 10 monclient(hunting): get_auth_request con 0x7f6a14074920 auth_method 0 2026-02-17T11:56:01.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a12d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a12d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a12d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a11d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a11d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a11d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a12d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a12d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.946+0000 7f6a12d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.947+0000 7f6a11d74640 10 monclient(hunting): handle_auth_done global_id 4518 payload 274 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.947+0000 7f6a11d74640 1 -- 10.20.193.10:0/1892423046 >> v2:10.20.193.153:3300/0 conn(0x7f6a14074920 msgr2=0x7f6a14153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.947+0000 7f6a11d74640 1 --2- 10.20.193.10:0/1892423046 >> v2:10.20.193.153:3300/0 conn(0x7f6a14074920 0x7f6a14153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.947+0000 7f6a11d74640 1 -- 10.20.193.10:0/1892423046 >> v1:10.20.193.153:6789/0 conn(0x7f6a1415d220 legacy=0x7f6a140c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.947+0000 7f6a11d74640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.947+0000 7f6a11d74640 1 monclient: found mon.noname-a 2026-02-17T11:56:01.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.947+0000 7f6a11d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.947+0000 7f6a11d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.947+0000 7f6a11d74640 1 -- 10.20.193.10:0/1892423046 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a140c8100 con 0x7f6a140c92f0 2026-02-17T11:56:01.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.948+0000 7f6a11d74640 1 --2- 10.20.193.10:0/1892423046 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a140c92f0 0x7f6a1415d600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0098a0 tx=0x7f69fc02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da638a9a10b64f04 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 1 -- 10.20.193.10:0/1892423046 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc03c070 con 0x7f6a140c92f0 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 10 monclient: dump: 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 1 -- 10.20.193.10:0/1892423046 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc02fae0 con 0x7f6a140c92f0 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 1 -- 10.20.193.10:0/1892423046 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc037440 con 0x7f6a140c92f0 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a11573640 10 monclient: dump: 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.959 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 5 monclient: authenticate success, global_id 4518 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 4 set_mon_vals no callback set 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 10 monclient: shutdown 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 1 -- 10.20.193.10:0/1892423046 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a140c92f0 msgr2=0x7f6a1415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 1 --2- 10.20.193.10:0/1892423046 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a140c92f0 0x7f6a1415d600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0098a0 tx=0x7f69fc02ee10 comp rx=0 tx=0).stop 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 1 -- 10.20.193.10:0/1892423046 shutdown_connections 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 1 --2- 10.20.193.10:0/1892423046 >> v2:10.20.193.153:3300/0 conn(0x7f6a14074920 0x7f6a14153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 1 --2- 10.20.193.10:0/1892423046 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a140c92f0 0x7f6a1415d600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 1 -- 10.20.193.10:0/1892423046 >> 10.20.193.10:0/1892423046 conn(0x7f6a140c9d80 msgr2=0x7f6a140ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 1 -- 10.20.193.10:0/1892423046 shutdown_connections 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.950+0000 7f6a18de6640 1 -- 10.20.193.10:0/1892423046 wait complete. 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient: build_initial_monmap 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient: monmap: 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 librados: starting msgr at 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 librados: starting objecter 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 Processor -- start 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 -- start start 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 librados: setting wanted keys 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 librados: calling monclient init 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient: init 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6a14074920 0x7f6a14144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient(hunting): picked mon.noname-b con 0x7f6a14074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6a140c92f0 0x7f6a140737c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient(hunting): picked mon.noname-c con 0x7f6a140c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a1415d220 0x7f6a1415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient(hunting): picked mon.noname-a con 0x7f6a1415d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f6a14074d70 con 0x7f6a1415d220 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6a140c86c0 con 0x7f6a14074920 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a14153b90 con 0x7f6a140c92f0 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a18de6640 10 monclient(hunting): authenticate will time out at 1031.672658s 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.951+0000 7f6a12d76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a1415d220 0x7f6a1415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6a14074920 0x7f6a14144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12d76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a1415d220 0x7f6a1415bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38744/0 (socket says 10.20.193.10:38744) 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12d76640 1 -- 10.20.193.10:0/290597960 learned_addr learned my addr 10.20.193.10:0/290597960 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12d76640 10 monclient(hunting): get_auth_request con 0x7f6a1415d220 auth_method 0 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a11d74640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6a140c92f0 0x7f6a140737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12575640 10 monclient(hunting): get_auth_request con 0x7f6a14074920 auth_method 0 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a11d74640 10 monclient(hunting): get_auth_request con 0x7f6a140c92f0 auth_method 0 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a11d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a11d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a11d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a12575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a11d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a11d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.952+0000 7f6a11d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 10 monclient(hunting): handle_auth_done global_id 4521 payload 824 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 1 -- 10.20.193.10:0/290597960 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6a140c92f0 msgr2=0x7f6a140737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6a140c92f0 0x7f6a140737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 1 -- 10.20.193.10:0/290597960 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6a14074920 msgr2=0x7f6a14144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6a14074920 0x7f6a14144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 10 monclient: _finish_hunting 0 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 1 monclient: found mon.noname-a 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.953+0000 7f6a12d76640 1 -- 10.20.193.10:0/290597960 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a141f4df0 con 0x7f6a1415d220 2026-02-17T11:56:01.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.954+0000 7f6a12d76640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a1415d220 0x7f6a1415bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400efc0 tx=0x7f6a0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.954+0000 7f69faffd640 10 client.?.objecter ms_handle_connect 0x7f6a1415d220 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.954+0000 7f69faffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 1 -- 10.20.193.10:0/290597960 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04018020 con 0x7f6a1415d220 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 10 monclient: dump: 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 1 -- 10.20.193.10:0/290597960 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a04014480 con 0x7f6a1415d220 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 1 -- 10.20.193.10:0/290597960 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04014870 con 0x7f6a1415d220 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a10d72640 4 set_mon_vals no callback set 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f69faffd640 10 monclient: dump: 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 5 monclient: authenticate success, global_id 4521 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 10 monclient: _renew_subs 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a14072720 con 0x7f6a1415d220 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 10 client.4521.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 10 monclient: _renew_subs 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a14072ce0 con 0x7f6a1415d220 2026-02-17T11:56:01.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 1 librados: init done 2026-02-17T11:56:01.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:01.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:01.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.956+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a14153f70 con 0x7f6a1415d220 2026-02-17T11:56:01.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.968+0000 7f69faffd640 1 -- 10.20.193.10:0/290597960 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6a04014a10 con 0x7f6a1415d220 2026-02-17T11:56:01.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.969+0000 7f69faffd640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f69e0078e80 0x7f69e007b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:01.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.969+0000 7f6a12575640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f69e0078e80 0x7f69e007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:01.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.969+0000 7f6a12575640 10 monclient: get_auth_request con 0x7f69e0078e80 auth_method 0 2026-02-17T11:56:01.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.969+0000 7f6a12575640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f69e0078e80 0x7f69e007b340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6a08002770 tx=0x7f6a08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:01.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:01.969+0000 7f69faffd640 10 client.4521.objecter ms_handle_connect 0x7f69e0078e80 2026-02-17T11:56:02.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.071+0000 7f69faffd640 1 -- 10.20.193.10:0/290597960 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f6a0405ee30 con 0x7f6a1415d220 2026-02-17T11:56:02.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.071+0000 7f69faffd640 10 client.4521.objecter ms_dispatch2 0x7f6a14000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:02.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.071+0000 7f69faffd640 3 client.4521.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:02.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.071+0000 7f69faffd640 3 client.4521.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:02.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.071+0000 7f69faffd640 20 client.4521.objecter dump_active .. 0 homeless 2026-02-17T11:56:02.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.071+0000 7f69faffd640 1 -- 10.20.193.10:0/290597960 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6a04022070 con 0x7f6a1415d220 2026-02-17T11:56:02.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.071+0000 7f69faffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:02.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.071+0000 7f69faffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:02.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.156+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a140724d0 con 0x7f69e0078e80 2026-02-17T11:56:02.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.157+0000 7f69faffd640 1 -- 10.20.193.10:0/290597960 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44548 (secure 0 0 0) 0x7f6a140724d0 con 0x7f69e0078e80 2026-02-17T11:56:02.158 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:02.160 INFO:teuthology.orchestra.run.trial010.stderr:dumped all 2026-02-17T11:56:02.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 10 librados: watch_flush enter 2026-02-17T11:56:02.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 10 librados: watch_flush exit 2026-02-17T11:56:02.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 20 client.4521.objecter shutdown clearing up homeless session... 2026-02-17T11:56:02.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 10 client.4521.objecter successfully canceled tick 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f69e0078e80 msgr2=0x7f69e007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f69e0078e80 0x7f69e007b340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6a08002770 tx=0x7f6a08009040 comp rx=0 tx=0).stop 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 10 monclient: shutdown 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a1415d220 msgr2=0x7f6a1415bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a1415d220 0x7f6a1415bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400efc0 tx=0x7f6a0400c490 comp rx=0 tx=0).stop 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 shutdown_connections 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f69e0078e80 0x7f69e007b340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6a1415d220 0x7f6a1415bf30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6a140c92f0 0x7f6a140737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 --2- 10.20.193.10:0/290597960 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6a14074920 0x7f6a14144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 >> 10.20.193.10:0/290597960 conn(0x7f6a140c9d80 msgr2=0x7f6a140c40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:02.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 shutdown_connections 2026-02-17T11:56:02.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 -- 10.20.193.10:0/290597960 wait complete. 2026-02-17T11:56:02.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.158+0000 7f6a18de6640 1 librados: shutdown 2026-02-17T11:56:02.167 INFO:teuthology.orchestra.run.trial010.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2026-02-17T11:56:01.767082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438032,"kb_used_data":6536,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511408,"statfs":{"total":1546188226560,"available":1545739681792,"internally_reserved":0,"allocated":6692864,"data_stored":3314964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25500,"internal_metadata":441424996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.506621"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.532493+0000","last_change":"2026-02-17T11:55:57.532493+0000","last_active":"2026-02-17T11:55:57.532493+0000","last_peered":"2026-02-17T11:55:57.532493+0000","last_clean":"2026-02-17T11:55:57.532493+0000","last_became_active":"2026-02-17T11:55:55.658594+0000","last_became_peered":"2026-02-17T11:55:55.658594+0000","last_unstale":"2026-02-17T11:55:57.532493+0000","last_undegraded":"2026-02-17T11:55:57.532493+0000","last_fullsized":"2026-02-17T11:55:57.532493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:26:38.378508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042345316000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.565000+0000","last_change":"2026-02-17T11:55:57.587525+0000","last_active":"2026-02-17T11:55:57.565000+0000","last_peered":"2026-02-17T11:55:57.565000+0000","last_clean":"2026-02-17T11:55:57.565000+0000","last_became_active":"2026-02-17T11:55:55.781344+0000","last_became_peered":"2026-02-17T11:55:55.781344+0000","last_unstale":"2026-02-17T11:55:57.565000+0000","last_undegraded":"2026-02-17T11:55:57.565000+0000","last_fullsized":"2026-02-17T11:55:57.565000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:52.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037397883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.503086+0000","last_change":"2026-02-17T11:55:57.503086+0000","last_active":"2026-02-17T11:55:57.503086+0000","last_peered":"2026-02-17T11:55:57.503086+0000","last_clean":"2026-02-17T11:55:57.503086+0000","last_became_active":"2026-02-17T11:55:55.451241+0000","last_became_peered":"2026-02-17T11:55:55.451241+0000","last_unstale":"2026-02-17T11:55:57.503086+0000","last_undegraded":"2026-02-17T11:55:57.503086+0000","last_fullsized":"2026-02-17T11:55:57.503086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:35:03.971846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037882574000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.580958+0000","last_change":"2026-02-17T11:55:57.580958+0000","last_active":"2026-02-17T11:55:57.580958+0000","last_peered":"2026-02-17T11:55:57.580958+0000","last_clean":"2026-02-17T11:55:57.580958+0000","last_became_active":"2026-02-17T11:55:55.648482+0000","last_became_peered":"2026-02-17T11:55:55.648482+0000","last_unstale":"2026-02-17T11:55:57.580958+0000","last_undegraded":"2026-02-17T11:55:57.580958+0000","last_fullsized":"2026-02-17T11:55:57.580958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:44:03.363850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037738756999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.569398+0000","last_change":"2026-02-17T11:55:57.569398+0000","last_active":"2026-02-17T11:55:57.569398+0000","last_peered":"2026-02-17T11:55:57.569398+0000","last_clean":"2026-02-17T11:55:57.569398+0000","last_became_active":"2026-02-17T11:55:55.640831+0000","last_became_peered":"2026-02-17T11:55:55.640831+0000","last_unstale":"2026-02-17T11:55:57.569398+0000","last_undegraded":"2026-02-17T11:55:57.569398+0000","last_fullsized":"2026-02-17T11:55:57.569398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:53:48.237641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056907020000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,12],"acting":[2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.559248+0000","last_change":"2026-02-17T11:55:57.578304+0000","last_active":"2026-02-17T11:55:57.559248+0000","last_peered":"2026-02-17T11:55:57.559248+0000","last_clean":"2026-02-17T11:55:57.559248+0000","last_became_active":"2026-02-17T11:55:55.453952+0000","last_became_peered":"2026-02-17T11:55:55.453952+0000","last_unstale":"2026-02-17T11:55:57.559248+0000","last_undegraded":"2026-02-17T11:55:57.559248+0000","last_fullsized":"2026-02-17T11:55:57.559248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:34:50.379105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034638460000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.539100+0000","last_change":"2026-02-17T11:55:57.561696+0000","last_active":"2026-02-17T11:55:57.539100+0000","last_peered":"2026-02-17T11:55:57.539100+0000","last_clean":"2026-02-17T11:55:57.539100+0000","last_became_active":"2026-02-17T11:55:55.508618+0000","last_became_peered":"2026-02-17T11:55:55.508618+0000","last_unstale":"2026-02-17T11:55:57.539100+0000","last_undegraded":"2026-02-17T11:55:57.539100+0000","last_fullsized":"2026-02-17T11:55:57.539100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:29:21.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055960348,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"32'1","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.580322+0000","last_change":"2026-02-17T11:55:57.580322+0000","last_active":"2026-02-17T11:55:57.580322+0000","last_peered":"2026-02-17T11:55:57.580322+0000","last_clean":"2026-02-17T11:55:57.580322+0000","last_became_active":"2026-02-17T11:55:55.408633+0000","last_became_peered":"2026-02-17T11:55:55.408633+0000","last_unstale":"2026-02-17T11:55:57.580322+0000","last_undegraded":"2026-02-17T11:55:57.580322+0000","last_fullsized":"2026-02-17T11:55:57.580322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:37:04.068558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027166316999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"29'32","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:55:57.543067+0000","last_change":"2026-02-17T11:55:50.153568+0000","last_active":"2026-02-17T11:55:57.543067+0000","last_peered":"2026-02-17T11:55:57.543067+0000","last_clean":"2026-02-17T11:55:57.543067+0000","last_became_active":"2026-02-17T11:55:49.807188+0000","last_became_peered":"2026-02-17T11:55:49.807188+0000","last_unstale":"2026-02-17T11:55:57.543067+0000","last_undegraded":"2026-02-17T11:55:57.543067+0000","last_fullsized":"2026-02-17T11:55:57.543067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_clean_scrub_stamp":"2026-02-17T11:55:42.183447+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:38:58.356098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[2,4,5,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":28,"seq":120259084292,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,5,6,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":28,"seq":120259084294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313224,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":372736,"data_stored":158068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":22,"seq":94489280519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247813,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":372736,"data_stored":158068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,6,7,8,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":25,"seq":107374182406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,4,5,6,7,8,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":24,"seq":103079215110,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":24,"seq":103079215110,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":770048,"data_stored":555889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[2,4,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":27,"seq":115964116999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":352256,"data_stored":148511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,5,6,7,8,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,3,5,6,7,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":27,"seq":115964117000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":770048,"data_stored":555889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":27,"seq":115964117002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":27,"seq":115964116999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,2,4,6,7,8,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":27,"seq":115964117001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":368640,"data_stored":158049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,2,3,4,5,7,9,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:56:02.169 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:56:02.169 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T11:56:02.169 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T11:56:02.170 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:02.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.235+0000 7f49f3db6640 10 monclient: get_monmap_and_config 2026-02-17T11:56:02.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.235+0000 7f49f3db6640 10 monclient: build_initial_monmap 2026-02-17T11:56:02.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.235+0000 7f49f3db6640 10 monclient: monmap: 2026-02-17T11:56:02.237 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:02.237 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:02.237 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:02.236116+0000 2026-02-17T11:56:02.237 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:02.236116+0000 2026-02-17T11:56:02.237 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:02.237 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:02.238 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:02.238 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:02.238 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:02.238 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:02.238 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:02.238 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:02.238 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:02.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.236+0000 7f49f3db6640 1 Processor -- start 2026-02-17T11:56:02.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.236+0000 7f49f3db6640 1 -- start start 2026-02-17T11:56:02.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.236+0000 7f49f3db6640 10 monclient: init 2026-02-17T11:56:02.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.236+0000 7f49f3db6640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:02.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.236+0000 7f49f3db6640 10 monclient: _add_conns ranks=[0,5,3,1,2,4] 2026-02-17T11:56:02.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.236+0000 7f49f3db6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f49ec155e80 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:02.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.236+0000 7f49f3db6640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f49ec074cd0 0x7f49ec0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:02.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 10 monclient(hunting): picked mon.noname-c con 0x7f49ec074cd0 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:02.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f49ec156260 0x7f49ec0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:02.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 10 monclient(hunting): picked mon.noname-a con 0x7f49ec156260 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:02.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ec073520 con 0x7f49ec155e80 2026-02-17T11:56:02.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:02.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f49ec0cd840 con 0x7f49ec156260 2026-02-17T11:56:02.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:02.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f49ec073800 con 0x7f49ec074cd0 2026-02-17T11:56:02.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:02.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f3db6640 10 monclient(hunting): authenticate will time out at 1031.958024s 2026-02-17T11:56:02.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f232c640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f49ec156260 0x7f49ec0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:02.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f132a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f49ec074cd0 0x7f49ec0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:02.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f132a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f49ec074cd0 0x7f49ec0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36184/0 (socket says 10.20.193.10:36184) 2026-02-17T11:56:02.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f132a640 1 -- 10.20.193.10:0/1941160293 learned_addr learned my addr 10.20.193.10:0/1941160293 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:02.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f132a640 10 monclient(hunting): get_auth_request con 0x7f49ec074cd0 auth_method 0 2026-02-17T11:56:02.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f132a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:02.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f132a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:02.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f132a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:02.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f232c640 10 monclient(hunting): get_auth_request con 0x7f49ec156260 auth_method 0 2026-02-17T11:56:02.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f232c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:02.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f232c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:02.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.237+0000 7f49f232c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:02.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:02.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:02.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:02.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f232c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:02.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f232c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:02.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f232c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:02.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 10 monclient(hunting): handle_auth_done global_id 4601 payload 274 2026-02-17T11:56:02.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 1 -- 10.20.193.10:0/1941160293 >> v2:10.20.193.10:3300/0 conn(0x7f49ec156260 msgr2=0x7f49ec0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:02.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 1 --2- 10.20.193.10:0/1941160293 >> v2:10.20.193.10:3300/0 conn(0x7f49ec156260 0x7f49ec0cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 1 -- 10.20.193.10:0/1941160293 >> v1:10.20.193.10:6789/0 conn(0x7f49ec155e80 legacy=0x7f49ec0745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:02.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 10 monclient: _finish_hunting 0 2026-02-17T11:56:02.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 1 monclient: found mon.noname-c 2026-02-17T11:56:02.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:02.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:02.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.238+0000 7f49f132a640 1 -- 10.20.193.10:0/1941160293 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec073ae0 con 0x7f49ec074cd0 2026-02-17T11:56:02.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.239+0000 7f49f132a640 1 --2- 10.20.193.10:0/1941160293 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 0x7f49ec0ccbc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49ec08f5e0 tx=0x7f49e002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a677a7add966f898 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:02.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 1 -- 10.20.193.10:0/1941160293 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e003c070 con 0x7f49ec074cd0 2026-02-17T11:56:02.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:02.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:02.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 10 monclient: dump: 2026-02-17T11:56:02.258 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:02.258 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:02.258 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:02.258 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:02.258 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:02.258 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:02.258 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:02.258 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:02.259 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:02.259 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:02.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 10 monclient: _finish_auth 0 2026-02-17T11:56:02.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 10 monclient: _check_auth_tickets 2026-02-17T11:56:02.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:02.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 1 -- 10.20.193.10:0/1941160293 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e002fbe0 con 0x7f49ec074cd0 2026-02-17T11:56:02.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:02.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 1 -- 10.20.193.10:0/1941160293 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e0037440 con 0x7f49ec074cd0 2026-02-17T11:56:02.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f3db6640 5 monclient: authenticate success, global_id 4601 2026-02-17T11:56:02.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f3db6640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:02.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f3db6640 4 set_mon_vals no callback set 2026-02-17T11:56:02.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:02.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:02.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.241+0000 7f49f0b29640 10 monclient: dump: 2026-02-17T11:56:02.260 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:02.260 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:02.261 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:02.261 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:02.261 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:02.261 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:02.261 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:02.261 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:02.261 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:02.261 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:02.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 10 monclient: shutdown 2026-02-17T11:56:02.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:02.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 -- 10.20.193.10:0/1941160293 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 msgr2=0x7f49ec0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:02.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 --2- 10.20.193.10:0/1941160293 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 0x7f49ec0ccbc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49ec08f5e0 tx=0x7f49e002eed0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 -- 10.20.193.10:0/1941160293 shutdown_connections 2026-02-17T11:56:02.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 --2- 10.20.193.10:0/1941160293 >> v2:10.20.193.10:3300/0 conn(0x7f49ec156260 0x7f49ec0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 --2- 10.20.193.10:0/1941160293 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 0x7f49ec0ccbc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 -- 10.20.193.10:0/1941160293 >> 10.20.193.10:0/1941160293 conn(0x7f49ec0ce2b0 msgr2=0x7f49ec0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:02.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 -- 10.20.193.10:0/1941160293 shutdown_connections 2026-02-17T11:56:02.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 -- 10.20.193.10:0/1941160293 wait complete. 2026-02-17T11:56:02.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 10 monclient: build_initial_monmap 2026-02-17T11:56:02.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 10 monclient: monmap: 2026-02-17T11:56:02.263 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:02.263 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:02.263 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:02.263 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:02.264 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:02.264 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:02.264 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:02.264 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:02.264 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:02.264 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:02.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 librados: starting msgr at 2026-02-17T11:56:02.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 librados: starting objecter 2026-02-17T11:56:02.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 Processor -- start 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 -- start start 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 librados: setting wanted keys 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 1 librados: calling monclient init 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.242+0000 7f49f3db6640 10 monclient: init 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 0x7f49ec15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient(hunting): picked mon.noname-c con 0x7f49ec074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f49ec155e80 0x7f49ec14b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient(hunting): picked mon.noname-b con 0x7f49ec155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f49ec156260 0x7f49ec15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:02.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient(hunting): picked mon.noname-a con 0x7f49ec156260 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec0c4870 con 0x7f49ec156260 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec0740a0 con 0x7f49ec155e80 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec0c49f0 con 0x7f49ec074cd0 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f3db6640 10 monclient(hunting): authenticate will time out at 1031.964246s 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f49ec156260 0x7f49ec15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f1b2b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 0x7f49ec15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f132a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f49ec155e80 0x7f49ec14b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f49ec156260 0x7f49ec15d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38750/0 (socket says 10.20.193.10:38750) 2026-02-17T11:56:02.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 1 -- 10.20.193.10:0/466144923 learned_addr learned my addr 10.20.193.10:0/466144923 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 10 monclient(hunting): get_auth_request con 0x7f49ec156260 auth_method 0 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f1b2b640 10 monclient(hunting): get_auth_request con 0x7f49ec074cd0 auth_method 0 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f1b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f1b2b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f1b2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f132a640 10 monclient(hunting): get_auth_request con 0x7f49ec155e80 auth_method 0 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f132a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f132a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f132a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:02.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.243+0000 7f49f232c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.244+0000 7f49f1b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.244+0000 7f49f1b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.244+0000 7f49f1b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.244+0000 7f49f132a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.244+0000 7f49f132a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.244+0000 7f49f132a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 10 monclient(hunting): handle_auth_done global_id 4604 payload 824 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 1 -- 10.20.193.10:0/466144923 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f49ec155e80 msgr2=0x7f49ec14b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f49ec155e80 0x7f49ec14b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 1 -- 10.20.193.10:0/466144923 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f49ec156260 msgr2=0x7f49ec15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:02.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f49ec156260 0x7f49ec15d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 10 monclient: _finish_hunting 0 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 1 monclient: found mon.noname-c 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.245+0000 7f49f1b2b640 1 -- 10.20.193.10:0/466144923 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec1f4900 con 0x7f49ec074cd0 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.246+0000 7f49f1b2b640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 0x7f49ec15faa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c480 tx=0x7f49dc00c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.246+0000 7f49da7fc640 10 client.?.objecter ms_handle_connect 0x7f49ec074cd0 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.246+0000 7f49da7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 1 -- 10.20.193.10:0/466144923 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc017070 con 0x7f49ec074cd0 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 10 monclient: dump: 2026-02-17T11:56:02.269 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:02.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49f3db6640 5 monclient: authenticate success, global_id 4604 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49f3db6640 10 monclient: _renew_subs 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49f3db6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ec1500d0 con 0x7f49ec074cd0 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49f3db6640 10 client.4604.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49f3db6640 10 monclient: _renew_subs 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49f3db6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ec150690 con 0x7f49ec074cd0 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49f3db6640 1 librados: init done 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 1 -- 10.20.193.10:0/466144923 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc0052d0 con 0x7f49ec074cd0 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.247+0000 7f49da7fc640 1 -- 10.20.193.10:0/466144923 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc021060 con 0x7f49ec074cd0 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.248+0000 7f49da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:02.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.248+0000 7f49da7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.248+0000 7f49da7fc640 10 monclient: dump: 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.248+0000 7f49dbfff640 4 set_mon_vals no callback set 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.248+0000 7f49f3db6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.248+0000 7f49f3db6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:02.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.248+0000 7f49f3db6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:02.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.248+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49ec0745c0 con 0x7f49ec074cd0 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.258+0000 7f49da7fc640 1 -- 10.20.193.10:0/466144923 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f49dc024080 con 0x7f49ec074cd0 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.259+0000 7f49da7fc640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f49bc078e30 0x7f49bc07b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.259+0000 7f49f132a640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f49bc078e30 0x7f49bc07b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.259+0000 7f49f132a640 10 monclient: get_auth_request con 0x7f49bc078e30 auth_method 0 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.259+0000 7f49f132a640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f49bc078e30 0x7f49bc07b2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f49ec06cfa0 tx=0x7f49e0039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.259+0000 7f49da7fc640 10 client.4604.objecter ms_handle_connect 0x7f49bc078e30 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.260+0000 7f49da7fc640 1 -- 10.20.193.10:0/466144923 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f49dc05d420 con 0x7f49ec074cd0 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.260+0000 7f49da7fc640 10 client.4604.objecter ms_dispatch2 0x7f49ec000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.260+0000 7f49da7fc640 3 client.4604.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.260+0000 7f49da7fc640 3 client.4604.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:56:02.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.260+0000 7f49da7fc640 20 client.4604.objecter dump_active .. 0 homeless 2026-02-17T11:56:02.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.361+0000 7f49da7fc640 1 -- 10.20.193.10:0/466144923 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f49dc0613e0 con 0x7f49ec074cd0 2026-02-17T11:56:02.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.361+0000 7f49da7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:02.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.361+0000 7f49da7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:02.465 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.463+0000 7f49f3db6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:02.465 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.463+0000 7f49f3db6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:02.465 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.463+0000 7f49f3db6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:02.465 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.463+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f49ec1597b0 con 0x7f49ec074cd0 2026-02-17T11:56:02.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.468+0000 7f49da7fc640 1 -- 10.20.193.10:0/466144923 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f49dc0656e0 con 0x7f49ec074cd0 2026-02-17T11:56:02.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.468+0000 7f49da7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:02.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.468+0000 7f49da7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:02.469 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:02.470 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:02.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 10 librados: watch_flush enter 2026-02-17T11:56:02.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 10 librados: watch_flush exit 2026-02-17T11:56:02.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 20 client.4604.objecter shutdown clearing up homeless session... 2026-02-17T11:56:02.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 10 client.4604.objecter successfully canceled tick 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f49bc078e30 msgr2=0x7f49bc07b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f49bc078e30 0x7f49bc07b2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f49ec06cfa0 tx=0x7f49e0039040 comp rx=0 tx=0).stop 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 10 monclient: shutdown 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 msgr2=0x7f49ec15faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 0x7f49ec15faa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c480 tx=0x7f49dc00c950 comp rx=0 tx=0).stop 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 shutdown_connections 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f49bc078e30 0x7f49bc07b2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f49ec156260 0x7f49ec15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f49ec155e80 0x7f49ec14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 --2- 10.20.193.10:0/466144923 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49ec074cd0 0x7f49ec15faa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:02.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 >> 10.20.193.10:0/466144923 conn(0x7f49ec0ce2b0 msgr2=0x7f49ec1536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:02.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 shutdown_connections 2026-02-17T11:56:02.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 -- 10.20.193.10:0/466144923 wait complete. 2026-02-17T11:56:02.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:02.469+0000 7f49f3db6640 1 librados: shutdown 2026-02-17T11:56:05.481 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:05.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.548+0000 7fac0e95b640 10 monclient: get_monmap_and_config 2026-02-17T11:56:05.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.548+0000 7fac0e95b640 10 monclient: build_initial_monmap 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.548+0000 7fac0e95b640 10 monclient: monmap: 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:05.548416+0000 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:05.548416+0000 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:05.550 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:05.551 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:05.551 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:05.551 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:05.551 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:05.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.548+0000 7fac0e95b640 1 Processor -- start 2026-02-17T11:56:05.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.548+0000 7fac0e95b640 1 -- start start 2026-02-17T11:56:05.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.548+0000 7fac0e95b640 10 monclient: init 2026-02-17T11:56:05.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:05.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 10 monclient: _add_conns ranks=[2,0,3,4,5,1] 2026-02-17T11:56:05.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fac08152660 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:05.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fac0815b030 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fac080c6ce0 0x7fac081631a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 10 monclient(hunting): picked mon.noname-a con 0x7fac080c6ce0 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac080c71e0 con 0x7fac0815b030 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac080c74c0 con 0x7fac08152660 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fac080c77a0 con 0x7fac080c6ce0 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0e95b640 10 monclient(hunting): authenticate will time out at 1035.270197s 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac0ced1640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fac080c6ce0 0x7fac081631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac07fff640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fac08152660 0x7fac0815a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:49664/0 (socket says 10.20.193.10:49664) 2026-02-17T11:56:05.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.549+0000 7fac07fff640 1 -- 10.20.193.10:0/412814495 learned_addr learned my addr 10.20.193.10:0/412814495 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:05.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.550+0000 7fac0ced1640 10 monclient(hunting): get_auth_request con 0x7fac080c6ce0 auth_method 0 2026-02-17T11:56:05.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.550+0000 7fac0ced1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:05.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.550+0000 7fac0ced1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:05.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.550+0000 7fac0ced1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:05.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.550+0000 7fac0ced1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:05.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.550+0000 7fac0ced1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:05.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.550+0000 7fac0ced1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:05.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac06ffd640 1 -- 10.20.193.10:0/412814495 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542321819 0 0) 0x7fac080c74c0 con 0x7fac08152660 2026-02-17T11:56:05.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac06ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:56:05.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:05.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:05.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac06ffd640 10 monclient(hunting): my global_id is 4607 2026-02-17T11:56:05.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac06ffd640 1 -- 10.20.193.10:0/412814495 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabec003620 con 0x7fac08152660 2026-02-17T11:56:05.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac0ced1640 10 monclient(hunting): handle_auth_done global_id 4533 payload 274 2026-02-17T11:56:05.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac0ced1640 1 -- 10.20.193.10:0/412814495 >> v1:10.20.193.153:6789/0 conn(0x7fac08152660 legacy=0x7fac0815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:05.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac0ced1640 1 -- 10.20.193.10:0/412814495 >> v1:10.20.193.10:6789/0 conn(0x7fac0815b030 legacy=0x7fac080c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:05.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac0ced1640 10 monclient: _finish_hunting 0 2026-02-17T11:56:05.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac0ced1640 1 monclient: found mon.noname-a 2026-02-17T11:56:05.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac0ced1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:05.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac0ced1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:05.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.551+0000 7fac0ced1640 1 -- 10.20.193.10:0/412814495 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac08159e40 con 0x7fac080c6ce0 2026-02-17T11:56:05.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.554+0000 7fac0ced1640 1 --2- 10.20.193.10:0/412814495 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac080c6ce0 0x7fac081631a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009d90 tx=0x7fabfc02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7d68c754debcfe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:05.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 1 -- 10.20.193.10:0/412814495 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc03c070 con 0x7fac080c6ce0 2026-02-17T11:56:05.568 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:05.568 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:05.568 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 10 monclient: dump: 2026-02-17T11:56:05.568 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:05.568 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:05.568 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:05.568 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:05.569 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:05.569 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:05.569 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:05.569 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:05.569 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:05.569 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:05.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:05.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:05.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:05.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 1 -- 10.20.193.10:0/412814495 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabfc037440 con 0x7fac080c6ce0 2026-02-17T11:56:05.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:05.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 5 monclient: authenticate success, global_id 4533 2026-02-17T11:56:05.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 1 -- 10.20.193.10:0/412814495 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc037810 con 0x7fac080c6ce0 2026-02-17T11:56:05.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:05.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 4 set_mon_vals no callback set 2026-02-17T11:56:05.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:05.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:05.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac06ffd640 10 monclient: dump: 2026-02-17T11:56:05.571 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:05.571 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:05.571 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:05.571 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:05.571 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:05.571 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:05.572 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:05.572 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:05.572 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:05.572 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:05.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 10 monclient: shutdown 2026-02-17T11:56:05.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:05.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 1 -- 10.20.193.10:0/412814495 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac080c6ce0 msgr2=0x7fac081631a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:05.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 1 --2- 10.20.193.10:0/412814495 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac080c6ce0 0x7fac081631a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009d90 tx=0x7fabfc02f230 comp rx=0 tx=0).stop 2026-02-17T11:56:05.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 1 -- 10.20.193.10:0/412814495 shutdown_connections 2026-02-17T11:56:05.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 1 --2- 10.20.193.10:0/412814495 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac080c6ce0 0x7fac081631a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:05.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 1 -- 10.20.193.10:0/412814495 >> 10.20.193.10:0/412814495 conn(0x7fac080c9d80 msgr2=0x7fac080ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:05.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 1 -- 10.20.193.10:0/412814495 shutdown_connections 2026-02-17T11:56:05.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.556+0000 7fac0e95b640 1 -- 10.20.193.10:0/412814495 wait complete. 2026-02-17T11:56:05.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient: build_initial_monmap 2026-02-17T11:56:05.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient: monmap: 2026-02-17T11:56:05.573 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:05.574 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:05.574 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:05.574 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:05.574 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:05.574 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:05.574 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:05.574 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:05.574 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:05.574 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:05.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 librados: starting msgr at 2026-02-17T11:56:05.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 librados: starting objecter 2026-02-17T11:56:05.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 Processor -- start 2026-02-17T11:56:05.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 -- start start 2026-02-17T11:56:05.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 librados: setting wanted keys 2026-02-17T11:56:05.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 librados: calling monclient init 2026-02-17T11:56:05.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient: init 2026-02-17T11:56:05.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:05.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:05.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac080c6ce0 0x7fac081f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:05.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient(hunting): picked mon.noname-c con 0x7fac080c6ce0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:05.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac08152660 0x7fac0806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:05.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient(hunting): picked mon.noname-a con 0x7fac08152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:05.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fac0815b030 0x7fac081515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:05.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient(hunting): picked mon.noname-b con 0x7fac0815b030 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:05.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:05.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fac080c94e0 con 0x7fac08152660 2026-02-17T11:56:05.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:05.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fac0815a400 con 0x7fac0815b030 2026-02-17T11:56:05.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:05.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac080c9660 con 0x7fac080c6ce0 2026-02-17T11:56:05.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:05.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.557+0000 7fac0e95b640 10 monclient(hunting): authenticate will time out at 1035.278995s 2026-02-17T11:56:05.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac08152660 0x7fac0806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:05.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac08152660 0x7fac0806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:42146/0 (socket says 10.20.193.10:42146) 2026-02-17T11:56:05.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 1 -- 10.20.193.10:0/455304498 learned_addr learned my addr 10.20.193.10:0/455304498 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:05.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 10 monclient(hunting): get_auth_request con 0x7fac08152660 auth_method 0 2026-02-17T11:56:05.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:05.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:05.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:05.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac07fff640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac080c6ce0 0x7fac081f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:05.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac0ced1640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fac0815b030 0x7fac081515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:05.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:05.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:05.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:05.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac07fff640 10 monclient(hunting): get_auth_request con 0x7fac080c6ce0 auth_method 0 2026-02-17T11:56:05.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:05.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:05.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:05.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac0ced1640 10 monclient(hunting): get_auth_request con 0x7fac0815b030 auth_method 0 2026-02-17T11:56:05.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac0ced1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:05.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac0ced1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:05.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac0ced1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:05.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:05.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:05.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:05.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac0ced1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:05.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.558+0000 7fac0ced1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:05.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac0ced1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:05.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 10 monclient(hunting): handle_auth_done global_id 4539 payload 824 2026-02-17T11:56:05.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 1 -- 10.20.193.10:0/455304498 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac080c6ce0 msgr2=0x7fac081f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:05.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac080c6ce0 0x7fac081f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:05.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 1 -- 10.20.193.10:0/455304498 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fac0815b030 msgr2=0x7fac081515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:05.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fac0815b030 0x7fac081515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:05.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:05.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 1 monclient: found mon.noname-a 2026-02-17T11:56:05.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.559+0000 7fac077fe640 1 -- 10.20.193.10:0/455304498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac081f59e0 con 0x7fac08152660 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.561+0000 7fac077fe640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac08152660 0x7fac0806b8b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c730 tx=0x7fabf800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.561+0000 7fac04ff9640 10 client.?.objecter ms_handle_connect 0x7fac08152660 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.561+0000 7fac04ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac04ff9640 1 -- 10.20.193.10:0/455304498 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8017070 con 0x7fac08152660 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac04ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac04ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac04ff9640 10 monclient: dump: 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:05.582 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac04ff9640 10 monclient: _finish_auth 0 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac04ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac04ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:05.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 5 monclient: authenticate success, global_id 4539 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 10 monclient: _renew_subs 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac081f21b0 con 0x7fac08152660 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 10 client.4539.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 10 monclient: _renew_subs 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac08150800 con 0x7fac08152660 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 1 librados: init done 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac04ff9640 1 -- 10.20.193.10:0/455304498 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf80052b0 con 0x7fac08152660 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.562+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0814d5b0 con 0x7fac08152660 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.563+0000 7fac04ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:05.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.563+0000 7fac04ff9640 1 -- 10.20.193.10:0/455304498 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8021060 con 0x7fac08152660 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.563+0000 7fac04ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.563+0000 7fac04ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.563+0000 7fac067fc640 4 set_mon_vals no callback set 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.563+0000 7fac04ff9640 10 monclient: dump: 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:05.585 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:05.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.668+0000 7fac04ff9640 1 -- 10.20.193.10:0/455304498 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fabf8024080 con 0x7fac08152660 2026-02-17T11:56:05.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.668+0000 7fac04ff9640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabd8078e00 0x7fabd807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:05.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.668+0000 7fac07fff640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabd8078e00 0x7fabd807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:05.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.668+0000 7fac07fff640 10 monclient: get_auth_request con 0x7fabd8078e00 auth_method 0 2026-02-17T11:56:05.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.669+0000 7fac07fff640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabd8078e00 0x7fabd807b2c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fabf4005980 tx=0x7fabf4007dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:05.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.669+0000 7fac04ff9640 10 client.4539.objecter ms_handle_connect 0x7fabd8078e00 2026-02-17T11:56:05.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.676+0000 7fac04ff9640 1 -- 10.20.193.10:0/455304498 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fabf805d5d0 con 0x7fac08152660 2026-02-17T11:56:05.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.676+0000 7fac04ff9640 10 client.4539.objecter ms_dispatch2 0x7fac08000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:05.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.676+0000 7fac04ff9640 3 client.4539.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:05.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.676+0000 7fac04ff9640 3 client.4539.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:05.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.676+0000 7fac04ff9640 20 client.4539.objecter dump_active .. 0 homeless 2026-02-17T11:56:05.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.676+0000 7fac04ff9640 1 -- 10.20.193.10:0/455304498 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fac0814d5b0 con 0x7fac08152660 2026-02-17T11:56:05.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.676+0000 7fac04ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:05.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.676+0000 7fac04ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:05.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.778+0000 7fac0e95b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:05.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.778+0000 7fac0e95b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:05.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.778+0000 7fac0e95b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:05.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.778+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fac0814ebc0 con 0x7fac08152660 2026-02-17T11:56:05.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.782+0000 7fac04ff9640 1 -- 10.20.193.10:0/455304498 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fabf8061590 con 0x7fac08152660 2026-02-17T11:56:05.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.782+0000 7fac04ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:05.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.782+0000 7fac04ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:05.783 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:05.783 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:05.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 10 librados: watch_flush enter 2026-02-17T11:56:05.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 10 librados: watch_flush exit 2026-02-17T11:56:05.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 20 client.4539.objecter shutdown clearing up homeless session... 2026-02-17T11:56:05.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 10 client.4539.objecter successfully canceled tick 2026-02-17T11:56:05.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabd8078e00 msgr2=0x7fabd807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:05.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabd8078e00 0x7fabd807b2c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fabf4005980 tx=0x7fabf4007dd0 comp rx=0 tx=0).stop 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 10 monclient: shutdown 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac08152660 msgr2=0x7fac0806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac08152660 0x7fac0806b8b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c730 tx=0x7fabf800cc00 comp rx=0 tx=0).stop 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 shutdown_connections 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabd8078e00 0x7fabd807b2c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fac0815b030 0x7fac081515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fac08152660 0x7fac0806b8b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 --2- 10.20.193.10:0/455304498 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac080c6ce0 0x7fac081f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 >> 10.20.193.10:0/455304498 conn(0x7fac080c9d80 msgr2=0x7fac0814d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 shutdown_connections 2026-02-17T11:56:05.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 -- 10.20.193.10:0/455304498 wait complete. 2026-02-17T11:56:05.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:05.783+0000 7fac0e95b640 1 librados: shutdown 2026-02-17T11:56:08.793 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:08.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.860+0000 7f2895ebf640 10 monclient: get_monmap_and_config 2026-02-17T11:56:08.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.860+0000 7f2895ebf640 10 monclient: build_initial_monmap 2026-02-17T11:56:08.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.860+0000 7f2895ebf640 10 monclient: monmap: 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:08.861858+0000 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:08.861858+0000 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:08.863 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:08.864 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:08.864 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:08.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 1 Processor -- start 2026-02-17T11:56:08.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 1 -- start start 2026-02-17T11:56:08.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient: init 2026-02-17T11:56:08.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:08.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient: _add_conns ranks=[0,5,4,2,3,1] 2026-02-17T11:56:08.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2890155d70 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f289006e2d0 0x7f28900c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient(hunting): picked mon.noname-c con 0x7f289006e2d0 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f289006e720 0x7f28900c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient(hunting): picked mon.noname-b con 0x7f289006e720 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2890156150 con 0x7f2890155d70 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f289006ecd0 con 0x7f289006e720 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f289006efb0 con 0x7f289006e2d0 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.861+0000 7f2895ebf640 10 monclient(hunting): authenticate will time out at 1038.583952s 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288f7fe640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f2890155d70 0x7f2890068e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:58944/0 (socket says 10.20.193.10:58944) 2026-02-17T11:56:08.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288f7fe640 1 -- 10.20.193.10:0/3080874718 learned_addr learned my addr 10.20.193.10:0/3080874718 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288ffff640 1 --2- 10.20.193.10:0/3080874718 >> v2:10.20.193.71:3300/0 conn(0x7f289006e720 0x7f28900c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288effd640 1 --2- 10.20.193.10:0/3080874718 >> v2:10.20.193.153:3300/0 conn(0x7f289006e2d0 0x7f28900c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288ffff640 10 monclient(hunting): get_auth_request con 0x7f289006e720 auth_method 0 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288effd640 10 monclient(hunting): get_auth_request con 0x7f289006e2d0 auth_method 0 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:08.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.862+0000 7f288effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288e7fc640 1 -- 10.20.193.10:0/3080874718 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895697417 0 0) 0x7f2890156150 con 0x7f2890155d70 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288e7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288e7fc640 10 monclient(hunting): my global_id is 4542 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288e7fc640 1 -- 10.20.193.10:0/3080874718 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2874003620 con 0x7f2890155d70 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288effd640 10 monclient(hunting): handle_auth_done global_id 4613 payload 274 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288effd640 1 -- 10.20.193.10:0/3080874718 >> v2:10.20.193.71:3300/0 conn(0x7f289006e720 msgr2=0x7f28900c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:08.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288effd640 1 --2- 10.20.193.10:0/3080874718 >> v2:10.20.193.71:3300/0 conn(0x7f289006e720 0x7f28900c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:08.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288effd640 1 -- 10.20.193.10:0/3080874718 >> v1:10.20.193.10:6789/0 conn(0x7f2890155d70 legacy=0x7f2890068e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:08.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288effd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:08.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288effd640 1 monclient: found mon.noname-c 2026-02-17T11:56:08.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:08.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:08.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288effd640 1 -- 10.20.193.10:0/3080874718 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28900c8da0 con 0x7f289006e2d0 2026-02-17T11:56:08.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.863+0000 7f288ffff640 1 --2- 10.20.193.10:0/3080874718 >> v2:10.20.193.71:3300/0 conn(0x7f289006e720 0x7f28900c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:08.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.864+0000 7f288effd640 1 --2- 10.20.193.10:0/3080874718 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 0x7f28900c9880 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2890073770 tx=0x7f288002ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee29f0af4e4d27aa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:08.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.865+0000 7f288e7fc640 1 -- 10.20.193.10:0/3080874718 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288003c070 con 0x7f289006e2d0 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.865+0000 7f288e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.865+0000 7f288e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.865+0000 7f288e7fc640 10 monclient: dump: 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:08.878 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.865+0000 7f288e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.865+0000 7f288e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.865+0000 7f288e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.865+0000 7f2895ebf640 5 monclient: authenticate success, global_id 4613 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.865+0000 7f2895ebf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f288e7fc640 1 -- 10.20.193.10:0/3080874718 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288002fc20 con 0x7f289006e2d0 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f288e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f288e7fc640 1 -- 10.20.193.10:0/3080874718 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880037440 con 0x7f289006e2d0 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f288e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f288e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f288e7fc640 10 monclient: dump: 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:08.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 4 set_mon_vals no callback set 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 10 monclient: shutdown 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 1 -- 10.20.193.10:0/3080874718 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 msgr2=0x7f28900c9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 1 --2- 10.20.193.10:0/3080874718 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 0x7f28900c9880 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2890073770 tx=0x7f288002ef10 comp rx=0 tx=0).stop 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 1 -- 10.20.193.10:0/3080874718 shutdown_connections 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 1 --2- 10.20.193.10:0/3080874718 >> v2:10.20.193.71:3300/0 conn(0x7f289006e720 0x7f28900c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 1 --2- 10.20.193.10:0/3080874718 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 0x7f28900c9880 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 1 -- 10.20.193.10:0/3080874718 >> 10.20.193.10:0/3080874718 conn(0x7f2890074090 msgr2=0x7f28900744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 1 -- 10.20.193.10:0/3080874718 shutdown_connections 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.866+0000 7f2895ebf640 1 -- 10.20.193.10:0/3080874718 wait complete. 2026-02-17T11:56:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.867+0000 7f2895ebf640 10 monclient: build_initial_monmap 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.867+0000 7f2895ebf640 10 monclient: monmap: 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:08.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.867+0000 7f2895ebf640 1 librados: starting msgr at 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.867+0000 7f2895ebf640 1 librados: starting objecter 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.867+0000 7f2895ebf640 1 Processor -- start 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.867+0000 7f2895ebf640 1 -- start start 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.867+0000 7f2895ebf640 1 librados: setting wanted keys 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.867+0000 7f2895ebf640 1 librados: calling monclient init 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.867+0000 7f2895ebf640 10 monclient: init 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 0x7f28901f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient(hunting): picked mon.noname-c con 0x7f289006e2d0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f289006e720 0x7f28901f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient(hunting): picked mon.noname-a con 0x7f289006e720 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:08.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2890155d70 0x7f28900cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient(hunting): picked mon.noname-b con 0x7f2890155d70 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f289006f290 con 0x7f289006e720 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28900c9360 con 0x7f2890155d70 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f289015ffb0 con 0x7f289006e2d0 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f2895ebf640 10 monclient(hunting): authenticate will time out at 1038.590054s 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288effd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f289006e720 0x7f28901f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 0x7f28901f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:08.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288ffff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2890155d70 0x7f28900cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 0x7f28901f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:51118/0 (socket says 10.20.193.10:51118) 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 1 -- 10.20.193.10:0/2567815773 learned_addr learned my addr 10.20.193.10:0/2567815773 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 10 monclient(hunting): get_auth_request con 0x7f289006e2d0 auth_method 0 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288effd640 10 monclient(hunting): get_auth_request con 0x7f289006e720 auth_method 0 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288ffff640 10 monclient(hunting): get_auth_request con 0x7f2890155d70 auth_method 0 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:08.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.868+0000 7f288ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 10 monclient(hunting): handle_auth_done global_id 4591 payload 824 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 1 -- 10.20.193.10:0/2567815773 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 msgr2=0x7f28901f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:08.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 0x7f28901f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 1 -- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f289006e720 msgr2=0x7f28901f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f289006e720 0x7f28901f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 1 monclient: found mon.noname-b 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288ffff640 1 -- 10.20.193.10:0/2567815773 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28901f4f10 con 0x7f2890155d70 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.870+0000 7f288effd640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f289006e720 0x7f28901f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.871+0000 7f288ffff640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2890155d70 0x7f28900cb160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2884009db0 tx=0x7f288400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.871+0000 7f286bfff640 10 client.?.objecter ms_handle_connect 0x7f2890155d70 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.871+0000 7f286bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:08.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 1 -- 10.20.193.10:0/2567815773 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2884018030 con 0x7f2890155d70 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 10 monclient: dump: 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:08.888 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 10 monclient: _finish_auth 0 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 1 -- 10.20.193.10:0/2567815773 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288400cd40 con 0x7f2890155d70 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 5 monclient: authenticate success, global_id 4591 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 10 monclient: _renew_subs 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289015db50 con 0x7f2890155d70 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 1 -- 10.20.193.10:0/2567815773 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2884003cf0 con 0x7f2890155d70 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:08.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f286bfff640 10 monclient: dump: 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f288dffb640 4 set_mon_vals no callback set 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 10 client.4591.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:08.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 10 monclient: _renew_subs 2026-02-17T11:56:08.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:08.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289015e110 con 0x7f2890155d70 2026-02-17T11:56:08.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 1 librados: init done 2026-02-17T11:56:08.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:08.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:08.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:08.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.873+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2890068e60 con 0x7f2890155d70 2026-02-17T11:56:08.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.885+0000 7f286bfff640 1 -- 10.20.193.10:0/2567815773 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f2884014480 con 0x7f2890155d70 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.886+0000 7f286bfff640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2860078e50 0x7f286007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.886+0000 7f288f7fe640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2860078e50 0x7f286007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.886+0000 7f288f7fe640 10 monclient: get_auth_request con 0x7f2860078e50 auth_method 0 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.886+0000 7f288f7fe640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2860078e50 0x7f286007b310 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f287c005980 tx=0x7f287c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.886+0000 7f286bfff640 10 client.4591.objecter ms_handle_connect 0x7f2860078e50 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.887+0000 7f286bfff640 1 -- 10.20.193.10:0/2567815773 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f288405efd0 con 0x7f2890155d70 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.887+0000 7f286bfff640 10 client.4591.objecter ms_dispatch2 0x7f2890000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.887+0000 7f286bfff640 3 client.4591.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.887+0000 7f286bfff640 3 client.4591.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:08.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.887+0000 7f286bfff640 20 client.4591.objecter dump_active .. 0 homeless 2026-02-17T11:56:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.987+0000 7f286bfff640 1 -- 10.20.193.10:0/2567815773 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2884022070 con 0x7f2890155d70 2026-02-17T11:56:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.987+0000 7f286bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:08.987+0000 7f286bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:09.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.086+0000 7f2895ebf640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:09.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.086+0000 7f2895ebf640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:09.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.086+0000 7f2895ebf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:09.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.086+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f289006f790 con 0x7f2890155d70 2026-02-17T11:56:09.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.091+0000 7f286bfff640 1 -- 10.20.193.10:0/2567815773 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f2884010040 con 0x7f2890155d70 2026-02-17T11:56:09.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.091+0000 7f286bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:09.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.091+0000 7f286bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:09.093 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:09.093 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:09.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 10 librados: watch_flush enter 2026-02-17T11:56:09.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 10 librados: watch_flush exit 2026-02-17T11:56:09.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 20 client.4591.objecter shutdown clearing up homeless session... 2026-02-17T11:56:09.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 10 client.4591.objecter successfully canceled tick 2026-02-17T11:56:09.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2860078e50 msgr2=0x7f286007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:09.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2860078e50 0x7f286007b310 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f287c005980 tx=0x7f287c009040 comp rx=0 tx=0).stop 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 10 monclient: shutdown 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2890155d70 msgr2=0x7f28900cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2890155d70 0x7f28900cb160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2884009db0 tx=0x7f288400c490 comp rx=0 tx=0).stop 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 shutdown_connections 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2860078e50 0x7f286007b310 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2890155d70 0x7f28900cb160 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f289006e720 0x7f28901f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 --2- 10.20.193.10:0/2567815773 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f289006e2d0 0x7f28901f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 >> 10.20.193.10:0/2567815773 conn(0x7f2890074090 msgr2=0x7f28900c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 shutdown_connections 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 -- 10.20.193.10:0/2567815773 wait complete. 2026-02-17T11:56:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:09.092+0000 7f2895ebf640 1 librados: shutdown 2026-02-17T11:56:12.104 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:12.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.173+0000 7f60a94c6640 10 monclient: get_monmap_and_config 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.173+0000 7f60a94c6640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.173+0000 7f60a94c6640 10 monclient: monmap: 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:12.174427+0000 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:12.174427+0000 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:12.177 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.173+0000 7f60a94c6640 1 Processor -- start 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.173+0000 7f60a94c6640 1 -- start start 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.173+0000 7f60a94c6640 10 monclient: init 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 10 monclient: _add_conns ranks=[4,1,0,3,2,5] 2026-02-17T11:56:12.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f60a415d220 0x7f60a415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 10 monclient(hunting): picked mon.noname-b con 0x7f60a415d220 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f60a4074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f60a40c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a40c58a0 con 0x7f60a40c92f0 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a40c55c0 con 0x7f60a4074920 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f60a40c7e20 con 0x7f60a415d220 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a94c6640 10 monclient(hunting): authenticate will time out at 1041.896155s 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a37fe640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f60a40c92f0 0x7f60a4153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:58946/0 (socket says 10.20.193.10:58946) 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a37fe640 1 -- 10.20.193.10:0/2066799709 learned_addr learned my addr 10.20.193.10:0/2066799709 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:12.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.174+0000 7f60a2ffd640 1 --2- 10.20.193.10:0/2066799709 >> v2:10.20.193.71:3300/0 conn(0x7f60a415d220 0x7f60a415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a2ffd640 10 monclient(hunting): get_auth_request con 0x7f60a415d220 auth_method 0 2026-02-17T11:56:12.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a1ffb640 1 -- 10.20.193.10:0/2066799709 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901939069 0 0) 0x7f60a40c58a0 con 0x7f60a40c92f0 2026-02-17T11:56:12.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a1ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:56:12.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a1ffb640 10 monclient(hunting): my global_id is 4548 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.175+0000 7f60a1ffb640 1 -- 10.20.193.10:0/2066799709 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6090003620 con 0x7f60a40c92f0 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.177+0000 7f60a2ffd640 10 monclient(hunting): handle_auth_done global_id 4594 payload 274 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.177+0000 7f60a2ffd640 1 -- 10.20.193.10:0/2066799709 >> v1:10.20.193.71:6789/0 conn(0x7f60a4074920 legacy=0x7f60a40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.177+0000 7f60a2ffd640 1 -- 10.20.193.10:0/2066799709 >> v1:10.20.193.10:6789/0 conn(0x7f60a40c92f0 legacy=0x7f60a4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.177+0000 7f60a2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.177+0000 7f60a2ffd640 1 monclient: found mon.noname-b 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.177+0000 7f60a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.177+0000 7f60a2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.177+0000 7f60a2ffd640 1 -- 10.20.193.10:0/2066799709 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a40c8100 con 0x7f60a415d220 2026-02-17T11:56:12.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.178+0000 7f60a2ffd640 1 --2- 10.20.193.10:0/2066799709 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a415d220 0x7f60a415d600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f60980098d0 tx=0x7f609802eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05dfd2b13baf187 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 1 -- 10.20.193.10:0/2066799709 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609803c070 con 0x7f60a415d220 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 10 monclient: dump: 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:12.186 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 1 -- 10.20.193.10:0/2066799709 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609802fba0 con 0x7f60a415d220 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 1 -- 10.20.193.10:0/2066799709 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098037440 con 0x7f60a415d220 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a94c6640 5 monclient: authenticate success, global_id 4594 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a94c6640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:12.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a94c6640 4 set_mon_vals no callback set 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a1ffb640 10 monclient: dump: 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:12.188 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a94c6640 10 monclient: shutdown 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a94c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a94c6640 1 -- 10.20.193.10:0/2066799709 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a415d220 msgr2=0x7f60a415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.180+0000 7f60a94c6640 1 --2- 10.20.193.10:0/2066799709 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a415d220 0x7f60a415d600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f60980098d0 tx=0x7f609802eed0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 1 -- 10.20.193.10:0/2066799709 shutdown_connections 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 1 --2- 10.20.193.10:0/2066799709 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a415d220 0x7f60a415d600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 1 -- 10.20.193.10:0/2066799709 >> 10.20.193.10:0/2066799709 conn(0x7f60a40c9d80 msgr2=0x7f60a40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 1 -- 10.20.193.10:0/2066799709 shutdown_connections 2026-02-17T11:56:12.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 1 -- 10.20.193.10:0/2066799709 wait complete. 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 10 monclient: build_initial_monmap 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 10 monclient: monmap: 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:12.190 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:12.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 1 librados: starting msgr at 2026-02-17T11:56:12.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 1 librados: starting objecter 2026-02-17T11:56:12.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.181+0000 7f60a94c6640 1 Processor -- start 2026-02-17T11:56:12.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 1 -- start start 2026-02-17T11:56:12.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 1 librados: setting wanted keys 2026-02-17T11:56:12.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 1 librados: calling monclient init 2026-02-17T11:56:12.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient: init 2026-02-17T11:56:12.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a4074920 0x7f60a406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient(hunting): picked mon.noname-b con 0x7f60a4074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f60a40c92f0 0x7f60a4156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient(hunting): picked mon.noname-c con 0x7f60a40c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f60a415d220 0x7f60a4156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient(hunting): picked mon.noname-a con 0x7f60a415d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f60a4074d70 con 0x7f60a415d220 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f60a40c86c0 con 0x7f60a4074920 2026-02-17T11:56:12.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60a4153d60 con 0x7f60a40c92f0 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a94c6640 10 monclient(hunting): authenticate will time out at 1041.904445s 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a2ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a4074920 0x7f60a406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a37fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f60a415d220 0x7f60a4156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a2ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a4074920 0x7f60a406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:36492/0 (socket says 10.20.193.10:36492) 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a2ffd640 1 -- 10.20.193.10:0/392282529 learned_addr learned my addr 10.20.193.10:0/392282529 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a2ffd640 10 monclient(hunting): get_auth_request con 0x7f60a4074920 auth_method 0 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a37fe640 10 monclient(hunting): get_auth_request con 0x7f60a415d220 auth_method 0 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.182+0000 7f60a27fc640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f60a40c92f0 0x7f60a4156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a27fc640 10 monclient(hunting): get_auth_request con 0x7f60a40c92f0 auth_method 0 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.183+0000 7f60a27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 10 monclient(hunting): handle_auth_done global_id 4600 payload 824 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 1 -- 10.20.193.10:0/392282529 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f60a40c92f0 msgr2=0x7f60a4156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f60a40c92f0 0x7f60a4156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 1 -- 10.20.193.10:0/392282529 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f60a415d220 msgr2=0x7f60a4156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f60a415d220 0x7f60a4156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 1 monclient: found mon.noname-b 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.184+0000 7f60a2ffd640 1 -- 10.20.193.10:0/392282529 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a4156090 con 0x7f60a4074920 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.185+0000 7f60a2ffd640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a4074920 0x7f60a406b8b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6098009130 tx=0x7f60980047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.185+0000 7f60837fe640 10 client.?.objecter ms_handle_connect 0x7f60a4074920 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.185+0000 7f60837fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60837fe640 1 -- 10.20.193.10:0/392282529 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098046020 con 0x7f60a4074920 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60837fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60837fe640 10 monclient: dump: 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:12.200 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60837fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60837fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60a94c6640 5 monclient: authenticate success, global_id 4600 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60a94c6640 10 monclient: _renew_subs 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60a94c6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a41f1b10 con 0x7f60a4074920 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60a94c6640 10 client.4600.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60a94c6640 10 monclient: _renew_subs 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60a94c6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:12.201 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a41f20d0 con 0x7f60a4074920 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.186+0000 7f60a94c6640 1 librados: init done 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60837fe640 1 -- 10.20.193.10:0/392282529 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609802fa60 con 0x7f60a4074920 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60837fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60837fe640 1 -- 10.20.193.10:0/392282529 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609803c040 con 0x7f60a4074920 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60837fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60837fe640 10 monclient: dump: 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:12.202 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:12.203 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:12.203 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:12.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60a17fa640 4 set_mon_vals no callback set 2026-02-17T11:56:12.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60a94c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60a94c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60a94c6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:12.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.187+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a415d600 con 0x7f60a4074920 2026-02-17T11:56:12.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.198+0000 7f60837fe640 1 -- 10.20.193.10:0/392282529 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6098053070 con 0x7f60a4074920 2026-02-17T11:56:12.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.199+0000 7f60837fe640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6070078e00 0x7f607007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:12.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.199+0000 7f60a27fc640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6070078e00 0x7f607007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:12.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.199+0000 7f60a27fc640 10 monclient: get_auth_request con 0x7f6070078e00 auth_method 0 2026-02-17T11:56:12.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.199+0000 7f60a27fc640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6070078e00 0x7f607007b2c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f60a40cbda0 tx=0x7f608c007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:12.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.199+0000 7f60837fe640 10 client.4600.objecter ms_handle_connect 0x7f6070078e00 2026-02-17T11:56:12.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.200+0000 7f60837fe640 1 -- 10.20.193.10:0/392282529 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f60980834a0 con 0x7f60a4074920 2026-02-17T11:56:12.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.200+0000 7f60837fe640 10 client.4600.objecter ms_dispatch2 0x7f60a4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:12.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.200+0000 7f60837fe640 3 client.4600.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:12.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.200+0000 7f60837fe640 3 client.4600.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:12.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.200+0000 7f60837fe640 20 client.4600.objecter dump_active .. 0 homeless 2026-02-17T11:56:12.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.300+0000 7f60837fe640 1 -- 10.20.193.10:0/392282529 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6098050020 con 0x7f60a4074920 2026-02-17T11:56:12.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.300+0000 7f60837fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:12.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.300+0000 7f60837fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:12.402 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.400+0000 7f60a94c6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:12.402 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.400+0000 7f60a94c6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:12.402 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.400+0000 7f60a94c6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:12.402 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.400+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f60a41573e0 con 0x7f60a4074920 2026-02-17T11:56:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.403+0000 7f60837fe640 1 -- 10.20.193.10:0/392282529 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f6098087460 con 0x7f60a4074920 2026-02-17T11:56:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.403+0000 7f60837fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.403+0000 7f60837fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:12.405 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:12.405 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 10 librados: watch_flush enter 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 10 librados: watch_flush exit 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 20 client.4600.objecter shutdown clearing up homeless session... 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 10 client.4600.objecter successfully canceled tick 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6070078e00 msgr2=0x7f607007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6070078e00 0x7f607007b2c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f60a40cbda0 tx=0x7f608c007ef0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 10 monclient: shutdown 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a4074920 msgr2=0x7f60a406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a4074920 0x7f60a406b8b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6098009130 tx=0x7f60980047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 shutdown_connections 2026-02-17T11:56:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6070078e00 0x7f607007b2c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f60a415d220 0x7f60a4156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f60a40c92f0 0x7f60a4156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 --2- 10.20.193.10:0/392282529 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f60a4074920 0x7f60a406b8b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.404+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 >> 10.20.193.10:0/392282529 conn(0x7f60a40c9d80 msgr2=0x7f60a40ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.405+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 shutdown_connections 2026-02-17T11:56:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.405+0000 7f60a94c6640 1 -- 10.20.193.10:0/392282529 wait complete. 2026-02-17T11:56:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:12.405+0000 7f60a94c6640 1 librados: shutdown 2026-02-17T11:56:14.862 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:02:32.030 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:14.866 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:02:32.034 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:14.880 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:02:32.049 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:14.892 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:02:32.055 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:14.893 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:02:32.021 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:14.894 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:02:32.057 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:14.894 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:02:32.023 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:14.906 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:02:32.069 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:14.908 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:02:32.036 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:15.416 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:15.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.481+0000 7f0ceaf3e640 10 monclient: get_monmap_and_config 2026-02-17T11:56:15.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.481+0000 7f0ceaf3e640 10 monclient: build_initial_monmap 2026-02-17T11:56:15.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.481+0000 7f0ceaf3e640 10 monclient: monmap: 2026-02-17T11:56:15.483 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:15.483 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:15.482926+0000 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:15.482926+0000 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:15.484 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 1 Processor -- start 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 1 -- start start 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient: init 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient: _add_conns ranks=[4,0,3,1,2,5] 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f0ce415d220 0x7f0ce415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient(hunting): picked mon.noname-b con 0x7f0ce415d220 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0ce4074920 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f0ce40c92f0 0x7f0ce4153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient(hunting): picked mon.noname-a con 0x7f0ce40c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ce40c58a0 con 0x7f0ce4074920 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce40c55c0 con 0x7f0ce40c92f0 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce40c7e20 con 0x7f0ce415d220 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.482+0000 7f0ceaf3e640 10 monclient(hunting): authenticate will time out at 1045.204776s 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce94b4640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f0ce40c92f0 0x7f0ce4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:15.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f0ce415d220 0x7f0ce415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f0ce415d220 0x7f0ce415d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:46032/0 (socket says 10.20.193.10:46032) 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 1 -- 10.20.193.10:0/4128734008 learned_addr learned my addr 10.20.193.10:0/4128734008 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 10 monclient(hunting): get_auth_request con 0x7f0ce415d220 auth_method 0 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce94b4640 10 monclient(hunting): get_auth_request con 0x7f0ce40c92f0 auth_method 0 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce94b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce94b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce94b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce8cb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:15.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce94b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.483+0000 7f0ce94b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.484+0000 7f0ce94b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce94b4640 10 monclient(hunting): handle_auth_done global_id 4554 payload 274 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce94b4640 1 -- 10.20.193.10:0/4128734008 >> v2:10.20.193.71:3300/0 conn(0x7f0ce415d220 msgr2=0x7f0ce415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce94b4640 1 --2- 10.20.193.10:0/4128734008 >> v2:10.20.193.71:3300/0 conn(0x7f0ce415d220 0x7f0ce415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce94b4640 1 -- 10.20.193.10:0/4128734008 >> v1:10.20.193.10:6789/0 conn(0x7f0ce4074920 legacy=0x7f0ce40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce94b4640 10 monclient: _finish_hunting 0 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce94b4640 1 monclient: found mon.noname-a 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce94b4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce94b4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce94b4640 1 -- 10.20.193.10:0/4128734008 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce40c8100 con 0x7f0ce40c92f0 2026-02-17T11:56:15.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.485+0000 7f0ce8cb3640 1 --2- 10.20.193.10:0/4128734008 >> v2:10.20.193.71:3300/0 conn(0x7f0ce415d220 0x7f0ce415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:56:15.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.487+0000 7f0ce94b4640 1 --2- 10.20.193.10:0/4128734008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 0x7f0ce4153650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009d90 tx=0x7f0ce002f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8e877644884088 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 1 -- 10.20.193.10:0/4128734008 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce003c070 con 0x7f0ce40c92f0 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 10 monclient: dump: 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:15.491 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 1 -- 10.20.193.10:0/4128734008 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0037440 con 0x7f0ce40c92f0 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 5 monclient: authenticate success, global_id 4554 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 1 -- 10.20.193.10:0/4128734008 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0037810 con 0x7f0ce40c92f0 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 4 set_mon_vals no callback set 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0cdb7fe640 10 monclient: dump: 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 10 monclient: shutdown 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:15.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/4128734008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 msgr2=0x7f0ce4153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:15.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 1 --2- 10.20.193.10:0/4128734008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 0x7f0ce4153650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009d90 tx=0x7f0ce002f1f0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/4128734008 shutdown_connections 2026-02-17T11:56:15.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 1 --2- 10.20.193.10:0/4128734008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 0x7f0ce4153650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 1 --2- 10.20.193.10:0/4128734008 >> v2:10.20.193.71:3300/0 conn(0x7f0ce415d220 0x7f0ce415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/4128734008 >> 10.20.193.10:0/4128734008 conn(0x7f0ce40c9d80 msgr2=0x7f0ce40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:15.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/4128734008 shutdown_connections 2026-02-17T11:56:15.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.489+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/4128734008 wait complete. 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 10 monclient: build_initial_monmap 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 10 monclient: monmap: 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 1 librados: starting msgr at 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 1 librados: starting objecter 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 1 Processor -- start 2026-02-17T11:56:15.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 1 -- start start 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 1 librados: setting wanted keys 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 1 librados: calling monclient init 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 10 monclient: init 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.490+0000 7f0ceaf3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce4074920 0x7f0ce41f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 10 monclient(hunting): picked mon.noname-c con 0x7f0ce4074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 0x7f0ce41f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 10 monclient(hunting): picked mon.noname-a con 0x7f0ce40c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce415d220 0x7f0ce413c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 10 monclient(hunting): picked mon.noname-b con 0x7f0ce415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce4074d70 con 0x7f0ce40c92f0 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce40c86c0 con 0x7f0ce415d220 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce4153b90 con 0x7f0ce4074920 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ceaf3e640 10 monclient(hunting): authenticate will time out at 1045.213042s 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 0x7f0ce41f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 0x7f0ce41f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:33788/0 (socket says 10.20.193.10:33788) 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 1 -- 10.20.193.10:0/703490561 learned_addr learned my addr 10.20.193.10:0/703490561 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 10 monclient(hunting): get_auth_request con 0x7f0ce40c92f0 auth_method 0 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce8cb3640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce4074920 0x7f0ce41f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce94b4640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce415d220 0x7f0ce413c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce8cb3640 10 monclient(hunting): get_auth_request con 0x7f0ce4074920 auth_method 0 2026-02-17T11:56:15.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce8cb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce8cb3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce8cb3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0cdbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce94b4640 10 monclient(hunting): get_auth_request con 0x7f0ce415d220 auth_method 0 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce94b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce94b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.491+0000 7f0ce94b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.492+0000 7f0ce8cb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.492+0000 7f0ce8cb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.492+0000 7f0ce8cb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.492+0000 7f0ce94b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.492+0000 7f0ce94b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.492+0000 7f0ce94b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 10 monclient(hunting): handle_auth_done global_id 4560 payload 824 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 1 -- 10.20.193.10:0/703490561 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce4074920 msgr2=0x7f0ce41f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:15.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce4074920 0x7f0ce41f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 1 -- 10.20.193.10:0/703490561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce415d220 msgr2=0x7f0ce413c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce415d220 0x7f0ce413c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 1 monclient: found mon.noname-a 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.493+0000 7f0cdbfff640 1 -- 10.20.193.10:0/703490561 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce41e8c10 con 0x7f0ce40c92f0 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.494+0000 7f0cdbfff640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 0x7f0ce41f18a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00c580 tx=0x7f0ccc00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.494+0000 7f0cd97fa640 10 client.?.objecter ms_handle_connect 0x7f0ce40c92f0 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.494+0000 7f0cd97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 1 -- 10.20.193.10:0/703490561 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc017070 con 0x7f0ce40c92f0 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:15.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 10 monclient: dump: 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 1 -- 10.20.193.10:0/703490561 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc0052d0 con 0x7f0ce40c92f0 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 1 -- 10.20.193.10:0/703490561 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0036b0 con 0x7f0ce40c92f0 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cd97fa640 10 monclient: dump: 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:15.498 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0cdaffd640 4 set_mon_vals no callback set 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0ceaf3e640 5 monclient: authenticate success, global_id 4560 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0ceaf3e640 10 monclient: _renew_subs 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0ceaf3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce41f27a0 con 0x7f0ce40c92f0 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0ceaf3e640 10 client.4560.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0ceaf3e640 10 monclient: _renew_subs 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0ceaf3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce41f1f00 con 0x7f0ce40c92f0 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.495+0000 7f0ceaf3e640 1 librados: init done 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.496+0000 7f0ceaf3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.496+0000 7f0ceaf3e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.496+0000 7f0ceaf3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:15.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.496+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce4153f70 con 0x7f0ce40c92f0 2026-02-17T11:56:15.508 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.507+0000 7f0cd97fa640 1 -- 10.20.193.10:0/703490561 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f0ccc003850 con 0x7f0ce40c92f0 2026-02-17T11:56:15.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.507+0000 7f0cd97fa640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb4078e00 0x7f0cb407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:15.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.507+0000 7f0ce8cb3640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb4078e00 0x7f0cb407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:15.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.507+0000 7f0ce8cb3640 10 monclient: get_auth_request con 0x7f0cb4078e00 auth_method 0 2026-02-17T11:56:15.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.508+0000 7f0cd97fa640 10 client.4560.objecter ms_handle_connect 0x7f0cb4078e00 2026-02-17T11:56:15.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.508+0000 7f0ce8cb3640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb4078e00 0x7f0cb407b2c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4006da0 tx=0x7f0cd4009340 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:15.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.509+0000 7f0cd97fa640 1 -- 10.20.193.10:0/703490561 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f0ccc05d1b0 con 0x7f0ce40c92f0 2026-02-17T11:56:15.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.509+0000 7f0cd97fa640 10 client.4560.objecter ms_dispatch2 0x7f0ce4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:15.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.509+0000 7f0cd97fa640 3 client.4560.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:15.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.509+0000 7f0cd97fa640 3 client.4560.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:15.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.509+0000 7f0cd97fa640 20 client.4560.objecter dump_active .. 0 homeless 2026-02-17T11:56:15.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.609+0000 7f0cd97fa640 1 -- 10.20.193.10:0/703490561 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0ccc021080 con 0x7f0ce40c92f0 2026-02-17T11:56:15.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.609+0000 7f0cd97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:15.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.609+0000 7f0cd97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:15.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.707+0000 7f0ceaf3e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:15.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.707+0000 7f0ceaf3e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:15.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.707+0000 7f0ceaf3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:15.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.707+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0ce41573e0 con 0x7f0ce40c92f0 2026-02-17T11:56:15.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.710+0000 7f0cd97fa640 1 -- 10.20.193.10:0/703490561 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f0ccc061170 con 0x7f0ce40c92f0 2026-02-17T11:56:15.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.710+0000 7f0cd97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:15.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.710+0000 7f0cd97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:15.712 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:15.712 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 10 librados: watch_flush enter 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 10 librados: watch_flush exit 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 20 client.4560.objecter shutdown clearing up homeless session... 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 10 client.4560.objecter successfully canceled tick 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb4078e00 msgr2=0x7f0cb407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb4078e00 0x7f0cb407b2c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4006da0 tx=0x7f0cd4009340 comp rx=0 tx=0).stop 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 10 monclient: shutdown 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 msgr2=0x7f0ce41f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 0x7f0ce41f18a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00c580 tx=0x7f0ccc00ca50 comp rx=0 tx=0).stop 2026-02-17T11:56:15.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 shutdown_connections 2026-02-17T11:56:15.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb4078e00 0x7f0cb407b2c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce415d220 0x7f0ce413c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce40c92f0 0x7f0ce41f18a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 --2- 10.20.193.10:0/703490561 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce4074920 0x7f0ce41f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:15.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 >> 10.20.193.10:0/703490561 conn(0x7f0ce40c9d80 msgr2=0x7f0ce414df20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:15.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 shutdown_connections 2026-02-17T11:56:15.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 -- 10.20.193.10:0/703490561 wait complete. 2026-02-17T11:56:15.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:15.712+0000 7f0ceaf3e640 1 librados: shutdown 2026-02-17T11:56:18.723 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:18.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.791+0000 7f79d9371640 10 monclient: get_monmap_and_config 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.791+0000 7f79d9371640 10 monclient: build_initial_monmap 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.791+0000 7f79d9371640 10 monclient: monmap: 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:18.792534+0000 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:18.792534+0000 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:18.794 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:18.795 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:18.795 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:18.795 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:18.795 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:18.795 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:18.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.791+0000 7f79d9371640 1 Processor -- start 2026-02-17T11:56:18.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.791+0000 7f79d9371640 1 -- start start 2026-02-17T11:56:18.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.791+0000 7f79d9371640 10 monclient: init 2026-02-17T11:56:18.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:18.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 10 monclient: _add_conns ranks=[0,3,1,4,5,2] 2026-02-17T11:56:18.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f79d415d220 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f79d40c92f0 0x7f79d415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 10 monclient(hunting): picked mon.noname-a con 0x7f79d40c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f79d4074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79d40c58a0 con 0x7f79d415d220 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79d40c55c0 con 0x7f79d4074920 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f79d40c7e20 con 0x7f79d40c92f0 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d9371640 10 monclient(hunting): authenticate will time out at 1048.514272s 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d27fc640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f79d40c92f0 0x7f79d415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:18.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d37fe640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f79d4074920 0x7f79d4153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:45820/0 (socket says 10.20.193.10:45820) 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d37fe640 1 -- 10.20.193.10:0/323564315 learned_addr learned my addr 10.20.193.10:0/323564315 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d27fc640 10 monclient(hunting): get_auth_request con 0x7f79d40c92f0 auth_method 0 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.792+0000 7f79d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.793+0000 7f79d27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.793+0000 7f79d27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.793+0000 7f79d27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d1ffb640 1 -- 10.20.193.10:0/323564315 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370274114 0 0) 0x7f79d40c55c0 con 0x7f79d4074920 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d1ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:18.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d1ffb640 10 monclient(hunting): my global_id is 4609 2026-02-17T11:56:18.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d1ffb640 1 -- 10.20.193.10:0/323564315 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79c0003620 con 0x7f79d4074920 2026-02-17T11:56:18.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d27fc640 10 monclient(hunting): handle_auth_done global_id 4563 payload 274 2026-02-17T11:56:18.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d27fc640 1 -- 10.20.193.10:0/323564315 >> v1:10.20.193.71:6789/0 conn(0x7f79d4074920 legacy=0x7f79d4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:18.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d27fc640 1 -- 10.20.193.10:0/323564315 >> v1:10.20.193.10:6789/0 conn(0x7f79d415d220 legacy=0x7f79d40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:18.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d27fc640 10 monclient: _finish_hunting 0 2026-02-17T11:56:18.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d27fc640 1 monclient: found mon.noname-a 2026-02-17T11:56:18.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:18.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d27fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:18.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.794+0000 7f79d27fc640 1 -- 10.20.193.10:0/323564315 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d40c8100 con 0x7f79d40c92f0 2026-02-17T11:56:18.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.796+0000 7f79d27fc640 1 --2- 10.20.193.10:0/323564315 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d40c92f0 0x7f79d415d600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0098d0 tx=0x7f79bc02eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bde75c8249de33 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:18.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 1 -- 10.20.193.10:0/323564315 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc03c070 con 0x7f79d40c92f0 2026-02-17T11:56:18.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:18.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:18.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 10 monclient: dump: 2026-02-17T11:56:18.807 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:18.807 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:18.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 1 -- 10.20.193.10:0/323564315 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79bc02fba0 con 0x7f79d40c92f0 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 1 -- 10.20.193.10:0/323564315 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc037440 con 0x7f79d40c92f0 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d1ffb640 10 monclient: dump: 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:18.809 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 5 monclient: authenticate success, global_id 4563 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 4 set_mon_vals no callback set 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 10 monclient: shutdown 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:18.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 1 -- 10.20.193.10:0/323564315 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d40c92f0 msgr2=0x7f79d415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 1 --2- 10.20.193.10:0/323564315 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d40c92f0 0x7f79d415d600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0098d0 tx=0x7f79bc02eed0 comp rx=0 tx=0).stop 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 1 -- 10.20.193.10:0/323564315 shutdown_connections 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 1 --2- 10.20.193.10:0/323564315 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d40c92f0 0x7f79d415d600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 1 -- 10.20.193.10:0/323564315 >> 10.20.193.10:0/323564315 conn(0x7f79d40c9d80 msgr2=0x7f79d40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 1 -- 10.20.193.10:0/323564315 shutdown_connections 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.798+0000 7f79d9371640 1 -- 10.20.193.10:0/323564315 wait complete. 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.799+0000 7f79d9371640 10 monclient: build_initial_monmap 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.799+0000 7f79d9371640 10 monclient: monmap: 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:18.811 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.799+0000 7f79d9371640 1 librados: starting msgr at 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.799+0000 7f79d9371640 1 librados: starting objecter 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.799+0000 7f79d9371640 1 Processor -- start 2026-02-17T11:56:18.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.799+0000 7f79d9371640 1 -- start start 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.799+0000 7f79d9371640 1 librados: setting wanted keys 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.799+0000 7f79d9371640 1 librados: calling monclient init 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.799+0000 7f79d9371640 10 monclient: init 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d4074920 0x7f79d41f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient(hunting): picked mon.noname-a con 0x7f79d4074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f79d40c92f0 0x7f79d4140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient(hunting): picked mon.noname-c con 0x7f79d40c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f79d415d220 0x7f79d415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient(hunting): picked mon.noname-b con 0x7f79d415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:18.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4074d70 con 0x7f79d4074920 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40c86c0 con 0x7f79d415d220 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4153d60 con 0x7f79d40c92f0 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d9371640 10 monclient(hunting): authenticate will time out at 1048.522178s 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d4074920 0x7f79d41f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d37fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f79d415d220 0x7f79d415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d4074920 0x7f79d41f3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:33814/0 (socket says 10.20.193.10:33814) 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 1 -- 10.20.193.10:0/4241665851 learned_addr learned my addr 10.20.193.10:0/4241665851 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 10 monclient(hunting): get_auth_request con 0x7f79d4074920 auth_method 0 2026-02-17T11:56:18.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d27fc640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f79d40c92f0 0x7f79d4140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d37fe640 10 monclient(hunting): get_auth_request con 0x7f79d415d220 auth_method 0 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d27fc640 10 monclient(hunting): get_auth_request con 0x7f79d40c92f0 auth_method 0 2026-02-17T11:56:18.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.800+0000 7f79d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.801+0000 7f79d37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.801+0000 7f79d37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.801+0000 7f79d37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.801+0000 7f79d27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.801+0000 7f79d27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.801+0000 7f79d27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 10 monclient(hunting): handle_auth_done global_id 4569 payload 824 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 1 -- 10.20.193.10:0/4241665851 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f79d40c92f0 msgr2=0x7f79d4140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f79d40c92f0 0x7f79d4140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 1 -- 10.20.193.10:0/4241665851 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f79d415d220 msgr2=0x7f79d415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:18.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f79d415d220 0x7f79d415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 1 monclient: found mon.noname-a 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.802+0000 7f79d2ffd640 1 -- 10.20.193.10:0/4241665851 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d415b300 con 0x7f79d4074920 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.803+0000 7f79d2ffd640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d4074920 0x7f79d41f3aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79c800c700 tx=0x7f79c800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.803+0000 7f79b37fe640 10 client.?.objecter ms_handle_connect 0x7f79d4074920 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.803+0000 7f79b37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 1 -- 10.20.193.10:0/4241665851 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c80052d0 con 0x7f79d4074920 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 10 monclient: dump: 2026-02-17T11:56:18.817 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:18.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 5 monclient: authenticate success, global_id 4569 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 10 monclient: _renew_subs 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d41f3fe0 con 0x7f79d4074920 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 10 client.4569.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 10 monclient: _renew_subs 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d41f4590 con 0x7f79d4074920 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 1 librados: init done 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:18.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d415d600 con 0x7f79d4074920 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 1 -- 10.20.193.10:0/4241665851 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c8005470 con 0x7f79d4074920 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 1 -- 10.20.193.10:0/4241665851 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c800a840 con 0x7f79d4074920 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79d17fa640 4 set_mon_vals no callback set 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.804+0000 7f79b37fe640 10 monclient: dump: 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:18.820 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:18.821 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:18.821 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:18.821 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:18.821 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:18.821 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:18.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.908+0000 7f79b37fe640 1 -- 10.20.193.10:0/4241665851 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f79c800a9e0 con 0x7f79d4074920 2026-02-17T11:56:18.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.909+0000 7f79b37fe640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f79a0078e00 0x7f79a007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:18.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.909+0000 7f79d27fc640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f79a0078e00 0x7f79a007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:18.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.909+0000 7f79d27fc640 10 monclient: get_auth_request con 0x7f79a0078e00 auth_method 0 2026-02-17T11:56:18.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.909+0000 7f79b37fe640 10 client.4569.objecter ms_handle_connect 0x7f79a0078e00 2026-02-17T11:56:18.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.909+0000 7f79d27fc640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f79a0078e00 0x7f79a007b2c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f79bc039000 tx=0x7f79bc033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:18.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.917+0000 7f79b37fe640 1 -- 10.20.193.10:0/4241665851 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f79c800ad00 con 0x7f79d4074920 2026-02-17T11:56:18.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.917+0000 7f79b37fe640 10 client.4569.objecter ms_dispatch2 0x7f79d4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:18.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.917+0000 7f79b37fe640 3 client.4569.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:18.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.917+0000 7f79b37fe640 3 client.4569.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:18.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.917+0000 7f79b37fe640 20 client.4569.objecter dump_active .. 0 homeless 2026-02-17T11:56:18.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.917+0000 7f79b37fe640 1 -- 10.20.193.10:0/4241665851 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f79c8061fe0 con 0x7f79d4074920 2026-02-17T11:56:18.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.917+0000 7f79b37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:18.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:18.917+0000 7f79b37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:19.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.016+0000 7f79d9371640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:19.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.016+0000 7f79d9371640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:19.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.016+0000 7f79d9371640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:19.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.016+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f79d41573e0 con 0x7f79d4074920 2026-02-17T11:56:19.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.019+0000 7f79b37fe640 1 -- 10.20.193.10:0/4241665851 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f79c80662e0 con 0x7f79d4074920 2026-02-17T11:56:19.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.019+0000 7f79b37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:19.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.019+0000 7f79b37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:19.021 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:19.022 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:19.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 10 librados: watch_flush enter 2026-02-17T11:56:19.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 10 librados: watch_flush exit 2026-02-17T11:56:19.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 20 client.4569.objecter shutdown clearing up homeless session... 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 10 client.4569.objecter successfully canceled tick 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f79a0078e00 msgr2=0x7f79a007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f79a0078e00 0x7f79a007b2c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f79bc039000 tx=0x7f79bc033000 comp rx=0 tx=0).stop 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 10 monclient: shutdown 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d4074920 msgr2=0x7f79d41f3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d4074920 0x7f79d41f3aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79c800c700 tx=0x7f79c800cbd0 comp rx=0 tx=0).stop 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 shutdown_connections 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f79a0078e00 0x7f79a007b2c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f79d415d220 0x7f79d415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f79d40c92f0 0x7f79d4140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:19.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 --2- 10.20.193.10:0/4241665851 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f79d4074920 0x7f79d41f3aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:19.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 >> 10.20.193.10:0/4241665851 conn(0x7f79d40c9d80 msgr2=0x7f79d406fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:19.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 shutdown_connections 2026-02-17T11:56:19.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 -- 10.20.193.10:0/4241665851 wait complete. 2026-02-17T11:56:19.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:19.020+0000 7f79d9371640 1 librados: shutdown 2026-02-17T11:56:22.032 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:22.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.098+0000 7f00bb81a640 10 monclient: get_monmap_and_config 2026-02-17T11:56:22.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.098+0000 7f00bb81a640 10 monclient: build_initial_monmap 2026-02-17T11:56:22.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.098+0000 7f00bb81a640 10 monclient: monmap: 2026-02-17T11:56:22.100 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:22.100 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:22.099390+0000 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:22.099390+0000 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.098+0000 7f00bb81a640 1 Processor -- start 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.098+0000 7f00bb81a640 1 -- start start 2026-02-17T11:56:22.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.098+0000 7f00bb81a640 10 monclient: init 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 10 monclient: _add_conns ranks=[0,1,2,5,4,3] 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f00b4152660 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f00b415b030 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f00b40c6ce0 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b40c71e0 con 0x7f00b4152660 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b40c74c0 con 0x7f00b415b030 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b4159e40 con 0x7f00b40c6ce0 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:22.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00bb81a640 10 monclient(hunting): authenticate will time out at 1051.821118s 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00b8d8e640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f00b415b030 0x7f00b40c8dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:45834/0 (socket says 10.20.193.10:45834) 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.099+0000 7f00b8d8e640 1 -- 10.20.193.10:0/1106928041 learned_addr learned my addr 10.20.193.10:0/1106928041 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.100+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410721456 0 0) 0x7f00b40c71e0 con 0x7f00b4152660 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.100+0000 7f00a3fff640 10 monclient(hunting): _negotiate 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.100+0000 7f00a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.100+0000 7f00a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.100+0000 7f00a3fff640 10 monclient(hunting): my global_id is 4572 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.100+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f009c003620 con 0x7f00b4152660 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156881271 0 0) 0x7f00b40c74c0 con 0x7f00b415b030 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 10 monclient(hunting): _negotiate 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 10 monclient(hunting): my global_id is 4615 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b40c71e0 con 0x7f00b415b030 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966770257 0 0) 0x7f00b4159e40 con 0x7f00b40c6ce0 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 10 monclient(hunting): _negotiate 2026-02-17T11:56:22.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:22.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 10 monclient(hunting): my global_id is 4628 2026-02-17T11:56:22.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.101+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b40c74c0 con 0x7f00b40c6ce0 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1957510329 0 0) 0x7f009c003620 con 0x7f00b4152660 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 >> v1:10.20.193.153:6789/0 conn(0x7f00b40c6ce0 legacy=0x7f00b41631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 >> v1:10.20.193.71:6789/0 conn(0x7f00b415b030 legacy=0x7f00b40c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b415a120 con 0x7f00b4152660 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient: _finish_auth 0 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f00a4002f20 con 0x7f00b4152660 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:56:22.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient: dump: 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 >> v1:10.20.193.10:6789/0 conn(0x7f00b4152660 legacy=0x7f00b415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f009c003fc0 0x7f009c004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient(hunting): picked mon.c con 0x7f009c003fc0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f009c0044d0 0x7f009c004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient(hunting): picked mon.b con 0x7f009c0044d0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:22.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c009ab0 0x7f009c00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient(hunting): picked mon.a con 0x7f009c009ab0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f009c00c510 con 0x7f009c009ab0 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f009c00c6c0 con 0x7f009c0044d0 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f009c00c8c0 con 0x7f009c003fc0 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.102+0000 7f00a3fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b958f640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f009c003fc0 0x7f009c004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b8d8e640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f009c0044d0 0x7f009c004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b8d8e640 10 monclient(hunting): get_auth_request con 0x7f009c0044d0 auth_method 0 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b8d8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b8d8e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b8d8e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b958f640 10 monclient(hunting): get_auth_request con 0x7f009c003fc0 auth_method 0 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b958f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b958f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.103+0000 7f00b958f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b8d8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:22.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b8d8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b8d8e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b9d90640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c009ab0 0x7f009c00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b958f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b958f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b958f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b9d90640 10 monclient(hunting): get_auth_request con 0x7f009c009ab0 auth_method 0 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b9d90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b9d90640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b9d90640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b9d90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b9d90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.104+0000 7f00b9d90640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 10 monclient(hunting): handle_auth_done global_id 4572 payload 293 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 1 -- 10.20.193.10:0/1106928041 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f009c003fc0 msgr2=0x7f009c004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f009c003fc0 0x7f009c004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 1 -- 10.20.193.10:0/1106928041 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c009ab0 msgr2=0x7f009c00bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c009ab0 0x7f009c00bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 10 monclient: _finish_hunting 0 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 1 monclient: found mon.b 2026-02-17T11:56:22.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b9d90640 1 -- 10.20.193.10:0/1106928041 reap_dead start 2026-02-17T11:56:22.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:22.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:22.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 1 -- 10.20.193.10:0/1106928041 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009c003620 con 0x7f009c0044d0 2026-02-17T11:56:22.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 10 monclient: _finish_auth 0 2026-02-17T11:56:22.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 10 monclient: _check_auth_tickets 2026-02-17T11:56:22.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00b8d8e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:22.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00bb81a640 5 monclient: authenticate success, global_id 4572 2026-02-17T11:56:22.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.105+0000 7f00bb81a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:22.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.106+0000 7f00b8d8e640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f009c0044d0 0x7f009c004ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c240 tx=0x7f00a802f4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cec29e54db4aa825 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8007ce0 con 0x7f009c0044d0 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 10 monclient: dump: 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:22.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00bb81a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a8033030 con 0x7f009c0044d0 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 1 -- 10.20.193.10:0/1106928041 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a802fe60 con 0x7f009c0044d0 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00bb81a640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00bb81a640 4 set_mon_vals no callback set 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.107+0000 7f00a3fff640 10 monclient: dump: 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 10 monclient: shutdown 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 -- 10.20.193.10:0/1106928041 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f009c0044d0 msgr2=0x7f009c004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f009c0044d0 0x7f009c004ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c240 tx=0x7f00a802f4a0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 -- 10.20.193.10:0/1106928041 shutdown_connections 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 --2- 10.20.193.10:0/1106928041 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f009c0044d0 0x7f009c004ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 -- 10.20.193.10:0/1106928041 >> 10.20.193.10:0/1106928041 conn(0x7f00b40c9d80 msgr2=0x7f00b40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 -- 10.20.193.10:0/1106928041 shutdown_connections 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 -- 10.20.193.10:0/1106928041 wait complete. 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 10 monclient: build_initial_monmap 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 10 monclient: monmap: 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 librados: starting msgr at 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 librados: starting objecter 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 Processor -- start 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 -- start start 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 librados: setting wanted keys 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 1 librados: calling monclient init 2026-02-17T11:56:22.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.108+0000 7f00bb81a640 10 monclient: init 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c0044d0 0x7f00b406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient(hunting): picked mon.noname-a con 0x7f009c0044d0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f00b406bdf0 0x7f00b406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient(hunting): picked mon.noname-b con 0x7f00b406bdf0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f00b4155a10 0x7f00b406e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient(hunting): picked mon.noname-c con 0x7f00b4155a10 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4152a40 con 0x7f009c0044d0 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f00b40c77a0 con 0x7f00b406bdf0 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4152bc0 con 0x7f00b4155a10 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00bb81a640 10 monclient(hunting): authenticate will time out at 1051.831364s 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c0044d0 0x7f00b406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b8d8e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f00b406bdf0 0x7f00b406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b9d90640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f00b4155a10 0x7f00b406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c0044d0 0x7f00b406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:33840/0 (socket says 10.20.193.10:33840) 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 1 -- 10.20.193.10:0/3720391131 learned_addr learned my addr 10.20.193.10:0/3720391131 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 10 monclient(hunting): get_auth_request con 0x7f009c0044d0 auth_method 0 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b8d8e640 10 monclient(hunting): get_auth_request con 0x7f00b406bdf0 auth_method 0 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b8d8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b8d8e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b8d8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b9d90640 10 monclient(hunting): get_auth_request con 0x7f00b4155a10 auth_method 0 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b9d90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b9d90640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b9d90640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.109+0000 7f00b958f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.110+0000 7f00b8d8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.110+0000 7f00b8d8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.110+0000 7f00b8d8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.110+0000 7f00b9d90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.110+0000 7f00b9d90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.110+0000 7f00b9d90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 10 monclient(hunting): handle_auth_done global_id 4575 payload 824 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 1 -- 10.20.193.10:0/3720391131 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f00b4155a10 msgr2=0x7f00b406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f00b4155a10 0x7f00b406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 1 -- 10.20.193.10:0/3720391131 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f00b406bdf0 msgr2=0x7f00b406dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f00b406bdf0 0x7f00b406dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 10 monclient: _finish_hunting 0 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 1 monclient: found mon.noname-a 2026-02-17T11:56:22.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:22.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:22.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.111+0000 7f00b958f640 1 -- 10.20.193.10:0/3720391131 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b41f7fb0 con 0x7f009c0044d0 2026-02-17T11:56:22.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.112+0000 7f00b958f640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c0044d0 0x7f00b406b8b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f00a400fb10 tx=0x7f00a4002ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:22.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.112+0000 7f00a1ffb640 10 client.?.objecter ms_handle_connect 0x7f009c0044d0 2026-02-17T11:56:22.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.112+0000 7f00a1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 1 -- 10.20.193.10:0/3720391131 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4018020 con 0x7f009c0044d0 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 10 monclient: dump: 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 1 -- 10.20.193.10:0/3720391131 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a400d940 con 0x7f009c0044d0 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00bb81a640 5 monclient: authenticate success, global_id 4575 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00bb81a640 10 monclient: _renew_subs 2026-02-17T11:56:22.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00bb81a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b41f3c10 con 0x7f009c0044d0 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 1 -- 10.20.193.10:0/3720391131 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a400dd50 con 0x7f009c0044d0 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a1ffb640 10 monclient: dump: 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00a37fe640 4 set_mon_vals no callback set 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00bb81a640 10 client.4575.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00bb81a640 10 monclient: _renew_subs 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00bb81a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b41f41d0 con 0x7f009c0044d0 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.113+0000 7f00bb81a640 1 librados: init done 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.114+0000 7f00bb81a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.114+0000 7f00bb81a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.114+0000 7f00bb81a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:22.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.114+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b414dc20 con 0x7f009c0044d0 2026-02-17T11:56:22.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.126+0000 7f00a1ffb640 1 -- 10.20.193.10:0/3720391131 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f00a4014470 con 0x7f009c0044d0 2026-02-17T11:56:22.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.126+0000 7f00a1ffb640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0084078e80 0x7f008407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:22.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.126+0000 7f00b8d8e640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0084078e80 0x7f008407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:22.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.126+0000 7f00b8d8e640 10 monclient: get_auth_request con 0x7f0084078e80 auth_method 0 2026-02-17T11:56:22.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.127+0000 7f00b8d8e640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0084078e80 0x7f008407b340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00a8033000 tx=0x7f00a8006000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:22.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.127+0000 7f00a1ffb640 10 client.4575.objecter ms_handle_connect 0x7f0084078e80 2026-02-17T11:56:22.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.228+0000 7f00a1ffb640 1 -- 10.20.193.10:0/3720391131 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f00a405e2d0 con 0x7f009c0044d0 2026-02-17T11:56:22.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.228+0000 7f00a1ffb640 10 client.4575.objecter ms_dispatch2 0x7f00b4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:22.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.228+0000 7f00a1ffb640 3 client.4575.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:22.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.228+0000 7f00a1ffb640 3 client.4575.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:22.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.228+0000 7f00a1ffb640 20 client.4575.objecter dump_active .. 0 homeless 2026-02-17T11:56:22.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.228+0000 7f00a1ffb640 1 -- 10.20.193.10:0/3720391131 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f00b414dc20 con 0x7f009c0044d0 2026-02-17T11:56:22.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.228+0000 7f00a1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:22.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.228+0000 7f00a1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:22.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.328+0000 7f00bb81a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:22.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.329+0000 7f00bb81a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:22.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.329+0000 7f00bb81a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:22.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.329+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f00b40c7950 con 0x7f009c0044d0 2026-02-17T11:56:22.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.331+0000 7f00a1ffb640 1 -- 10.20.193.10:0/3720391131 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f00b40c7950 con 0x7f009c0044d0 2026-02-17T11:56:22.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.331+0000 7f00a1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:22.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.331+0000 7f00a1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:22.333 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:22.333 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:22.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 10 librados: watch_flush enter 2026-02-17T11:56:22.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 10 librados: watch_flush exit 2026-02-17T11:56:22.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 20 client.4575.objecter shutdown clearing up homeless session... 2026-02-17T11:56:22.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 10 client.4575.objecter successfully canceled tick 2026-02-17T11:56:22.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0084078e80 msgr2=0x7f008407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0084078e80 0x7f008407b340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00a8033000 tx=0x7f00a8006000 comp rx=0 tx=0).stop 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 10 monclient: shutdown 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c0044d0 msgr2=0x7f00b406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c0044d0 0x7f00b406b8b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f00a400fb10 tx=0x7f00a4002ef0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 shutdown_connections 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0084078e80 0x7f008407b340 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f00b4155a10 0x7f00b406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f00b406bdf0 0x7f00b406dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 --2- 10.20.193.10:0/3720391131 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f009c0044d0 0x7f00b406b8b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 >> 10.20.193.10:0/3720391131 conn(0x7f00b40c9d80 msgr2=0x7f00b414f460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:22.336 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 shutdown_connections 2026-02-17T11:56:22.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 -- 10.20.193.10:0/3720391131 wait complete. 2026-02-17T11:56:22.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:22.332+0000 7f00bb81a640 1 librados: shutdown 2026-02-17T11:56:25.343 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:25.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.411+0000 7fd170d34640 10 monclient: get_monmap_and_config 2026-02-17T11:56:25.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.411+0000 7fd170d34640 10 monclient: build_initial_monmap 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.411+0000 7fd170d34640 10 monclient: monmap: 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:25.412318+0000 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:25.412318+0000 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:25.414 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:25.415 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:25.415 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:25.415 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:25.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.411+0000 7fd170d34640 1 Processor -- start 2026-02-17T11:56:25.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.411+0000 7fd170d34640 1 -- start start 2026-02-17T11:56:25.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.411+0000 7fd170d34640 10 monclient: init 2026-02-17T11:56:25.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.411+0000 7fd170d34640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:25.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 10 monclient: _add_conns ranks=[2,5,0,1,3,4] 2026-02-17T11:56:25.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd16c152660 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fd16c15b030 0x7fd16c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 10 monclient(hunting): picked mon.noname-c con 0x7fd16c15b030 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd16c152a40 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c0c71e0 con 0x7fd16c152a40 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c0c74c0 con 0x7fd16c152660 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd16c0c77a0 con 0x7fd16c15b030 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd170d34640 10 monclient(hunting): authenticate will time out at 1055.134067s 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd16ad76640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fd16c152a40 0x7fd16c0c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:54124/0 (socket says 10.20.193.10:54124) 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd16ad76640 1 -- 10.20.193.10:0/3105492886 learned_addr learned my addr 10.20.193.10:0/3105492886 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:25.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd169d74640 1 --2- 10.20.193.10:0/3105492886 >> v2:10.20.193.153:3300/0 conn(0x7fd16c15b030 0x7fd16c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd169d74640 10 monclient(hunting): get_auth_request con 0x7fd16c15b030 auth_method 0 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd169d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd169d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.412+0000 7fd169d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.413+0000 7fd169d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.413+0000 7fd169d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.413+0000 7fd169d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.413+0000 7fd169573640 1 -- 10.20.193.10:0/3105492886 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1541858990 0 0) 0x7fd16c0c71e0 con 0x7fd16c152a40 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.413+0000 7fd169573640 10 monclient(hunting): _negotiate 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.413+0000 7fd169573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.413+0000 7fd169573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:25.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.413+0000 7fd169573640 10 monclient(hunting): my global_id is 4578 2026-02-17T11:56:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.413+0000 7fd169573640 1 -- 10.20.193.10:0/3105492886 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd158003620 con 0x7fd16c152a40 2026-02-17T11:56:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.415+0000 7fd169d74640 10 monclient(hunting): handle_auth_done global_id 4634 payload 274 2026-02-17T11:56:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.415+0000 7fd169d74640 1 -- 10.20.193.10:0/3105492886 >> v1:10.20.193.153:6789/0 conn(0x7fd16c152660 legacy=0x7fd16c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.415+0000 7fd169d74640 1 -- 10.20.193.10:0/3105492886 >> v1:10.20.193.10:6789/0 conn(0x7fd16c152a40 legacy=0x7fd16c0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.415+0000 7fd169d74640 10 monclient: _finish_hunting 0 2026-02-17T11:56:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.415+0000 7fd169d74640 1 monclient: found mon.noname-c 2026-02-17T11:56:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.415+0000 7fd169d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.415+0000 7fd169d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:25.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.415+0000 7fd169d74640 1 -- 10.20.193.10:0/3105492886 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c159e40 con 0x7fd16c15b030 2026-02-17T11:56:25.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.416+0000 7fd169d74640 1 --2- 10.20.193.10:0/3105492886 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 0x7fd16c0c8dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1540098a0 tx=0x7fd15402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=666f677c1e2a0f29 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 1 -- 10.20.193.10:0/3105492886 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15403c070 con 0x7fd16c15b030 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 10 monclient: dump: 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:25.426 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 10 monclient: _finish_auth 0 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 10 monclient: _check_auth_tickets 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 1 -- 10.20.193.10:0/3105492886 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15402fb70 con 0x7fd16c15b030 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 1 -- 10.20.193.10:0/3105492886 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154037440 con 0x7fd16c15b030 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 5 monclient: authenticate success, global_id 4634 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 4 set_mon_vals no callback set 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd169573640 10 monclient: dump: 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 10 monclient: shutdown 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 1 -- 10.20.193.10:0/3105492886 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 msgr2=0x7fd16c0c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 1 --2- 10.20.193.10:0/3105492886 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 0x7fd16c0c8dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1540098a0 tx=0x7fd15402ee60 comp rx=0 tx=0).stop 2026-02-17T11:56:25.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 1 -- 10.20.193.10:0/3105492886 shutdown_connections 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 1 --2- 10.20.193.10:0/3105492886 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 0x7fd16c0c8dd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 1 -- 10.20.193.10:0/3105492886 >> 10.20.193.10:0/3105492886 conn(0x7fd16c0c9d80 msgr2=0x7fd16c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 1 -- 10.20.193.10:0/3105492886 shutdown_connections 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.418+0000 7fd170d34640 1 -- 10.20.193.10:0/3105492886 wait complete. 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient: build_initial_monmap 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient: monmap: 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 librados: starting msgr at 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 librados: starting objecter 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 Processor -- start 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 -- start start 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 librados: setting wanted keys 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 librados: calling monclient init 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient: init 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd16c152660 0x7fd16c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient(hunting): picked mon.noname-a con 0x7fd16c152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd16c152a40 0x7fd16c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient(hunting): picked mon.noname-b con 0x7fd16c152a40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 0x7fd16c13f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient(hunting): picked mon.noname-c con 0x7fd16c15b030 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c0c9310 con 0x7fd16c152660 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c15a400 con 0x7fd16c152a40 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c0c9490 con 0x7fd16c15b030 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.419+0000 7fd170d34640 10 monclient(hunting): authenticate will time out at 1055.141970s 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 0x7fd16c13f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16a575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd16c152660 0x7fd16c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd169d74640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd16c152a40 0x7fd16c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:25.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 0x7fd16c13f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:39172/0 (socket says 10.20.193.10:39172) 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 1 -- 10.20.193.10:0/3030478111 learned_addr learned my addr 10.20.193.10:0/3030478111 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 10 monclient(hunting): get_auth_request con 0x7fd16c15b030 auth_method 0 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16a575640 10 monclient(hunting): get_auth_request con 0x7fd16c152660 auth_method 0 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd169d74640 10 monclient(hunting): get_auth_request con 0x7fd16c152a40 auth_method 0 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd169d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd169d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd169d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.420+0000 7fd16a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.421+0000 7fd169d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.421+0000 7fd169d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.421+0000 7fd169d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 10 monclient(hunting): handle_auth_done global_id 4640 payload 824 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 1 -- 10.20.193.10:0/3030478111 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd16c152a40 msgr2=0x7fd16c0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd16c152a40 0x7fd16c0cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 1 -- 10.20.193.10:0/3030478111 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd16c152660 msgr2=0x7fd16c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd16c152660 0x7fd16c0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 1 monclient: found mon.noname-c 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:25.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.422+0000 7fd16ad76640 1 -- 10.20.193.10:0/3030478111 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c0cc400 con 0x7fd16c15b030 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.424+0000 7fd16ad76640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 0x7fd16c13f4a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00cb60 tx=0x7fd15c00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.424+0000 7fd152ffd640 10 client.?.objecter ms_handle_connect 0x7fd16c15b030 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.424+0000 7fd152ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 1 -- 10.20.193.10:0/3030478111 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c00ad50 con 0x7fd16c15b030 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 10 monclient: dump: 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 1 -- 10.20.193.10:0/3030478111 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15c012400 con 0x7fd16c15b030 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 5 monclient: authenticate success, global_id 4640 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 1 -- 10.20.193.10:0/3030478111 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0127b0 con 0x7fd16c15b030 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd152ffd640 10 monclient: dump: 2026-02-17T11:56:25.430 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd168d72640 4 set_mon_vals no callback set 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 10 monclient: _renew_subs 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16c13f9e0 con 0x7fd16c15b030 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 10 client.4640.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 10 monclient: _renew_subs 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16c0cc990 con 0x7fd16c15b030 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 1 librados: init done 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:25.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.426+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16c15a920 con 0x7fd16c15b030 2026-02-17T11:56:25.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.439+0000 7fd152ffd640 1 -- 10.20.193.10:0/3030478111 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fd15c012950 con 0x7fd16c15b030 2026-02-17T11:56:25.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.439+0000 7fd152ffd640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd138078e50 0x7fd13807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:25.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.439+0000 7fd16a575640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd138078e50 0x7fd13807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:25.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.439+0000 7fd16a575640 10 monclient: get_auth_request con 0x7fd138078e50 auth_method 0 2026-02-17T11:56:25.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.439+0000 7fd16a575640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd138078e50 0x7fd13807b310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd160002410 tx=0x7fd160007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:25.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.439+0000 7fd152ffd640 10 client.4640.objecter ms_handle_connect 0x7fd138078e50 2026-02-17T11:56:25.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.440+0000 7fd152ffd640 1 -- 10.20.193.10:0/3030478111 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fd15c05e860 con 0x7fd16c15b030 2026-02-17T11:56:25.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.440+0000 7fd152ffd640 10 client.4640.objecter ms_dispatch2 0x7fd16c000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:25.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.440+0000 7fd152ffd640 3 client.4640.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:25.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.440+0000 7fd152ffd640 3 client.4640.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:25.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.440+0000 7fd152ffd640 20 client.4640.objecter dump_active .. 0 homeless 2026-02-17T11:56:25.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.543+0000 7fd152ffd640 1 -- 10.20.193.10:0/3030478111 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd15c062820 con 0x7fd16c15b030 2026-02-17T11:56:25.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.543+0000 7fd152ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:25.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.543+0000 7fd152ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:25.645 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.642+0000 7fd170d34640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:25.646 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.642+0000 7fd170d34640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:25.646 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.642+0000 7fd170d34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:25.646 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.642+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd16c0cb2e0 con 0x7fd16c15b030 2026-02-17T11:56:25.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd152ffd640 1 -- 10.20.193.10:0/3030478111 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fd15c066b20 con 0x7fd16c15b030 2026-02-17T11:56:25.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd152ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:25.649 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd152ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:25.649 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:25.649 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:25.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 10 librados: watch_flush enter 2026-02-17T11:56:25.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 10 librados: watch_flush exit 2026-02-17T11:56:25.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 20 client.4640.objecter shutdown clearing up homeless session... 2026-02-17T11:56:25.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 10 client.4640.objecter successfully canceled tick 2026-02-17T11:56:25.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd138078e50 msgr2=0x7fd13807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:25.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd138078e50 0x7fd13807b310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd160002410 tx=0x7fd160007ef0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 10 monclient: shutdown 2026-02-17T11:56:25.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:25.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 msgr2=0x7fd16c13f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:25.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 0x7fd16c13f4a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00cb60 tx=0x7fd15c00a430 comp rx=0 tx=0).stop 2026-02-17T11:56:25.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 shutdown_connections 2026-02-17T11:56:25.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd138078e50 0x7fd13807b310 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd16c15b030 0x7fd16c13f4a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd16c152a40 0x7fd16c0cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 --2- 10.20.193.10:0/3030478111 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd16c152660 0x7fd16c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:25.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 >> 10.20.193.10:0/3030478111 conn(0x7fd16c0c9d80 msgr2=0x7fd16c15bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:25.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 shutdown_connections 2026-02-17T11:56:25.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 -- 10.20.193.10:0/3030478111 wait complete. 2026-02-17T11:56:25.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:25.647+0000 7fd170d34640 1 librados: shutdown 2026-02-17T11:56:28.659 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:28.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 10 monclient: get_monmap_and_config 2026-02-17T11:56:28.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 10 monclient: build_initial_monmap 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 10 monclient: monmap: 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:28.726311+0000 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:28.726311+0000 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:28.729 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 1 Processor -- start 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 1 -- start start 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 10 monclient: init 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 10 monclient: _add_conns ranks=[5,1,2,0,4,3] 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fb70c15d220 0x7fb70c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 10 monclient(hunting): picked mon.noname-c con 0x7fb70c15d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.725+0000 7fb7125d3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb70c074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:28.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb7125d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb70c0c92f0 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:28.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb7125d3640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb70c0c58a0 con 0x7fb70c074920 2026-02-17T11:56:28.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb7125d3640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb70c0c55c0 con 0x7fb70c0c92f0 2026-02-17T11:56:28.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb7125d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:28.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb7125d3640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb70c0c7e20 con 0x7fb70c15d220 2026-02-17T11:56:28.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb7125d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:28.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb7125d3640 10 monclient(hunting): authenticate will time out at 1058.448028s 2026-02-17T11:56:28.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb70b7fe640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fb70c074920 0x7fb70c0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:56952/0 (socket says 10.20.193.10:56952) 2026-02-17T11:56:28.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb70b7fe640 1 -- 10.20.193.10:0/2524255373 learned_addr learned my addr 10.20.193.10:0/2524255373 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:28.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb70bfff640 1 --2- 10.20.193.10:0/2524255373 >> v2:10.20.193.153:3300/0 conn(0x7fb70c15d220 0x7fb70c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:28.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb70bfff640 10 monclient(hunting): get_auth_request con 0x7fb70c15d220 auth_method 0 2026-02-17T11:56:28.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb70bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:28.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb70bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:28.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.726+0000 7fb70bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:28.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.727+0000 7fb70bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:28.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.727+0000 7fb70bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.727+0000 7fb70bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70affd640 1 -- 10.20.193.10:0/2524255373 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485076168 0 0) 0x7fb70c0c58a0 con 0x7fb70c074920 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70affd640 10 monclient(hunting): _negotiate 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70affd640 10 monclient(hunting): my global_id is 4624 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70affd640 1 -- 10.20.193.10:0/2524255373 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6f0003620 con 0x7fb70c074920 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70bfff640 10 monclient(hunting): handle_auth_done global_id 4643 payload 274 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70bfff640 1 -- 10.20.193.10:0/2524255373 >> v1:10.20.193.153:6789/0 conn(0x7fb70c0c92f0 legacy=0x7fb70c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70bfff640 1 -- 10.20.193.10:0/2524255373 >> v1:10.20.193.71:6789/0 conn(0x7fb70c074920 legacy=0x7fb70c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:28.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70bfff640 1 monclient: found mon.noname-c 2026-02-17T11:56:28.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:28.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:28.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.728+0000 7fb70bfff640 1 -- 10.20.193.10:0/2524255373 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c0c8100 con 0x7fb70c15d220 2026-02-17T11:56:28.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.731+0000 7fb70bfff640 1 --2- 10.20.193.10:0/2524255373 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 0x7fb70c15d600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80098d0 tx=0x7fb6f802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a999b360ad5459c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:28.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 1 -- 10.20.193.10:0/2524255373 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f803c070 con 0x7fb70c15d220 2026-02-17T11:56:28.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:28.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:28.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 10 monclient: dump: 2026-02-17T11:56:28.740 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:28.740 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:28.740 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 10 monclient: _finish_auth 0 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 1 -- 10.20.193.10:0/2524255373 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f802fba0 con 0x7fb70c15d220 2026-02-17T11:56:28.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 1 -- 10.20.193.10:0/2524255373 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8037440 con 0x7fb70c15d220 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb70affd640 10 monclient: dump: 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:28.742 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 5 monclient: authenticate success, global_id 4643 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 4 set_mon_vals no callback set 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 10 monclient: shutdown 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 1 -- 10.20.193.10:0/2524255373 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 msgr2=0x7fb70c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 1 --2- 10.20.193.10:0/2524255373 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 0x7fb70c15d600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80098d0 tx=0x7fb6f802eed0 comp rx=0 tx=0).stop 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 1 -- 10.20.193.10:0/2524255373 shutdown_connections 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 1 --2- 10.20.193.10:0/2524255373 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 0x7fb70c15d600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 1 -- 10.20.193.10:0/2524255373 >> 10.20.193.10:0/2524255373 conn(0x7fb70c0c9d80 msgr2=0x7fb70c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:28.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 1 -- 10.20.193.10:0/2524255373 shutdown_connections 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.733+0000 7fb7125d3640 1 -- 10.20.193.10:0/2524255373 wait complete. 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient: build_initial_monmap 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient: monmap: 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:28.744 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 librados: starting msgr at 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 librados: starting objecter 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 Processor -- start 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 -- start start 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 librados: setting wanted keys 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 librados: calling monclient init 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient: init 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb70c074920 0x7fb70c1e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient(hunting): picked mon.noname-a con 0x7fb70c074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb70c0c92f0 0x7fb70c0cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:28.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient(hunting): picked mon.noname-b con 0x7fb70c0c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 0x7fb70c1f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient(hunting): picked mon.noname-c con 0x7fb70c15d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c074d70 con 0x7fb70c074920 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c0c86c0 con 0x7fb70c0c92f0 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c153d60 con 0x7fb70c15d220 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.734+0000 7fb7125d3640 10 monclient(hunting): authenticate will time out at 1058.456965s 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 0x7fb70c1f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70bfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb70c074920 0x7fb70c1e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:28.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70b7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb70c0c92f0 0x7fb70c0cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 0x7fb70c1f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:39180/0 (socket says 10.20.193.10:39180) 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 1 -- 10.20.193.10:0/2376298545 learned_addr learned my addr 10.20.193.10:0/2376298545 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 10 monclient(hunting): get_auth_request con 0x7fb70c15d220 auth_method 0 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70bfff640 10 monclient(hunting): get_auth_request con 0x7fb70c074920 auth_method 0 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70b7fe640 10 monclient(hunting): get_auth_request con 0x7fb70c0c92f0 auth_method 0 2026-02-17T11:56:28.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb710b49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.735+0000 7fb70b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 10 monclient(hunting): handle_auth_done global_id 4649 payload 824 2026-02-17T11:56:28.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 1 -- 10.20.193.10:0/2376298545 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb70c0c92f0 msgr2=0x7fb70c0cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb70c0c92f0 0x7fb70c0cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 1 -- 10.20.193.10:0/2376298545 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb70c074920 msgr2=0x7fb70c1e4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb70c074920 0x7fb70c1e4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 10 monclient: _finish_hunting 0 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 1 monclient: found mon.noname-c 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.737+0000 7fb710b49640 1 -- 10.20.193.10:0/2376298545 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c1e56c0 con 0x7fb70c15d220 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.738+0000 7fb710b49640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 0x7fb70c1f2c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb70000cc80 tx=0x7fb70000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.738+0000 7fb708ff9640 10 client.?.objecter ms_handle_connect 0x7fb70c15d220 2026-02-17T11:56:28.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.738+0000 7fb708ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:28.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 1 -- 10.20.193.10:0/2376298545 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700003a70 con 0x7fb70c15d220 2026-02-17T11:56:28.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:28.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:28.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 10 monclient: dump: 2026-02-17T11:56:28.751 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:28.751 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:28.751 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:28.751 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 10 monclient: _finish_auth 0 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 1 -- 10.20.193.10:0/2376298545 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb700003c10 con 0x7fb70c15d220 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb7125d3640 5 monclient: authenticate success, global_id 4649 2026-02-17T11:56:28.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb7125d3640 10 monclient: _renew_subs 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb7125d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c1e59a0 con 0x7fb70c15d220 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 1 -- 10.20.193.10:0/2376298545 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7000050d0 con 0x7fb70c15d220 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb708ff9640 10 monclient: dump: 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:28.753 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb70a7fc640 4 set_mon_vals no callback set 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb7125d3640 10 client.4649.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb7125d3640 10 monclient: _renew_subs 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb7125d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c1e5f60 con 0x7fb70c15d220 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.739+0000 7fb7125d3640 1 librados: init done 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.740+0000 7fb7125d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:28.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.740+0000 7fb7125d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:28.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.740+0000 7fb7125d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:28.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.740+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c15d600 con 0x7fb70c15d220 2026-02-17T11:56:28.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.751+0000 7fb708ff9640 1 -- 10.20.193.10:0/2376298545 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fb700005270 con 0x7fb70c15d220 2026-02-17T11:56:28.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.751+0000 7fb708ff9640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb6dc078e50 0x7fb6dc07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:28.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.752+0000 7fb70bfff640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb6dc078e50 0x7fb6dc07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:28.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.752+0000 7fb70bfff640 10 monclient: get_auth_request con 0x7fb6dc078e50 auth_method 0 2026-02-17T11:56:28.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.752+0000 7fb708ff9640 10 client.4649.objecter ms_handle_connect 0x7fb6dc078e50 2026-02-17T11:56:28.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.752+0000 7fb70bfff640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb6dc078e50 0x7fb6dc07b310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8039000 tx=0x7fb6f8033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:28.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.753+0000 7fb708ff9640 1 -- 10.20.193.10:0/2376298545 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb70005e730 con 0x7fb70c15d220 2026-02-17T11:56:28.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.753+0000 7fb708ff9640 10 client.4649.objecter ms_dispatch2 0x7fb70c000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:28.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.753+0000 7fb708ff9640 3 client.4649.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:28.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.753+0000 7fb708ff9640 3 client.4649.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:28.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.753+0000 7fb708ff9640 20 client.4649.objecter dump_active .. 0 homeless 2026-02-17T11:56:28.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.859+0000 7fb708ff9640 1 -- 10.20.193.10:0/2376298545 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb7000626f0 con 0x7fb70c15d220 2026-02-17T11:56:28.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.859+0000 7fb708ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:28.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.859+0000 7fb708ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:28.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.959+0000 7fb7125d3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:28.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.959+0000 7fb7125d3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:28.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.959+0000 7fb7125d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:28.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.959+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb70c0c9b60 con 0x7fb70c15d220 2026-02-17T11:56:28.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.961+0000 7fb708ff9640 1 -- 10.20.193.10:0/2376298545 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fb7000669f0 con 0x7fb70c15d220 2026-02-17T11:56:28.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.961+0000 7fb708ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:28.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.961+0000 7fb708ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:28.964 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:28.964 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 10 librados: watch_flush enter 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 10 librados: watch_flush exit 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 20 client.4649.objecter shutdown clearing up homeless session... 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 10 client.4649.objecter successfully canceled tick 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb6dc078e50 msgr2=0x7fb6dc07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb6dc078e50 0x7fb6dc07b310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8039000 tx=0x7fb6f8033000 comp rx=0 tx=0).stop 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 10 monclient: shutdown 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 msgr2=0x7fb70c1f2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:28.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 0x7fb70c1f2c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb70000cc80 tx=0x7fb70000a430 comp rx=0 tx=0).stop 2026-02-17T11:56:28.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 shutdown_connections 2026-02-17T11:56:28.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb6dc078e50 0x7fb6dc07b310 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:28.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb70c15d220 0x7fb70c1f2c80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:28.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb70c0c92f0 0x7fb70c0cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:28.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 --2- 10.20.193.10:0/2376298545 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb70c074920 0x7fb70c1e4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:28.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 >> 10.20.193.10:0/2376298545 conn(0x7fb70c0c9d80 msgr2=0x7fb70c152ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:28.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 shutdown_connections 2026-02-17T11:56:28.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 -- 10.20.193.10:0/2376298545 wait complete. 2026-02-17T11:56:28.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:28.963+0000 7fb7125d3640 1 librados: shutdown 2026-02-17T11:56:31.974 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:32.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.040+0000 7f1966ae8640 10 monclient: get_monmap_and_config 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.040+0000 7f1966ae8640 10 monclient: build_initial_monmap 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.040+0000 7f1966ae8640 10 monclient: monmap: 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:32.040391+0000 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:32.040391+0000 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:32.042 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:32.043 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:32.043 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:32.043 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:32.043 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:32.043 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:32.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.040+0000 7f1966ae8640 1 Processor -- start 2026-02-17T11:56:32.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.040+0000 7f1966ae8640 1 -- start start 2026-02-17T11:56:32.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.040+0000 7f1966ae8640 10 monclient: init 2026-02-17T11:56:32.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:32.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 10 monclient: _add_conns ranks=[5,0,3,1,2,4] 2026-02-17T11:56:32.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f196015d220 0x7f196015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:32.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 10 monclient(hunting): picked mon.noname-c con 0x7f196015d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:32.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1960074920 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:32.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f19600c92f0 0x7f1960153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:32.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 10 monclient(hunting): picked mon.noname-a con 0x7f19600c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:32.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19600c58a0 con 0x7f1960074920 2026-02-17T11:56:32.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:32.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f19600c55c0 con 0x7f19600c92f0 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f19600c7e20 con 0x7f196015d220 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f1966ae8640 10 monclient(hunting): authenticate will time out at 1061.762197s 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196505e640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f19600c92f0 0x7f1960153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196485d640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f196015d220 0x7f196015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196485d640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f196015d220 0x7f196015d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:39186/0 (socket says 10.20.193.10:39186) 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196485d640 1 -- 10.20.193.10:0/3879872480 learned_addr learned my addr 10.20.193.10:0/3879872480 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196485d640 10 monclient(hunting): get_auth_request con 0x7f196015d220 auth_method 0 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196485d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196485d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196485d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196505e640 10 monclient(hunting): get_auth_request con 0x7f19600c92f0 auth_method 0 2026-02-17T11:56:32.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196505e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196505e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.041+0000 7f196505e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.042+0000 7f196485d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.042+0000 7f196485d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.042+0000 7f196485d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.042+0000 7f196505e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.042+0000 7f196505e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.042+0000 7f196505e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 10 monclient(hunting): handle_auth_done global_id 4652 payload 274 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 1 -- 10.20.193.10:0/3879872480 >> v2:10.20.193.10:3300/0 conn(0x7f19600c92f0 msgr2=0x7f1960153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 1 --2- 10.20.193.10:0/3879872480 >> v2:10.20.193.10:3300/0 conn(0x7f19600c92f0 0x7f1960153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 1 -- 10.20.193.10:0/3879872480 >> v1:10.20.193.10:6789/0 conn(0x7f1960074920 legacy=0x7f19600c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:32.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 10 monclient: _finish_hunting 0 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 1 monclient: found mon.noname-c 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 1 -- 10.20.193.10:0/3879872480 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19600c8100 con 0x7f196015d220 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.043+0000 7f196485d640 1 --2- 10.20.193.10:0/3879872480 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f196015d220 0x7f196015d600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1950009970 tx=0x7f195002eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f017f735aa7a567 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 1 -- 10.20.193.10:0/3879872480 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195003c070 con 0x7f196015d220 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 10 monclient: dump: 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:32.057 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 1 -- 10.20.193.10:0/3879872480 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195002fbc0 con 0x7f196015d220 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f1966ae8640 5 monclient: authenticate success, global_id 4652 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f1966ae8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 1 -- 10.20.193.10:0/3879872480 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950037440 con 0x7f196015d220 2026-02-17T11:56:32.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f19577fe640 10 monclient: dump: 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:32.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f1966ae8640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.045+0000 7f1966ae8640 4 set_mon_vals no callback set 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 10 monclient: shutdown 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 1 -- 10.20.193.10:0/3879872480 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f196015d220 msgr2=0x7f196015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 1 --2- 10.20.193.10:0/3879872480 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f196015d220 0x7f196015d600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1950009970 tx=0x7f195002eef0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 1 -- 10.20.193.10:0/3879872480 shutdown_connections 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 1 --2- 10.20.193.10:0/3879872480 >> v2:10.20.193.10:3300/0 conn(0x7f19600c92f0 0x7f1960153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 1 --2- 10.20.193.10:0/3879872480 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f196015d220 0x7f196015d600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 1 -- 10.20.193.10:0/3879872480 >> 10.20.193.10:0/3879872480 conn(0x7f19600c9d80 msgr2=0x7f19600ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 1 -- 10.20.193.10:0/3879872480 shutdown_connections 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 1 -- 10.20.193.10:0/3879872480 wait complete. 2026-02-17T11:56:32.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 10 monclient: build_initial_monmap 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.046+0000 7f1966ae8640 10 monclient: monmap: 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:32.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 librados: starting msgr at 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 librados: starting objecter 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 Processor -- start 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 -- start start 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 librados: setting wanted keys 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 librados: calling monclient init 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient: init 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1960074920 0x7f1960148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient(hunting): picked mon.noname-c con 0x7f1960074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19600c92f0 0x7f1960072820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient(hunting): picked mon.noname-b con 0x7f19600c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:32.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f196015d220 0x7f1960072d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient(hunting): picked mon.noname-a con 0x7f196015d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f1960074d70 con 0x7f196015d220 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19600c86c0 con 0x7f19600c92f0 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1960153b90 con 0x7f1960074920 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f1966ae8640 10 monclient(hunting): authenticate will time out at 1061.768517s 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196505e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f196015d220 0x7f1960072d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196485d640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1960074920 0x7f1960148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:32.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196505e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f196015d220 0x7f1960072d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:36126/0 (socket says 10.20.193.10:36126) 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196505e640 1 -- 10.20.193.10:0/79038905 learned_addr learned my addr 10.20.193.10:0/79038905 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196505e640 10 monclient(hunting): get_auth_request con 0x7f196015d220 auth_method 0 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196505e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196505e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196505e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196485d640 10 monclient(hunting): get_auth_request con 0x7f1960074920 auth_method 0 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196485d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196485d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.047+0000 7f196485d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f1957fff640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19600c92f0 0x7f1960072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f196485d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f196485d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:32.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f196485d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f1957fff640 10 monclient(hunting): get_auth_request con 0x7f19600c92f0 auth_method 0 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f1957fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f1957fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f1957fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f196505e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f196505e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f196505e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f1957fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f1957fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.048+0000 7f1957fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 10 monclient(hunting): handle_auth_done global_id 4655 payload 824 2026-02-17T11:56:32.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 1 -- 10.20.193.10:0/79038905 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19600c92f0 msgr2=0x7f1960072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19600c92f0 0x7f1960072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 1 -- 10.20.193.10:0/79038905 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f196015d220 msgr2=0x7f1960072d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f196015d220 0x7f1960072d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 10 monclient: _finish_hunting 0 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 1 monclient: found mon.noname-c 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.049+0000 7f196485d640 1 -- 10.20.193.10:0/79038905 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19600cc0e0 con 0x7f1960074920 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.050+0000 7f196485d640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1960074920 0x7f1960148da0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f19600c7fa0 tx=0x7f19500047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.050+0000 7f19557fa640 10 client.?.objecter ms_handle_connect 0x7f1960074920 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.050+0000 7f19557fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 1 -- 10.20.193.10:0/79038905 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195003c040 con 0x7f1960074920 2026-02-17T11:56:32.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 10 monclient: dump: 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:32.067 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 1 -- 10.20.193.10:0/79038905 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1950042430 con 0x7f1960074920 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 5 monclient: authenticate success, global_id 4655 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 10 monclient: _renew_subs 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19600cb280 con 0x7f1960074920 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 1 -- 10.20.193.10:0/79038905 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950042820 con 0x7f1960074920 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:32.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f19557fa640 10 monclient: dump: 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:32.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1956ffd640 4 set_mon_vals no callback set 2026-02-17T11:56:32.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 10 client.4655.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:32.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 10 monclient: _renew_subs 2026-02-17T11:56:32.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:32.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19600cb840 con 0x7f1960074920 2026-02-17T11:56:32.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 1 librados: init done 2026-02-17T11:56:32.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:32.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:32.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:32.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.052+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1960153f70 con 0x7f1960074920 2026-02-17T11:56:32.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.064+0000 7f19557fa640 1 -- 10.20.193.10:0/79038905 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f19500429c0 con 0x7f1960074920 2026-02-17T11:56:32.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.064+0000 7f19557fa640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1930078e30 0x7f193007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:32.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.064+0000 7f1957fff640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1930078e30 0x7f193007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:32.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.064+0000 7f1957fff640 10 monclient: get_auth_request con 0x7f1930078e30 auth_method 0 2026-02-17T11:56:32.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.064+0000 7f19557fa640 10 client.4655.objecter ms_handle_connect 0x7f1930078e30 2026-02-17T11:56:32.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.064+0000 7f1957fff640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1930078e30 0x7f193007b2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19600c49d0 tx=0x7f1948007f30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:32.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.065+0000 7f19557fa640 1 -- 10.20.193.10:0/79038905 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f1950031db0 con 0x7f1960074920 2026-02-17T11:56:32.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.065+0000 7f19557fa640 10 client.4655.objecter ms_dispatch2 0x7f1960000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:32.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.065+0000 7f19557fa640 3 client.4655.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:32.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.065+0000 7f19557fa640 3 client.4655.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:32.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.065+0000 7f19557fa640 20 client.4655.objecter dump_active .. 0 homeless 2026-02-17T11:56:32.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.168+0000 7f19557fa640 1 -- 10.20.193.10:0/79038905 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1950087650 con 0x7f1960074920 2026-02-17T11:56:32.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.168+0000 7f19557fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:32.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.168+0000 7f19557fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:32.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.265+0000 7f1966ae8640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:32.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.265+0000 7f1966ae8640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:32.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.265+0000 7f1966ae8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:32.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.265+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f19601573e0 con 0x7f1960074920 2026-02-17T11:56:32.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.267+0000 7f19557fa640 1 -- 10.20.193.10:0/79038905 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f195008b950 con 0x7f1960074920 2026-02-17T11:56:32.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.267+0000 7f19557fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:32.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.267+0000 7f19557fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:32.269 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:32.269 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:32.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 10 librados: watch_flush enter 2026-02-17T11:56:32.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 10 librados: watch_flush exit 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 20 client.4655.objecter shutdown clearing up homeless session... 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 10 client.4655.objecter successfully canceled tick 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1930078e30 msgr2=0x7f193007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1930078e30 0x7f193007b2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19600c49d0 tx=0x7f1948007f30 comp rx=0 tx=0).stop 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 10 monclient: shutdown 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1960074920 msgr2=0x7f1960148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1960074920 0x7f1960148da0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f19600c7fa0 tx=0x7f19500047c0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 shutdown_connections 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1930078e30 0x7f193007b2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f196015d220 0x7f1960072d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f19600c92f0 0x7f1960072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 --2- 10.20.193.10:0/79038905 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1960074920 0x7f1960148da0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:32.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 >> 10.20.193.10:0/79038905 conn(0x7f19600c9d80 msgr2=0x7f1960153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:32.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 shutdown_connections 2026-02-17T11:56:32.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 -- 10.20.193.10:0/79038905 wait complete. 2026-02-17T11:56:32.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:32.269+0000 7f1966ae8640 1 librados: shutdown 2026-02-17T11:56:34.862 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:02:52.029 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:34.889 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:02:52.057 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:34.897 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:02:52.065 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:34.917 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:02:52.080 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:34.918 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:02:52.046 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:34.919 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:02:52.083 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:34.920 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:02:52.048 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:34.927 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:02:52.090 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:34.928 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:02:52.057 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:35.280 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.349+0000 7fd9c30da640 10 monclient: get_monmap_and_config 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.349+0000 7fd9c30da640 10 monclient: build_initial_monmap 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.349+0000 7fd9c30da640 10 monclient: monmap: 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:35.349837+0000 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:35.349837+0000 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:35.350 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:35.351 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:35.351 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:35.351 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:35.351 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:35.351 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:35.351 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:35.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 1 Processor -- start 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 1 -- start start 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 10 monclient: init 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 10 monclient: _add_conns ranks=[0,2,4,3,1,5] 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd9bc152660 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd9bc15b030 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fd9bc0c6ce0 0x7fd9bc1631a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 10 monclient(hunting): picked mon.noname-b con 0x7fd9bc0c6ce0 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9bc0c71e0 con 0x7fd9bc152660 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9bc0c74c0 con 0x7fd9bc15b030 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd9bc0c77a0 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.350+0000 7fd9c30da640 10 monclient(hunting): authenticate will time out at 1065.071641s 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c0e4f640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fd9bc152660 0x7fd9bc15a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:55846/0 (socket says 10.20.193.10:55846) 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c1650640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fd9bc0c6ce0 0x7fd9bc1631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c0e4f640 1 -- 10.20.193.10:0/1782559957 learned_addr learned my addr 10.20.193.10:0/1782559957 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c1650640 10 monclient(hunting): get_auth_request con 0x7fd9bc0c6ce0 auth_method 0 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c1650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c1650640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c1650640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:35.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c1650640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:35.353 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c1650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:35.353 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.351+0000 7fd9c1650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:35.353 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 1 -- 10.20.193.10:0/1782559957 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977541604 0 0) 0x7fd9bc0c71e0 con 0x7fd9bc152660 2026-02-17T11:56:35.353 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 10 monclient(hunting): _negotiate 2026-02-17T11:56:35.353 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:35.353 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:35.353 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 10 monclient(hunting): my global_id is 4596 2026-02-17T11:56:35.353 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 1 -- 10.20.193.10:0/1782559957 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9a8003620 con 0x7fd9bc152660 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 1 -- 10.20.193.10:0/1782559957 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730951726 0 0) 0x7fd9bc0c74c0 con 0x7fd9bc15b030 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 10 monclient(hunting): _negotiate 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 10 monclient(hunting): my global_id is 4658 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9b37fe640 1 -- 10.20.193.10:0/1782559957 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9bc0c71e0 con 0x7fd9bc15b030 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9c1650640 10 monclient(hunting): handle_auth_done global_id 4633 payload 274 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9c1650640 1 -- 10.20.193.10:0/1782559957 >> v1:10.20.193.153:6789/0 conn(0x7fd9bc15b030 legacy=0x7fd9bc0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9c1650640 1 -- 10.20.193.10:0/1782559957 >> v1:10.20.193.10:6789/0 conn(0x7fd9bc152660 legacy=0x7fd9bc15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9c1650640 10 monclient: _finish_hunting 0 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9c1650640 1 monclient: found mon.noname-b 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9c1650640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9c1650640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.352+0000 7fd9c1650640 1 -- 10.20.193.10:0/1782559957 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9bc159e40 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.354+0000 7fd9c1650640 1 --2- 10.20.193.10:0/1782559957 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc0c6ce0 0x7fd9bc1631a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009d90 tx=0x7fd9b802f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3408c20785d2a557 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 1 -- 10.20.193.10:0/1782559957 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b803c070 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 10 monclient: dump: 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:35.357 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 1 -- 10.20.193.10:0/1782559957 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b8037440 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 1 -- 10.20.193.10:0/1782559957 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8037810 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9b37fe640 10 monclient: dump: 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 5 monclient: authenticate success, global_id 4633 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 4 set_mon_vals no callback set 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 10 monclient: shutdown 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 1 -- 10.20.193.10:0/1782559957 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc0c6ce0 msgr2=0x7fd9bc1631a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 1 --2- 10.20.193.10:0/1782559957 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc0c6ce0 0x7fd9bc1631a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009d90 tx=0x7fd9b802f230 comp rx=0 tx=0).stop 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 1 -- 10.20.193.10:0/1782559957 shutdown_connections 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 1 --2- 10.20.193.10:0/1782559957 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc0c6ce0 0x7fd9bc1631a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:35.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 1 -- 10.20.193.10:0/1782559957 >> 10.20.193.10:0/1782559957 conn(0x7fd9bc0c9d80 msgr2=0x7fd9bc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:35.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 1 -- 10.20.193.10:0/1782559957 shutdown_connections 2026-02-17T11:56:35.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.356+0000 7fd9c30da640 1 -- 10.20.193.10:0/1782559957 wait complete. 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient: build_initial_monmap 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient: monmap: 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 librados: starting msgr at 2026-02-17T11:56:35.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 librados: starting objecter 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 Processor -- start 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 -- start start 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 librados: setting wanted keys 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 librados: calling monclient init 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient: init 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd9bc0c6ce0 0x7fd9bc153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient(hunting): picked mon.noname-c con 0x7fd9bc0c6ce0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc152660 0x7fd9bc155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient(hunting): picked mon.noname-b con 0x7fd9bc152660 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd9bc15b030 0x7fd9bc158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient(hunting): picked mon.noname-a con 0x7fd9bc15b030 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc0c94e0 con 0x7fd9bc15b030 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc15a400 con 0x7fd9bc152660 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc0c9660 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.357+0000 7fd9c30da640 10 monclient(hunting): authenticate will time out at 1065.078897s 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c1650640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd9bc15b030 0x7fd9bc158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc152660 0x7fd9bc155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c0e4f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd9bc0c6ce0 0x7fd9bc153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc152660 0x7fd9bc155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:41338/0 (socket says 10.20.193.10:41338) 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 1 -- 10.20.193.10:0/2426095890 learned_addr learned my addr 10.20.193.10:0/2426095890 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 10 monclient(hunting): get_auth_request con 0x7fd9bc152660 auth_method 0 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:35.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c1650640 10 monclient(hunting): get_auth_request con 0x7fd9bc15b030 auth_method 0 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c1650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c1650640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c1650640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c0e4f640 10 monclient(hunting): get_auth_request con 0x7fd9bc0c6ce0 auth_method 0 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c0e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c0e4f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c0e4f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c0e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c0e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c0e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c1650640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c1650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.358+0000 7fd9c1650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:35.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 10 monclient(hunting): handle_auth_done global_id 4661 payload 824 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 1 -- 10.20.193.10:0/2426095890 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc152660 msgr2=0x7fd9bc155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc152660 0x7fd9bc155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 1 -- 10.20.193.10:0/2426095890 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd9bc15b030 msgr2=0x7fd9bc158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd9bc15b030 0x7fd9bc158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 10 monclient: _finish_hunting 0 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 1 monclient: found mon.noname-c 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.360+0000 7fd9c0e4f640 1 -- 10.20.193.10:0/2426095890 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9bc154f70 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.361+0000 7fd9c0e4f640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd9bc0c6ce0 0x7fd9bc153110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c4f0 tx=0x7fd9ac00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.361+0000 7fd9b17fa640 10 client.?.objecter ms_handle_connect 0x7fd9bc0c6ce0 2026-02-17T11:56:35.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.361+0000 7fd9b17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 1 -- 10.20.193.10:0/2426095890 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac017070 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 10 monclient: dump: 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 10 monclient: _finish_auth 0 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 10 monclient: _check_auth_tickets 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 1 -- 10.20.193.10:0/2426095890 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ac005e00 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:35.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 1 -- 10.20.193.10:0/2426095890 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac007290 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b17fa640 10 monclient: dump: 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9b2ffd640 4 set_mon_vals no callback set 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 5 monclient: authenticate success, global_id 4661 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 10 monclient: _renew_subs 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9bc1564e0 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 10 client.4661.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 10 monclient: _renew_subs 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9bc1554c0 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 1 librados: init done 2026-02-17T11:56:35.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:35.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:35.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:35.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.363+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9bc1516e0 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.473+0000 7fd9b17fa640 1 -- 10.20.193.10:0/2426095890 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fd9ac0074f0 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.474+0000 7fd9b17fa640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd98c078e00 0x7fd98c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:35.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.474+0000 7fd9b3fff640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd98c078e00 0x7fd98c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:35.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.474+0000 7fd9b3fff640 10 monclient: get_auth_request con 0x7fd98c078e00 auth_method 0 2026-02-17T11:56:35.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.474+0000 7fd9b3fff640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd98c078e00 0x7fd98c07b2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4002c30 tx=0x7fd9a4002bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:35.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.474+0000 7fd9b17fa640 10 client.4661.objecter ms_handle_connect 0x7fd98c078e00 2026-02-17T11:56:35.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.475+0000 7fd9b17fa640 1 -- 10.20.193.10:0/2426095890 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fd9ac007810 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.475+0000 7fd9b17fa640 10 client.4661.objecter ms_dispatch2 0x7fd9bc000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:35.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.475+0000 7fd9b17fa640 3 client.4661.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:35.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.475+0000 7fd9b17fa640 3 client.4661.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:35.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.475+0000 7fd9b17fa640 20 client.4661.objecter dump_active .. 0 homeless 2026-02-17T11:56:35.482 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.481+0000 7fd9b17fa640 1 -- 10.20.193.10:0/2426095890 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd9bc1516e0 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.482 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.481+0000 7fd9b17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:35.482 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.481+0000 7fd9b17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:35.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.584+0000 7fd9c30da640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:35.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.584+0000 7fd9c30da640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:35.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.584+0000 7fd9c30da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:35.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.584+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd9bc150670 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.587 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.587+0000 7fd9b17fa640 1 -- 10.20.193.10:0/2426095890 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fd9ac021020 con 0x7fd9bc0c6ce0 2026-02-17T11:56:35.587 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.587+0000 7fd9b17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:35.587 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.587+0000 7fd9b17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:35.587 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:35.588 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:35.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 10 librados: watch_flush enter 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 10 librados: watch_flush exit 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 20 client.4661.objecter shutdown clearing up homeless session... 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 10 client.4661.objecter successfully canceled tick 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd98c078e00 msgr2=0x7fd98c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd98c078e00 0x7fd98c07b2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4002c30 tx=0x7fd9a4002bc0 comp rx=0 tx=0).stop 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 10 monclient: shutdown 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd9bc0c6ce0 msgr2=0x7fd9bc153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd9bc0c6ce0 0x7fd9bc153110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c4f0 tx=0x7fd9ac00c9c0 comp rx=0 tx=0).stop 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 shutdown_connections 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd98c078e00 0x7fd98c07b2c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd9bc15b030 0x7fd9bc158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd9bc152660 0x7fd9bc155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 --2- 10.20.193.10:0/2426095890 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd9bc0c6ce0 0x7fd9bc153110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 >> 10.20.193.10:0/2426095890 conn(0x7fd9bc0c9d80 msgr2=0x7fd9bc0c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 shutdown_connections 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 -- 10.20.193.10:0/2426095890 wait complete. 2026-02-17T11:56:35.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:35.588+0000 7fd9c30da640 1 librados: shutdown 2026-02-17T11:56:38.598 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:38.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.664+0000 7fa22c996640 10 monclient: get_monmap_and_config 2026-02-17T11:56:38.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.664+0000 7fa22c996640 10 monclient: build_initial_monmap 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.664+0000 7fa22c996640 10 monclient: monmap: 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:38.665681+0000 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:38.665681+0000 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:38.670 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.664+0000 7fa22c996640 1 Processor -- start 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.664+0000 7fa22c996640 1 -- start start 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.664+0000 7fa22c996640 10 monclient: init 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 10 monclient: _add_conns ranks=[3,0,4,5,2,1] 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa22415d220 0x7fa22415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:38.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 10 monclient(hunting): picked mon.noname-a con 0x7fa22415d220 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa224074920 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa2240c92f0 0x7fa224153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 10 monclient(hunting): picked mon.noname-b con 0x7fa2240c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2240c58a0 con 0x7fa224074920 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa2240c55c0 con 0x7fa22415d220 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa2240c7e20 con 0x7fa2240c92f0 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22c996640 10 monclient(hunting): authenticate will time out at 1068.387398s 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22a70b640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa22415d220 0x7fa22415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:38.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.665+0000 7fa22af0c640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa2240c92f0 0x7fa224153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22af0c640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa2240c92f0 0x7fa224153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:41354/0 (socket says 10.20.193.10:41354) 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22af0c640 1 -- 10.20.193.10:0/2436878689 learned_addr learned my addr 10.20.193.10:0/2436878689 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22af0c640 10 monclient(hunting): get_auth_request con 0x7fa2240c92f0 auth_method 0 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22af0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22af0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22af0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22a70b640 10 monclient(hunting): get_auth_request con 0x7fa22415d220 auth_method 0 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22a70b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22a70b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22a70b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:38.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22af0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22af0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22af0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22a70b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22a70b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.666+0000 7fa22a70b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.667+0000 7fa22af0c640 10 monclient(hunting): handle_auth_done global_id 4639 payload 274 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.667+0000 7fa22af0c640 1 -- 10.20.193.10:0/2436878689 >> v2:10.20.193.10:3300/0 conn(0x7fa22415d220 msgr2=0x7fa22415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.667+0000 7fa22af0c640 1 --2- 10.20.193.10:0/2436878689 >> v2:10.20.193.10:3300/0 conn(0x7fa22415d220 0x7fa22415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.667+0000 7fa22af0c640 1 -- 10.20.193.10:0/2436878689 >> v1:10.20.193.10:6789/0 conn(0x7fa224074920 legacy=0x7fa2240c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.667+0000 7fa22af0c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:38.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.667+0000 7fa22af0c640 1 monclient: found mon.noname-b 2026-02-17T11:56:38.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.667+0000 7fa22af0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:38.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.667+0000 7fa22af0c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:38.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.667+0000 7fa22af0c640 1 -- 10.20.193.10:0/2436878689 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2240c8100 con 0x7fa2240c92f0 2026-02-17T11:56:38.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.668+0000 7fa22af0c640 1 --2- 10.20.193.10:0/2436878689 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa2240c92f0 0x7fa224153650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa218009e50 tx=0x7fa21802f2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5682dbc278496d0f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:38.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 1 -- 10.20.193.10:0/2436878689 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21802fd60 con 0x7fa2240c92f0 2026-02-17T11:56:38.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:38.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:38.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 10 monclient: dump: 2026-02-17T11:56:38.682 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:38.682 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 10 monclient: _finish_auth 0 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 10 monclient: _check_auth_tickets 2026-02-17T11:56:38.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 5 monclient: authenticate success, global_id 4639 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 1 -- 10.20.193.10:0/2436878689 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2180373f0 con 0x7fa2240c92f0 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 1 -- 10.20.193.10:0/2436878689 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2180377c0 con 0x7fa2240c92f0 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa229709640 10 monclient: dump: 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:38.684 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:38.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 4 set_mon_vals no callback set 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 10 monclient: shutdown 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 1 -- 10.20.193.10:0/2436878689 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa2240c92f0 msgr2=0x7fa224153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 1 --2- 10.20.193.10:0/2436878689 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa2240c92f0 0x7fa224153650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa218009e50 tx=0x7fa21802f2a0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 1 -- 10.20.193.10:0/2436878689 shutdown_connections 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 1 --2- 10.20.193.10:0/2436878689 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa2240c92f0 0x7fa224153650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 1 --2- 10.20.193.10:0/2436878689 >> v2:10.20.193.10:3300/0 conn(0x7fa22415d220 0x7fa22415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 1 -- 10.20.193.10:0/2436878689 >> 10.20.193.10:0/2436878689 conn(0x7fa2240c9d80 msgr2=0x7fa2240ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 1 -- 10.20.193.10:0/2436878689 shutdown_connections 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.670+0000 7fa22c996640 1 -- 10.20.193.10:0/2436878689 wait complete. 2026-02-17T11:56:38.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient: build_initial_monmap 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient: monmap: 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:38.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 librados: starting msgr at 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 librados: starting objecter 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 Processor -- start 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 -- start start 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 librados: setting wanted keys 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 librados: calling monclient init 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient: init 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa224074920 0x7fa224073790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient(hunting): picked mon.noname-c con 0x7fa224074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:38.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa2240c92f0 0x7fa22406e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient(hunting): picked mon.noname-a con 0x7fa2240c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa22415d220 0x7fa22406e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient(hunting): picked mon.noname-b con 0x7fa22415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa224074d70 con 0x7fa2240c92f0 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240c86c0 con 0x7fa22415d220 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa224153b90 con 0x7fa224074920 2026-02-17T11:56:38.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.671+0000 7fa22c996640 10 monclient(hunting): authenticate will time out at 1068.393845s 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa229f0a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa2240c92f0 0x7fa22406e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa22415d220 0x7fa22406e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa22415d220 0x7fa22406e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:41366/0 (socket says 10.20.193.10:41366) 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 1 -- 10.20.193.10:0/850407729 learned_addr learned my addr 10.20.193.10:0/850407729 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 10 monclient(hunting): get_auth_request con 0x7fa22415d220 auth_method 0 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:38.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa229f0a640 10 monclient(hunting): get_auth_request con 0x7fa2240c92f0 auth_method 0 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa229f0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa229f0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa229f0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22a70b640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa224074920 0x7fa224073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa229f0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa229f0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa229f0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22af0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22a70b640 10 monclient(hunting): get_auth_request con 0x7fa224074920 auth_method 0 2026-02-17T11:56:38.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22a70b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22a70b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.672+0000 7fa22a70b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.673+0000 7fa22a70b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.673+0000 7fa22a70b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.673+0000 7fa22a70b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 10 monclient(hunting): handle_auth_done global_id 4642 payload 824 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 1 -- 10.20.193.10:0/850407729 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa224074920 msgr2=0x7fa224073790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa224074920 0x7fa224073790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 1 -- 10.20.193.10:0/850407729 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa2240c92f0 msgr2=0x7fa22406e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:38.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa2240c92f0 0x7fa22406e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 1 monclient: found mon.noname-b 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.674+0000 7fa22af0c640 1 -- 10.20.193.10:0/850407729 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2241f6ba0 con 0x7fa22415d220 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.675+0000 7fa22af0c640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa22415d220 0x7fa22406e630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa21802f7d0 tx=0x7fa218004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.675+0000 7fa20effd640 10 client.?.objecter ms_handle_connect 0x7fa22415d220 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.675+0000 7fa20effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 1 -- 10.20.193.10:0/850407729 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218046020 con 0x7fa22415d220 2026-02-17T11:56:38.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 10 monclient: dump: 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:38.694 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 10 monclient: _finish_auth 0 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 1 -- 10.20.193.10:0/850407729 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa218041450 con 0x7fa22415d220 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 5 monclient: authenticate success, global_id 4642 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 10 monclient: _renew_subs 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22406d330 con 0x7fa22415d220 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:38.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 1 -- 10.20.193.10:0/850407729 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218009510 con 0x7fa22415d220 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa228f08640 4 set_mon_vals no callback set 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa20effd640 10 monclient: dump: 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:38.696 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 10 client.4642.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 10 monclient: _renew_subs 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22406d8f0 con 0x7fa22415d220 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 1 librados: init done 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:38.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:38.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.677+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22414e550 con 0x7fa22415d220 2026-02-17T11:56:38.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.689+0000 7fa20effd640 1 -- 10.20.193.10:0/850407729 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fa218041820 con 0x7fa22415d220 2026-02-17T11:56:38.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.689+0000 7fa20effd640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa1f4078e50 0x7fa1f407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:38.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.689+0000 7fa22a70b640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa1f4078e50 0x7fa1f407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:38.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.689+0000 7fa22a70b640 10 monclient: get_auth_request con 0x7fa1f4078e50 auth_method 0 2026-02-17T11:56:38.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.690+0000 7fa22a70b640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa1f4078e50 0x7fa1f407b310 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009ba0 tx=0x7fa21c009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:38.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.690+0000 7fa20effd640 10 client.4642.objecter ms_handle_connect 0x7fa1f4078e50 2026-02-17T11:56:38.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.691+0000 7fa20effd640 1 -- 10.20.193.10:0/850407729 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fa2180838b0 con 0x7fa22415d220 2026-02-17T11:56:38.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.691+0000 7fa20effd640 10 client.4642.objecter ms_dispatch2 0x7fa224000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:38.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.691+0000 7fa20effd640 3 client.4642.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:38.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.691+0000 7fa20effd640 3 client.4642.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:38.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.691+0000 7fa20effd640 20 client.4642.objecter dump_active .. 0 homeless 2026-02-17T11:56:38.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.793+0000 7fa20effd640 1 -- 10.20.193.10:0/850407729 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa22414e550 con 0x7fa22415d220 2026-02-17T11:56:38.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.793+0000 7fa20effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:38.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.793+0000 7fa20effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:38.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.892+0000 7fa22c996640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:38.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.892+0000 7fa22c996640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:38.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.892+0000 7fa22c996640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:38.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.892+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa224153f20 con 0x7fa22415d220 2026-02-17T11:56:38.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.895+0000 7fa20effd640 1 -- 10.20.193.10:0/850407729 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fa218050030 con 0x7fa22415d220 2026-02-17T11:56:38.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.895+0000 7fa20effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:38.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.895+0000 7fa20effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:38.897 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:38.898 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:38.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 10 librados: watch_flush enter 2026-02-17T11:56:38.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 10 librados: watch_flush exit 2026-02-17T11:56:38.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 20 client.4642.objecter shutdown clearing up homeless session... 2026-02-17T11:56:38.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 10 client.4642.objecter successfully canceled tick 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa1f4078e50 msgr2=0x7fa1f407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa1f4078e50 0x7fa1f407b310 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009ba0 tx=0x7fa21c009290 comp rx=0 tx=0).stop 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 10 monclient: shutdown 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa22415d220 msgr2=0x7fa22406e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa22415d220 0x7fa22406e630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa21802f7d0 tx=0x7fa218004b40 comp rx=0 tx=0).stop 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 shutdown_connections 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa1f4078e50 0x7fa1f407b310 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa22415d220 0x7fa22406e630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa2240c92f0 0x7fa22406e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 --2- 10.20.193.10:0/850407729 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa224074920 0x7fa224073790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:38.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 >> 10.20.193.10:0/850407729 conn(0x7fa2240c9d80 msgr2=0x7fa22414dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:38.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 shutdown_connections 2026-02-17T11:56:38.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 -- 10.20.193.10:0/850407729 wait complete. 2026-02-17T11:56:38.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:38.896+0000 7fa22c996640 1 librados: shutdown 2026-02-17T11:56:41.908 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.976+0000 7f2aad6b0640 10 monclient: get_monmap_and_config 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.976+0000 7f2aad6b0640 10 monclient: build_initial_monmap 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.976+0000 7f2aad6b0640 10 monclient: monmap: 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:41.977975+0000 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:41.977975+0000 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:41.978 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 1 Processor -- start 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 1 -- start start 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 10 monclient: init 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 10 monclient: _add_conns ranks=[2,4,1,3,0,5] 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2aa81502f0 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f2aa81506d0 0x7f2aa80c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 10 monclient(hunting): picked mon.noname-b con 0x7f2aa81506d0 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2aa80c8eb0 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aa80c5380 con 0x7f2aa80c8eb0 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aa80c5660 con 0x7f2aa81502f0 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2aa8074e80 con 0x7f2aa81506d0 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:41.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.977+0000 7f2aad6b0640 10 monclient(hunting): authenticate will time out at 1071.699780s 2026-02-17T11:56:41.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.978+0000 7f2aa77fe640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f2aa80c8eb0 0x7f2aa815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:43108/0 (socket says 10.20.193.10:43108) 2026-02-17T11:56:41.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.978+0000 7f2aa77fe640 1 -- 10.20.193.10:0/2671883288 learned_addr learned my addr 10.20.193.10:0/2671883288 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1135916015 0 0) 0x7f2aa80c5660 con 0x7f2aa81502f0 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 10 monclient(hunting): my global_id is 4667 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a94003620 con 0x7f2aa81502f0 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa67fc640 1 --2- 10.20.193.10:0/2671883288 >> v2:10.20.193.71:3300/0 conn(0x7f2aa81506d0 0x7f2aa80c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103390174 0 0) 0x7f2aa80c5380 con 0x7f2aa80c8eb0 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:41.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 10 monclient(hunting): my global_id is 4645 2026-02-17T11:56:41.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.979+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2aa80c5660 con 0x7f2aa80c8eb0 2026-02-17T11:56:41.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.980+0000 7f2aa67fc640 10 monclient(hunting): get_auth_request con 0x7f2aa81506d0 auth_method 0 2026-02-17T11:56:41.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.980+0000 7f2aa67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:41.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.980+0000 7f2aa67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:41.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.980+0000 7f2aa67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:41.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.980+0000 7f2aa67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:41.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.980+0000 7f2aa67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:41.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.980+0000 7f2aa67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 <== mon.2 v1:10.20.193.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3620460779 0 0) 0x7f2a94003620 con 0x7f2aa81502f0 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 >> v2:10.20.193.71:3300/0 conn(0x7f2aa81506d0 msgr2=0x7f2aa80c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 --2- 10.20.193.10:0/2671883288 >> v2:10.20.193.71:3300/0 conn(0x7f2aa81506d0 0x7f2aa80c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 >> v1:10.20.193.71:6789/0 conn(0x7f2aa80c8eb0 legacy=0x7f2aa815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient: _finish_hunting 0 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.153:6789/0 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 --> v1:10.20.193.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa80c7e90 con 0x7f2aa81502f0 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 <== mon.2 v1:10.20.193.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f2a9c002f00 con 0x7f2aa81502f0 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient: dump: 2026-02-17T11:56:41.983 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] but i'm connected to v1:10.20.193.153:6789/0, reconnecting 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 >> v1:10.20.193.153:6789/0 conn(0x7f2aa81502f0 legacy=0x7f2aa8074770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2a94003dd0 0x7f2a940041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient(hunting): picked mon.b con 0x7f2a94003dd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a94004900 0x7f2a94004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient(hunting): picked mon.c con 0x7f2a94004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a94005490 0x7f2a9400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient(hunting): picked mon.a con 0x7f2a94005490 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9400c350 con 0x7f2a94005490 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9400c500 con 0x7f2a94003dd0 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9400c700 con 0x7f2a94004900 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:56:41.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.981+0000 7f2aa77fe640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a94005490 0x7f2a9400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.982+0000 7f2aa77fe640 10 monclient(hunting): get_auth_request con 0x7f2a94005490 auth_method 0 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.982+0000 7f2aa77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.982+0000 7f2aa77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.982+0000 7f2aa77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.982+0000 7f2aa77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.982+0000 7f2aa77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.982+0000 7f2aa77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.982+0000 7f2aa67fc640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a94004900 0x7f2a94004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa67fc640 10 monclient(hunting): get_auth_request con 0x7f2a94004900 auth_method 0 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa67fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa67fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 10 monclient(hunting): handle_auth_done global_id 4667 payload 293 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 1 -- 10.20.193.10:0/2671883288 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a94004900 msgr2=0x7f2a94004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a94004900 0x7f2a94004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 1 -- 10.20.193.10:0/2671883288 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2a94003dd0 msgr2=0x7f2a940041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2a94003dd0 0x7f2a940041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 1 monclient: found mon.a 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 1 -- 10.20.193.10:0/2671883288 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a94003620 con 0x7f2a94005490 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:41.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:41.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:41.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aad6b0640 5 monclient: authenticate success, global_id 4667 2026-02-17T11:56:41.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aad6b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:41.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.983+0000 7f2aa77fe640 1 -- 10.20.193.10:0/2671883288 reap_dead start 2026-02-17T11:56:41.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.984+0000 7f2aa77fe640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a94005490 0x7f2a9400bac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800c2f0 tx=0x7f2a9802f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7783477eb9b4ba9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a980038a0 con 0x7f2a94005490 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 10 monclient: dump: 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a98037630 con 0x7f2a94005490 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 4 set_mon_vals no callback set 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 1 -- 10.20.193.10:0/2671883288 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a98037a20 con 0x7f2a94005490 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aa5ffb640 10 monclient: dump: 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:41.988 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:41.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 10 monclient: shutdown 2026-02-17T11:56:41.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:41.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2671883288 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a94005490 msgr2=0x7f2a9400bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:41.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a94005490 0x7f2a9400bac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800c2f0 tx=0x7f2a9802f640 comp rx=0 tx=0).stop 2026-02-17T11:56:41.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2671883288 shutdown_connections 2026-02-17T11:56:41.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 1 --2- 10.20.193.10:0/2671883288 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2a94005490 0x7f2a9400bac0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:41.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2671883288 >> 10.20.193.10:0/2671883288 conn(0x7f2aa80c9d80 msgr2=0x7f2aa80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2671883288 shutdown_connections 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.986+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2671883288 wait complete. 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient: build_initial_monmap 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient: monmap: 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 librados: starting msgr at 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 librados: starting objecter 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 Processor -- start 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 -- start start 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 librados: setting wanted keys 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 librados: calling monclient init 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient: init 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a94005490 0x7f2aa81f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient(hunting): picked mon.noname-c con 0x7f2a94005490 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2aa8154340 0x7f2aa8155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient(hunting): picked mon.noname-b con 0x7f2aa8154340 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2aa80738c0 0x7f2aa81f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient(hunting): picked mon.noname-a con 0x7f2aa80738c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa80c92d0 con 0x7f2aa80738c0 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa80c8450 con 0x7f2aa8154340 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa80c8970 con 0x7f2a94005490 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.987+0000 7f2aad6b0640 10 monclient(hunting): authenticate will time out at 1071.709738s 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2aa80738c0 0x7f2aa81f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa67fc640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2aa8154340 0x7f2aa8155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:41.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa6ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a94005490 0x7f2aa81f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2aa80738c0 0x7f2aa81f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:51222/0 (socket says 10.20.193.10:51222) 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 1 -- 10.20.193.10:0/2497808727 learned_addr learned my addr 10.20.193.10:0/2497808727 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 10 monclient(hunting): get_auth_request con 0x7f2aa80738c0 auth_method 0 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa67fc640 10 monclient(hunting): get_auth_request con 0x7f2aa8154340 auth_method 0 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa6ffd640 10 monclient(hunting): get_auth_request con 0x7f2a94005490 auth_method 0 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:41.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.988+0000 7f2aa6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 10 monclient(hunting): handle_auth_done global_id 4611 payload 824 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 1 -- 10.20.193.10:0/2497808727 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a94005490 msgr2=0x7f2aa81f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a94005490 0x7f2aa81f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 1 -- 10.20.193.10:0/2497808727 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2aa8154340 msgr2=0x7f2aa8155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2aa8154340 0x7f2aa8155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 1 monclient: found mon.noname-a 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.989+0000 7f2aa77fe640 1 -- 10.20.193.10:0/2497808727 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa8154870 con 0x7f2aa80738c0 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.990+0000 7f2aa77fe640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2aa80738c0 0x7f2aa81f7590 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2a9802fb50 tx=0x7f2a98002e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.990+0000 7f2a877fe640 10 client.?.objecter ms_handle_connect 0x7f2aa80738c0 2026-02-17T11:56:41.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.990+0000 7f2a877fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 1 -- 10.20.193.10:0/2497808727 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a98048070 con 0x7f2aa80738c0 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 10 monclient: dump: 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 10 monclient: _finish_auth 0 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 10 monclient: _check_auth_tickets 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 1 -- 10.20.193.10:0/2497808727 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a980038a0 con 0x7f2aa80738c0 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 1 -- 10.20.193.10:0/2497808727 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a980031d0 con 0x7f2aa80738c0 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aa57fa640 4 set_mon_vals no callback set 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2a877fe640 10 monclient: dump: 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:41.994 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 5 monclient: authenticate success, global_id 4611 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 10 monclient: _renew_subs 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa8154b50 con 0x7f2aa80738c0 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 10 client.4611.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 10 monclient: _renew_subs 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa8155110 con 0x7f2aa80738c0 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 1 librados: init done 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:41.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:41.992+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa815e190 con 0x7f2aa80738c0 2026-02-17T11:56:42.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.004+0000 7f2a877fe640 1 -- 10.20.193.10:0/2497808727 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f2a980074e0 con 0x7f2aa80738c0 2026-02-17T11:56:42.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.004+0000 7f2a877fe640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a74078e30 0x7f2a7407b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:42.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.005+0000 7f2aa6ffd640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a74078e30 0x7f2a7407b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:42.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.005+0000 7f2aa6ffd640 10 monclient: get_auth_request con 0x7f2a74078e30 auth_method 0 2026-02-17T11:56:42.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.005+0000 7f2aa6ffd640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a74078e30 0x7f2a7407b2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c002820 tx=0x7f2a9c002790 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:42.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.005+0000 7f2a877fe640 10 client.4611.objecter ms_handle_connect 0x7f2a74078e30 2026-02-17T11:56:42.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.006+0000 7f2a877fe640 1 -- 10.20.193.10:0/2497808727 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f2a98082de0 con 0x7f2aa80738c0 2026-02-17T11:56:42.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.006+0000 7f2a877fe640 10 client.4611.objecter ms_dispatch2 0x7f2aa8000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:42.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.006+0000 7f2a877fe640 3 client.4611.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:42.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.006+0000 7f2a877fe640 3 client.4611.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:42.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.006+0000 7f2a877fe640 20 client.4611.objecter dump_active .. 0 homeless 2026-02-17T11:56:42.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.105+0000 7f2a877fe640 1 -- 10.20.193.10:0/2497808727 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2aa815e190 con 0x7f2aa80738c0 2026-02-17T11:56:42.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.105+0000 7f2a877fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:42.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.105+0000 7f2a877fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:42.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.208+0000 7f2aad6b0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:42.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.208+0000 7f2aad6b0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:42.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.208+0000 7f2aad6b0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:42.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.208+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2aa8069900 con 0x7f2aa80738c0 2026-02-17T11:56:42.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.211+0000 7f2a877fe640 1 -- 10.20.193.10:0/2497808727 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f2aa8069900 con 0x7f2aa80738c0 2026-02-17T11:56:42.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.211+0000 7f2a877fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:42.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.211+0000 7f2a877fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:42.213 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:42.214 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:42.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 10 librados: watch_flush enter 2026-02-17T11:56:42.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 10 librados: watch_flush exit 2026-02-17T11:56:42.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 20 client.4611.objecter shutdown clearing up homeless session... 2026-02-17T11:56:42.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 10 client.4611.objecter successfully canceled tick 2026-02-17T11:56:42.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a74078e30 msgr2=0x7f2a7407b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:42.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a74078e30 0x7f2a7407b2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c002820 tx=0x7f2a9c002790 comp rx=0 tx=0).stop 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 10 monclient: shutdown 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2aa80738c0 msgr2=0x7f2aa81f7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2aa80738c0 0x7f2aa81f7590 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2a9802fb50 tx=0x7f2a98002e80 comp rx=0 tx=0).stop 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 shutdown_connections 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2a74078e30 0x7f2a7407b2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2aa80738c0 0x7f2aa81f7590 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2aa8154340 0x7f2aa8155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 --2- 10.20.193.10:0/2497808727 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2a94005490 0x7f2aa81f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 >> 10.20.193.10:0/2497808727 conn(0x7f2aa80c9d80 msgr2=0x7f2aa814e790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:42.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 shutdown_connections 2026-02-17T11:56:42.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 -- 10.20.193.10:0/2497808727 wait complete. 2026-02-17T11:56:42.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:42.212+0000 7f2aad6b0640 1 librados: shutdown 2026-02-17T11:56:45.224 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:45.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.289+0000 7f97b4a24640 10 monclient: get_monmap_and_config 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.289+0000 7f97b4a24640 10 monclient: build_initial_monmap 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.289+0000 7f97b4a24640 10 monclient: monmap: 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:45.290574+0000 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:45.290574+0000 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:45.292 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:45.293 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:45.293 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:45.293 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:45.293 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:45.293 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:45.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.289+0000 7f97b4a24640 1 Processor -- start 2026-02-17T11:56:45.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.289+0000 7f97b4a24640 1 -- start start 2026-02-17T11:56:45.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.289+0000 7f97b4a24640 10 monclient: init 2026-02-17T11:56:45.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:45.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 10 monclient: _add_conns ranks=[5,3,2,1,0,4] 2026-02-17T11:56:45.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f97b015d220 0x7f97b015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:45.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 10 monclient(hunting): picked mon.noname-c con 0x7f97b015d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:45.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f97b0074920 0x7f97b00c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 10 monclient(hunting): picked mon.noname-a con 0x7f97b0074920 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f97b00c9120 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97b00c95b0 con 0x7f97b00c9120 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f97b00c58a0 con 0x7f97b0074920 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f97b00c55c0 con 0x7f97b015d220 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97b4a24640 10 monclient(hunting): authenticate will time out at 1075.012392s 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97add74640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f97b0074920 0x7f97b00c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:45.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.290+0000 7f97ae575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f97b015d220 0x7f97b015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:45.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97add74640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f97b0074920 0x7f97b00c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:43544/0 (socket says 10.20.193.10:43544) 2026-02-17T11:56:45.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97add74640 1 -- 10.20.193.10:0/3544453083 learned_addr learned my addr 10.20.193.10:0/3544453083 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:45.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97add74640 10 monclient(hunting): get_auth_request con 0x7f97b0074920 auth_method 0 2026-02-17T11:56:45.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97add74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:45.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97add74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:45.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97add74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:45.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97add74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:45.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97add74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:45.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97add74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:45.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97ae575640 10 monclient(hunting): get_auth_request con 0x7f97b015d220 auth_method 0 2026-02-17T11:56:45.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:45.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:45.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97ae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:45.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:45.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:45.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.291+0000 7f97ae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:45.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.292+0000 7f97add74640 10 monclient(hunting): handle_auth_done global_id 4614 payload 274 2026-02-17T11:56:45.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.292+0000 7f97add74640 1 -- 10.20.193.10:0/3544453083 >> v2:10.20.193.153:3300/0 conn(0x7f97b015d220 msgr2=0x7f97b015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:45.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.292+0000 7f97add74640 1 --2- 10.20.193.10:0/3544453083 >> v2:10.20.193.153:3300/0 conn(0x7f97b015d220 0x7f97b015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.292+0000 7f97add74640 1 -- 10.20.193.10:0/3544453083 >> v1:10.20.193.153:6789/0 conn(0x7f97b00c9120 legacy=0x7f97b0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:45.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.292+0000 7f97add74640 10 monclient: _finish_hunting 0 2026-02-17T11:56:45.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.292+0000 7f97add74640 1 monclient: found mon.noname-a 2026-02-17T11:56:45.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.292+0000 7f97add74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:45.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.292+0000 7f97add74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:45.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.292+0000 7f97add74640 1 -- 10.20.193.10:0/3544453083 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b00c7e20 con 0x7f97b0074920 2026-02-17T11:56:45.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.293+0000 7f97add74640 1 --2- 10.20.193.10:0/3544453083 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b0074920 0x7f97b00c8be0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9798009970 tx=0x7f979802eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec5ca691bc2ed67 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 1 -- 10.20.193.10:0/3544453083 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979803c070 con 0x7f97b0074920 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 10 monclient: dump: 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 10 monclient: _finish_auth 0 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 10 monclient: _check_auth_tickets 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 1 -- 10.20.193.10:0/3544453083 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979802fbc0 con 0x7f97b0074920 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 5 monclient: authenticate success, global_id 4614 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 1 -- 10.20.193.10:0/3544453083 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798037440 con 0x7f97b0074920 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97ad573640 10 monclient: dump: 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:45.308 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 4 set_mon_vals no callback set 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 10 monclient: shutdown 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 1 -- 10.20.193.10:0/3544453083 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b0074920 msgr2=0x7f97b00c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 1 --2- 10.20.193.10:0/3544453083 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b0074920 0x7f97b00c8be0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9798009970 tx=0x7f979802eef0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 1 -- 10.20.193.10:0/3544453083 shutdown_connections 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 1 --2- 10.20.193.10:0/3544453083 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b0074920 0x7f97b00c8be0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 1 --2- 10.20.193.10:0/3544453083 >> v2:10.20.193.153:3300/0 conn(0x7f97b015d220 0x7f97b015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 1 -- 10.20.193.10:0/3544453083 >> 10.20.193.10:0/3544453083 conn(0x7f97b00c9d80 msgr2=0x7f97b00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 1 -- 10.20.193.10:0/3544453083 shutdown_connections 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.295+0000 7f97b4a24640 1 -- 10.20.193.10:0/3544453083 wait complete. 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient: build_initial_monmap 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient: monmap: 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 librados: starting msgr at 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 librados: starting objecter 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 Processor -- start 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 -- start start 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 librados: setting wanted keys 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 librados: calling monclient init 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient: init 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f97b0074920 0x7f97b01eaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient(hunting): picked mon.noname-b con 0x7f97b0074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97b00c9120 0x7f97b00cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient(hunting): picked mon.noname-c con 0x7f97b00c9120 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b015d220 0x7f97b01f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient(hunting): picked mon.noname-a con 0x7f97b015d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f97b00c86c0 con 0x7f97b015d220 2026-02-17T11:56:45.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97b00c83e0 con 0x7f97b0074920 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97b0074d70 con 0x7f97b00c9120 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.296+0000 7f97b4a24640 10 monclient(hunting): authenticate will time out at 1075.018996s 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b015d220 0x7f97b01f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97add74640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97b00c9120 0x7f97b00cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b015d220 0x7f97b01f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:43554/0 (socket says 10.20.193.10:43554) 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 1 -- 10.20.193.10:0/1221176089 learned_addr learned my addr 10.20.193.10:0/1221176089 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 10 monclient(hunting): get_auth_request con 0x7f97b015d220 auth_method 0 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97ae575640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f97b0074920 0x7f97b01eaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97add74640 10 monclient(hunting): get_auth_request con 0x7f97b00c9120 auth_method 0 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97add74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97add74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97add74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97aed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97ae575640 10 monclient(hunting): get_auth_request con 0x7f97b0074920 auth_method 0 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97ae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97ae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97add74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97add74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.297+0000 7f97add74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 10 monclient(hunting): handle_auth_done global_id 4617 payload 824 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 1 -- 10.20.193.10:0/1221176089 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97b00c9120 msgr2=0x7f97b00cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97b00c9120 0x7f97b00cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 1 -- 10.20.193.10:0/1221176089 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f97b0074920 msgr2=0x7f97b01eaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f97b0074920 0x7f97b01eaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 10 monclient: _finish_hunting 0 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 1 monclient: found mon.noname-a 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.299+0000 7f97aed76640 1 -- 10.20.193.10:0/1221176089 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b01f4ff0 con 0x7f97b015d220 2026-02-17T11:56:45.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.300+0000 7f97aed76640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b015d220 0x7f97b01f57b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f97a000cc50 tx=0x7f97a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.300+0000 7f9796ffd640 10 client.?.objecter ms_handle_connect 0x7f97b015d220 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.300+0000 7f9796ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 1 -- 10.20.193.10:0/1221176089 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0003a70 con 0x7f97b015d220 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 10 monclient: dump: 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 1 -- 10.20.193.10:0/1221176089 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a0003c10 con 0x7f97b015d220 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 1 -- 10.20.193.10:0/1221176089 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a00050d0 con 0x7f97b015d220 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97acd72640 4 set_mon_vals no callback set 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f9796ffd640 10 monclient: dump: 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97b4a24640 5 monclient: authenticate success, global_id 4617 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97b4a24640 10 monclient: _renew_subs 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97b4a24640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b01f4120 con 0x7f97b015d220 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97b4a24640 10 client.4617.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97b4a24640 10 monclient: _renew_subs 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97b4a24640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:45.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b01f46e0 con 0x7f97b015d220 2026-02-17T11:56:45.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.301+0000 7f97b4a24640 1 librados: init done 2026-02-17T11:56:45.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.302+0000 7f97b4a24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:45.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.302+0000 7f97b4a24640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:45.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.302+0000 7f97b4a24640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:45.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.302+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b00c8be0 con 0x7f97b015d220 2026-02-17T11:56:45.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.313+0000 7f9796ffd640 1 -- 10.20.193.10:0/1221176089 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f97a0005270 con 0x7f97b015d220 2026-02-17T11:56:45.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.313+0000 7f9796ffd640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f977c078e50 0x7f977c07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:45.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.313+0000 7f97ae575640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f977c078e50 0x7f977c07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:45.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.313+0000 7f97ae575640 10 monclient: get_auth_request con 0x7f977c078e50 auth_method 0 2026-02-17T11:56:45.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.314+0000 7f97ae575640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f977c078e50 0x7f977c07b310 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009ba0 tx=0x7f97a4009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:45.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.314+0000 7f9796ffd640 10 client.4617.objecter ms_handle_connect 0x7f977c078e50 2026-02-17T11:56:45.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.315+0000 7f9796ffd640 1 -- 10.20.193.10:0/1221176089 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f97a005e6d0 con 0x7f97b015d220 2026-02-17T11:56:45.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.315+0000 7f9796ffd640 10 client.4617.objecter ms_dispatch2 0x7f97b0000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:45.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.315+0000 7f9796ffd640 3 client.4617.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:45.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.315+0000 7f9796ffd640 3 client.4617.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:45.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.315+0000 7f9796ffd640 20 client.4617.objecter dump_active .. 0 homeless 2026-02-17T11:56:45.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.416+0000 7f9796ffd640 1 -- 10.20.193.10:0/1221176089 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f97a0062690 con 0x7f97b015d220 2026-02-17T11:56:45.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.416+0000 7f9796ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:45.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.416+0000 7f9796ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:45.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.515+0000 7f97b4a24640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:45.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.515+0000 7f97b4a24640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:45.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.515+0000 7f97b4a24640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:45.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.515+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f97b01573e0 con 0x7f97b015d220 2026-02-17T11:56:45.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.518+0000 7f9796ffd640 1 -- 10.20.193.10:0/1221176089 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f97a0066990 con 0x7f97b015d220 2026-02-17T11:56:45.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.518+0000 7f9796ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:45.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.518+0000 7f9796ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:45.521 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:45.522 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:45.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 10 librados: watch_flush enter 2026-02-17T11:56:45.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 10 librados: watch_flush exit 2026-02-17T11:56:45.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 20 client.4617.objecter shutdown clearing up homeless session... 2026-02-17T11:56:45.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 10 client.4617.objecter successfully canceled tick 2026-02-17T11:56:45.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f977c078e50 msgr2=0x7f977c07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f977c078e50 0x7f977c07b310 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009ba0 tx=0x7f97a4009290 comp rx=0 tx=0).stop 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 10 monclient: shutdown 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b015d220 msgr2=0x7f97b01f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b015d220 0x7f97b01f57b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f97a000cc50 tx=0x7f97a000a430 comp rx=0 tx=0).stop 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 shutdown_connections 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f977c078e50 0x7f977c07b310 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f97b015d220 0x7f97b01f57b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97b00c9120 0x7f97b00cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 --2- 10.20.193.10:0/1221176089 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f97b0074920 0x7f97b01eaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:45.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 >> 10.20.193.10:0/1221176089 conn(0x7f97b00c9d80 msgr2=0x7f97b00c4910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:45.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 shutdown_connections 2026-02-17T11:56:45.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 -- 10.20.193.10:0/1221176089 wait complete. 2026-02-17T11:56:45.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:45.519+0000 7f97b4a24640 1 librados: shutdown 2026-02-17T11:56:48.531 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:48.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.597+0000 7fa80c9a0640 10 monclient: get_monmap_and_config 2026-02-17T11:56:48.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.597+0000 7fa80c9a0640 10 monclient: build_initial_monmap 2026-02-17T11:56:48.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.597+0000 7fa80c9a0640 10 monclient: monmap: 2026-02-17T11:56:48.600 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:48.600 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:48.600 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:48.598757+0000 2026-02-17T11:56:48.600 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:48.598757+0000 2026-02-17T11:56:48.600 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:48.601 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:48.601 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:48.601 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:48.601 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:48.601 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:48.601 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:48.601 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:48.601 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:48.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.597+0000 7fa80c9a0640 1 Processor -- start 2026-02-17T11:56:48.602 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.597+0000 7fa80c9a0640 1 -- start start 2026-02-17T11:56:48.602 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.597+0000 7fa80c9a0640 10 monclient: init 2026-02-17T11:56:48.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:48.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 10 monclient: _add_conns ranks=[2,0,5,3,4,1] 2026-02-17T11:56:48.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa80415d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:48.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa8040c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:48.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fa804153d60 0x7fa80415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 10 monclient(hunting): picked mon.noname-c con 0x7fa804153d60 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8040c58a0 con 0x7fa8040c92f0 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8040c55c0 con 0x7fa80415d220 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa8040c7e20 con 0x7fa804153d60 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa80c9a0640 10 monclient(hunting): authenticate will time out at 1078.320484s 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa809f14640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fa8040c92f0 0x7fa804153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:34894/0 (socket says 10.20.193.10:34894) 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.598+0000 7fa809f14640 1 -- 10.20.193.10:0/1808792610 learned_addr learned my addr 10.20.193.10:0/1808792610 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:48.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.599+0000 7fa80af16640 1 --2- 10.20.193.10:0/1808792610 >> v2:10.20.193.153:3300/0 conn(0x7fa804153d60 0x7fa80415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.599+0000 7fa80af16640 10 monclient(hunting): get_auth_request con 0x7fa804153d60 auth_method 0 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.599+0000 7fa80af16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.599+0000 7fa80af16640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.599+0000 7fa80af16640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.600+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080109372 0 0) 0x7fa8040c58a0 con 0x7fa8040c92f0 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.600+0000 7fa809713640 10 monclient(hunting): _negotiate 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.600+0000 7fa809713640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.600+0000 7fa809713640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.600+0000 7fa809713640 10 monclient(hunting): my global_id is 4620 2026-02-17T11:56:48.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.600+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f4003620 con 0x7fa8040c92f0 2026-02-17T11:56:48.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.600+0000 7fa80af16640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:48.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.600+0000 7fa80af16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:48.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.600+0000 7fa80af16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:48.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038011593 0 0) 0x7fa8040c55c0 con 0x7fa80415d220 2026-02-17T11:56:48.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): _negotiate 2026-02-17T11:56:48.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:48.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): my global_id is 4685 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8040c58a0 con 0x7fa80415d220 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 478893442 0 0) 0x7fa7f4003620 con 0x7fa8040c92f0 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 >> v2:10.20.193.153:3300/0 conn(0x7fa804153d60 msgr2=0x7fa80415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 --2- 10.20.193.10:0/1808792610 >> v2:10.20.193.153:3300/0 conn(0x7fa804153d60 0x7fa80415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 >> v1:10.20.193.153:6789/0 conn(0x7fa80415d220 legacy=0x7fa8040c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient: _finish_hunting 0 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8040c8100 con 0x7fa8040c92f0 2026-02-17T11:56:48.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient: _finish_auth 0 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient: _check_auth_tickets 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fa7f0002f00 con 0x7fa8040c92f0 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient: dump: 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.614 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 >> v1:10.20.193.10:6789/0 conn(0x7fa8040c92f0 legacy=0x7fa804153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa7f4003dd0 0x7fa7f40041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): picked mon.c con 0x7fa7f4003dd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:48.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa7f4004900 0x7fa7f4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): picked mon.a con 0x7fa7f4004900 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa7f400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): picked mon.b con 0x7fa7f4005490 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa8040c7e20 con 0x7fa7f4004900 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f400c380 con 0x7fa7f4005490 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f400c580 con 0x7fa7f4003dd0 2026-02-17T11:56:48.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.601+0000 7fa809713640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.602+0000 7fa80af16640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa7f400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.602+0000 7fa80af16640 10 monclient(hunting): get_auth_request con 0x7fa7f4005490 auth_method 0 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.602+0000 7fa80af16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.602+0000 7fa80af16640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.602+0000 7fa80af16640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa80af16640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa80af16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa80af16640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa809f14640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa7f4004900 0x7fa7f4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:48.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa809f14640 10 monclient(hunting): get_auth_request con 0x7fa7f4004900 auth_method 0 2026-02-17T11:56:48.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa809f14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:48.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa809f14640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:48.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa809f14640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:48.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa80a715640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa7f4003dd0 0x7fa7f40041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:48.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa809f14640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:48.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa809f14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:48.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.603+0000 7fa809f14640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:48.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80a715640 10 monclient(hunting): get_auth_request con 0x7fa7f4003dd0 auth_method 0 2026-02-17T11:56:48.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80a715640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:48.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80a715640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:48.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80a715640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:56:48.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80a715640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:48.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80a715640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:48.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80a715640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:56:48.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 10 monclient(hunting): handle_auth_done global_id 4620 payload 293 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 1 -- 10.20.193.10:0/1808792610 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa7f4003dd0 msgr2=0x7fa7f40041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa7f4003dd0 0x7fa7f40041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 1 -- 10.20.193.10:0/1808792610 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa7f4004900 msgr2=0x7fa7f4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa7f4004900 0x7fa7f4004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 10 monclient: _finish_hunting 0 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 1 monclient: found mon.b 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 1 -- 10.20.193.10:0/1808792610 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f4003620 con 0x7fa7f4005490 2026-02-17T11:56:48.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 10 monclient: _finish_auth 0 2026-02-17T11:56:48.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 10 monclient: _check_auth_tickets 2026-02-17T11:56:48.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:48.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80c9a0640 5 monclient: authenticate success, global_id 4620 2026-02-17T11:56:48.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80c9a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:48.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.604+0000 7fa80af16640 1 -- 10.20.193.10:0/1808792610 reap_dead start 2026-02-17T11:56:48.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.605+0000 7fa80af16640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa7f400bac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009fc0 tx=0x7fa7f802f5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627802b3e0144fa2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:48.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f803a020 con 0x7fa7f4005490 2026-02-17T11:56:48.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:48.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 10 monclient: dump: 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:48.628 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa80c9a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8003cd0 con 0x7fa7f4005490 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 1 -- 10.20.193.10:0/1808792610 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8009c10 con 0x7fa7f4005490 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa80c9a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa80c9a0640 4 set_mon_vals no callback set 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa809713640 10 monclient: dump: 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:48.629 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.607+0000 7fa80c9a0640 10 monclient: shutdown 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 -- 10.20.193.10:0/1808792610 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 msgr2=0x7fa7f400bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:48.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa7f400bac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009fc0 tx=0x7fa7f802f5b0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 -- 10.20.193.10:0/1808792610 shutdown_connections 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 --2- 10.20.193.10:0/1808792610 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa7f400bac0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 -- 10.20.193.10:0/1808792610 >> 10.20.193.10:0/1808792610 conn(0x7fa8040c9d80 msgr2=0x7fa8040ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 -- 10.20.193.10:0/1808792610 shutdown_connections 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 -- 10.20.193.10:0/1808792610 wait complete. 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 10 monclient: build_initial_monmap 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 10 monclient: monmap: 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:48.631 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 librados: starting msgr at 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 librados: starting objecter 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 Processor -- start 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 -- start start 2026-02-17T11:56:48.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 librados: setting wanted keys 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 1 librados: calling monclient init 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.608+0000 7fa80c9a0640 10 monclient: init 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa80406dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient(hunting): picked mon.noname-b con 0x7fa7f4005490 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8041f4f50 0x7fa8041f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient(hunting): picked mon.noname-c con 0x7fa8041f4f50 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa80414ec50 0x7fa8041f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient(hunting): picked mon.noname-a con 0x7fa80414ec50 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:48.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa80415d600 con 0x7fa80414ec50 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8040c86c0 con 0x7fa7f4005490 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa80415d780 con 0x7fa8041f4f50 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80c9a0640 10 monclient(hunting): authenticate will time out at 1078.331302s 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80af16640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa80414ec50 0x7fa8041f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80a715640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa80406dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa809f14640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8041f4f50 0x7fa8041f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80a715640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa80406dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:33140/0 (socket says 10.20.193.10:33140) 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80a715640 1 -- 10.20.193.10:0/2903042354 learned_addr learned my addr 10.20.193.10:0/2903042354 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:48.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80a715640 10 monclient(hunting): get_auth_request con 0x7fa7f4005490 auth_method 0 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80a715640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80a715640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80a715640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80af16640 10 monclient(hunting): get_auth_request con 0x7fa80414ec50 auth_method 0 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80af16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80af16640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80af16640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa809f14640 10 monclient(hunting): get_auth_request con 0x7fa8041f4f50 auth_method 0 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa809f14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa809f14640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa809f14640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80a715640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:48.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.609+0000 7fa80a715640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.610+0000 7fa80a715640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.610+0000 7fa80af16640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.610+0000 7fa80af16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.610+0000 7fa80af16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.610+0000 7fa809f14640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.610+0000 7fa809f14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.610+0000 7fa809f14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 10 monclient(hunting): handle_auth_done global_id 4623 payload 824 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 1 -- 10.20.193.10:0/2903042354 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8041f4f50 msgr2=0x7fa8041f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8041f4f50 0x7fa8041f3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 1 -- 10.20.193.10:0/2903042354 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 msgr2=0x7fa80406dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa80406dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 10 monclient: _finish_hunting 0 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 1 monclient: found mon.noname-a 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.611+0000 7fa80af16640 1 -- 10.20.193.10:0/2903042354 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80406d250 con 0x7fa80414ec50 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.612+0000 7fa80af16640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa80414ec50 0x7fa8041f7470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa8040c6850 tx=0x7fa7f8004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.612+0000 7fa7eeffd640 10 client.?.objecter ms_handle_connect 0x7fa80414ec50 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.612+0000 7fa7eeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 1 -- 10.20.193.10:0/2903042354 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f803a050 con 0x7fa80414ec50 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 10 monclient: dump: 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:48.637 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 1 -- 10.20.193.10:0/2903042354 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8047070 con 0x7fa80414ec50 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa80c9a0640 5 monclient: authenticate success, global_id 4623 2026-02-17T11:56:48.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 1 -- 10.20.193.10:0/2903042354 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8009c10 con 0x7fa80414ec50 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa7eeffd640 10 monclient: dump: 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:48.639 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa80c9a0640 10 monclient: _renew_subs 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa80c9a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80406e200 con 0x7fa80414ec50 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa808f12640 4 set_mon_vals no callback set 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa80c9a0640 10 client.4623.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa80c9a0640 10 monclient: _renew_subs 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa80c9a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8041f46b0 con 0x7fa80414ec50 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.613+0000 7fa80c9a0640 1 librados: init done 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.614+0000 7fa80c9a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.614+0000 7fa80c9a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.614+0000 7fa80c9a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:48.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.614+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa804074920 con 0x7fa80414ec50 2026-02-17T11:56:48.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.719+0000 7fa7eeffd640 1 -- 10.20.193.10:0/2903042354 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fa7f803f8a0 con 0x7fa80414ec50 2026-02-17T11:56:48.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.719+0000 7fa7eeffd640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa7d4078e80 0x7fa7d407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:48.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.719+0000 7fa80a715640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa7d4078e80 0x7fa7d407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:48.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.719+0000 7fa80a715640 10 monclient: get_auth_request con 0x7fa7d4078e80 auth_method 0 2026-02-17T11:56:48.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.720+0000 7fa80a715640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa7d4078e80 0x7fa7d407b340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0056c0 tx=0x7fa7fc007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:48.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.720+0000 7fa7eeffd640 10 client.4623.objecter ms_handle_connect 0x7fa7d4078e80 2026-02-17T11:56:48.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.727+0000 7fa7eeffd640 1 -- 10.20.193.10:0/2903042354 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fa7f8083b90 con 0x7fa80414ec50 2026-02-17T11:56:48.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.727+0000 7fa7eeffd640 10 client.4623.objecter ms_dispatch2 0x7fa804000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:48.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.727+0000 7fa7eeffd640 3 client.4623.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:48.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.727+0000 7fa7eeffd640 3 client.4623.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:48.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.727+0000 7fa7eeffd640 20 client.4623.objecter dump_active .. 0 homeless 2026-02-17T11:56:48.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.727+0000 7fa7eeffd640 1 -- 10.20.193.10:0/2903042354 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa7f8087b50 con 0x7fa80414ec50 2026-02-17T11:56:48.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.727+0000 7fa7eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:48.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.727+0000 7fa7eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:48.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.828+0000 7fa80c9a0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:48.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.828+0000 7fa80c9a0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:48.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.828+0000 7fa80c9a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:48.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.828+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa8041573e0 con 0x7fa80414ec50 2026-02-17T11:56:48.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.831+0000 7fa7eeffd640 1 -- 10.20.193.10:0/2903042354 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fa7f808be50 con 0x7fa80414ec50 2026-02-17T11:56:48.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.831+0000 7fa7eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:48.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.831+0000 7fa7eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:48.833 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:48.833 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:48.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 10 librados: watch_flush enter 2026-02-17T11:56:48.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 10 librados: watch_flush exit 2026-02-17T11:56:48.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 20 client.4623.objecter shutdown clearing up homeless session... 2026-02-17T11:56:48.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 10 client.4623.objecter successfully canceled tick 2026-02-17T11:56:48.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa7d4078e80 msgr2=0x7fa7d407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:48.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa7d4078e80 0x7fa7d407b340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0056c0 tx=0x7fa7fc007d60 comp rx=0 tx=0).stop 2026-02-17T11:56:48.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 10 monclient: shutdown 2026-02-17T11:56:48.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:48.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa80414ec50 msgr2=0x7fa8041f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa80414ec50 0x7fa8041f7470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa8040c6850 tx=0x7fa7f8004bb0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 shutdown_connections 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa7d4078e80 0x7fa7d407b340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa80414ec50 0x7fa8041f7470 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8041f4f50 0x7fa8041f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 --2- 10.20.193.10:0/2903042354 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa7f4005490 0x7fa80406dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 >> 10.20.193.10:0/2903042354 conn(0x7fa8040c9d80 msgr2=0x7fa8041510e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 shutdown_connections 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 -- 10.20.193.10:0/2903042354 wait complete. 2026-02-17T11:56:48.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:48.832+0000 7fa80c9a0640 1 librados: shutdown 2026-02-17T11:56:51.844 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:51.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.911+0000 7f46a62bf640 10 monclient: get_monmap_and_config 2026-02-17T11:56:51.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.911+0000 7f46a62bf640 10 monclient: build_initial_monmap 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.911+0000 7f46a62bf640 10 monclient: monmap: 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:51.912964+0000 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:51.912964+0000 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:51.914 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:51.915 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:51.915 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:51.915 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 1 Processor -- start 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 1 -- start start 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient: init 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient: _add_conns ranks=[1,4,3,5,2,0] 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f46a0152660 addr v1:10.20.193.71:6789/0 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f46a015b030 0x7f46a00c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient(hunting): picked mon.noname-b con 0x7f46a015b030 addr v2:10.20.193.71:3300/0 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f46a0152a40 0x7f46a00c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient(hunting): picked mon.noname-a con 0x7f46a0152a40 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:51.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a00c71e0 con 0x7f46a0152660 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f46a00c77a0 con 0x7f46a0152a40 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f46a00c74c0 con 0x7f46a015b030 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.912+0000 7f46a62bf640 10 monclient(hunting): authenticate will time out at 1081.634960s 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f46a4835640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f46a0152a40 0x7f46a00c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f469f7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f46a015b030 0x7f46a00c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f46a4835640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f46a0152a40 0x7f46a00c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:43570/0 (socket says 10.20.193.10:43570) 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f46a4835640 1 -- 10.20.193.10:0/3241908353 learned_addr learned my addr 10.20.193.10:0/3241908353 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f46a4835640 10 monclient(hunting): get_auth_request con 0x7f46a0152a40 auth_method 0 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f46a4835640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f46a4835640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:51.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f46a4835640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f469f7fe640 10 monclient(hunting): get_auth_request con 0x7f46a015b030 auth_method 0 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f469f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f469f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f469f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f46a4835640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.913+0000 7f46a4835640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.914+0000 7f46a4835640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.914+0000 7f469f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.914+0000 7f469f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.914+0000 7f469f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.915+0000 7f46a4835640 10 monclient(hunting): handle_auth_done global_id 4626 payload 274 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.915+0000 7f46a4835640 1 -- 10.20.193.10:0/3241908353 >> v2:10.20.193.71:3300/0 conn(0x7f46a015b030 msgr2=0x7f46a00c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:51.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.915+0000 7f46a4835640 1 --2- 10.20.193.10:0/3241908353 >> v2:10.20.193.71:3300/0 conn(0x7f46a015b030 0x7f46a00c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:51.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.915+0000 7f46a4835640 1 -- 10.20.193.10:0/3241908353 >> v1:10.20.193.71:6789/0 conn(0x7f46a0152660 legacy=0x7f46a015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:51.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.915+0000 7f46a4835640 10 monclient: _finish_hunting 0 2026-02-17T11:56:51.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.915+0000 7f46a4835640 1 monclient: found mon.noname-a 2026-02-17T11:56:51.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.915+0000 7f46a4835640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:51.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.915+0000 7f46a4835640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:51.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.915+0000 7f46a4835640 1 -- 10.20.193.10:0/3241908353 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a0159e40 con 0x7f46a0152a40 2026-02-17T11:56:51.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.916+0000 7f46a4835640 1 --2- 10.20.193.10:0/3241908353 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f46a0152a40 0x7f46a00c9310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f46a01563f0 tx=0x7f4694031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2863357b710c54ed server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:51.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.917+0000 7f469effd640 1 -- 10.20.193.10:0/3241908353 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469403d070 con 0x7f46a0152a40 2026-02-17T11:56:51.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.917+0000 7f469effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:51.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.917+0000 7f469effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:51.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.917+0000 7f469effd640 10 monclient: dump: 2026-02-17T11:56:51.925 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.917+0000 7f469effd640 10 monclient: _finish_auth 0 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.917+0000 7f469effd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.917+0000 7f469effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.917+0000 7f46a62bf640 5 monclient: authenticate success, global_id 4626 2026-02-17T11:56:51.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.917+0000 7f46a62bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f469effd640 1 -- 10.20.193.10:0/3241908353 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469400b4e0 con 0x7f46a0152a40 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f469effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f469effd640 1 -- 10.20.193.10:0/3241908353 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46940098a0 con 0x7f46a0152a40 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f469effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f469effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f469effd640 10 monclient: dump: 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:51.927 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 4 set_mon_vals no callback set 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 10 monclient: shutdown 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 1 -- 10.20.193.10:0/3241908353 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f46a0152a40 msgr2=0x7f46a00c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 1 --2- 10.20.193.10:0/3241908353 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f46a0152a40 0x7f46a00c9310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f46a01563f0 tx=0x7f4694031500 comp rx=0 tx=0).stop 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 1 -- 10.20.193.10:0/3241908353 shutdown_connections 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 1 --2- 10.20.193.10:0/3241908353 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f46a0152a40 0x7f46a00c9310 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 1 --2- 10.20.193.10:0/3241908353 >> v2:10.20.193.71:3300/0 conn(0x7f46a015b030 0x7f46a00c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 1 -- 10.20.193.10:0/3241908353 >> 10.20.193.10:0/3241908353 conn(0x7f46a00c9d80 msgr2=0x7f46a00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 1 -- 10.20.193.10:0/3241908353 shutdown_connections 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.919+0000 7f46a62bf640 1 -- 10.20.193.10:0/3241908353 wait complete. 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.920+0000 7f46a62bf640 10 monclient: build_initial_monmap 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.920+0000 7f46a62bf640 10 monclient: monmap: 2026-02-17T11:56:51.928 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.920+0000 7f46a62bf640 1 librados: starting msgr at 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.920+0000 7f46a62bf640 1 librados: starting objecter 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.920+0000 7f46a62bf640 1 Processor -- start 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.920+0000 7f46a62bf640 1 -- start start 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.920+0000 7f46a62bf640 1 librados: setting wanted keys 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.920+0000 7f46a62bf640 1 librados: calling monclient init 2026-02-17T11:56:51.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.920+0000 7f46a62bf640 10 monclient: init 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46a0152660 0x7f46a01efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient(hunting): picked mon.noname-b con 0x7f46a0152660 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f46a0152a40 0x7f46a01500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient(hunting): picked mon.noname-a con 0x7f46a0152a40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f46a015b030 0x7f46a0158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient(hunting): picked mon.noname-c con 0x7f46a015b030 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f46a00c7c80 con 0x7f46a0152a40 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46a015a400 con 0x7f46a0152660 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46a00c7e00 con 0x7f46a015b030 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:51.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a62bf640 10 monclient(hunting): authenticate will time out at 1081.643315s 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f469ffff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46a0152660 0x7f46a01efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f46a4835640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f46a015b030 0x7f46a0158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f469ffff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46a0152660 0x7f46a01efd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:33156/0 (socket says 10.20.193.10:33156) 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f469ffff640 1 -- 10.20.193.10:0/609189522 learned_addr learned my addr 10.20.193.10:0/609189522 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f469ffff640 10 monclient(hunting): get_auth_request con 0x7f46a0152660 auth_method 0 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f469ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f469ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.921+0000 7f469ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f46a4835640 10 monclient(hunting): get_auth_request con 0x7f46a015b030 auth_method 0 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f46a4835640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f46a4835640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f46a4835640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469f7fe640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f46a0152a40 0x7f46a01500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:51.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f46a4835640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f46a4835640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f46a4835640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469f7fe640 10 monclient(hunting): get_auth_request con 0x7f46a0152a40 auth_method 0 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.922+0000 7f469f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 10 monclient(hunting): handle_auth_done global_id 4666 payload 824 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 1 -- 10.20.193.10:0/609189522 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f46a015b030 msgr2=0x7f46a0158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f46a015b030 0x7f46a0158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 1 -- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f46a0152a40 msgr2=0x7f46a01500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f46a0152a40 0x7f46a01500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:56:51.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 1 monclient: found mon.noname-b 2026-02-17T11:56:51.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:51.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:56:51.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.923+0000 7f469ffff640 1 -- 10.20.193.10:0/609189522 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a0156a10 con 0x7f46a0152660 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.924+0000 7f469ffff640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46a0152660 0x7f46a01efd50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c520 tx=0x7f468c00c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.924+0000 7f469cff9640 10 client.?.objecter ms_handle_connect 0x7f46a0152660 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.924+0000 7f469cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f469cff9640 1 -- 10.20.193.10:0/609189522 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c016020 con 0x7f46a0152660 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f469cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f469cff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f469cff9640 10 monclient: dump: 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:51.934 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f469cff9640 10 monclient: _finish_auth 0 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f469cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f469cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f46a62bf640 5 monclient: authenticate success, global_id 4666 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f46a62bf640 10 monclient: _renew_subs 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f46a62bf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a0156cf0 con 0x7f46a0152660 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f46a62bf640 10 client.4666.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f46a62bf640 10 monclient: _renew_subs 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f46a62bf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a01f0ac0 con 0x7f46a0152660 2026-02-17T11:56:51.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.925+0000 7f46a62bf640 1 librados: init done 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f46a62bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f46a62bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f46a62bf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a015a920 con 0x7f46a0152660 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f469cff9640 1 -- 10.20.193.10:0/609189522 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468c0052d0 con 0x7f46a0152660 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f469cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f469cff9640 1 -- 10.20.193.10:0/609189522 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c0068d0 con 0x7f46a0152660 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f469cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f469cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f469cff9640 10 monclient: dump: 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:51.936 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:51.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:51.926+0000 7f469e7fc640 4 set_mon_vals no callback set 2026-02-17T11:56:52.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.034+0000 7f469cff9640 1 -- 10.20.193.10:0/609189522 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f468c003710 con 0x7f46a0152660 2026-02-17T11:56:52.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.034+0000 7f469cff9640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4670078e00 0x7f467007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:52.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.034+0000 7f469f7fe640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4670078e00 0x7f467007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:52.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.034+0000 7f469f7fe640 10 monclient: get_auth_request con 0x7f4670078e00 auth_method 0 2026-02-17T11:56:52.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.035+0000 7f469f7fe640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4670078e00 0x7f467007b2c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f46a00c70e0 tx=0x7f4690009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:52.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.035+0000 7f469cff9640 10 client.4666.objecter ms_handle_connect 0x7f4670078e00 2026-02-17T11:56:52.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.036+0000 7f469cff9640 1 -- 10.20.193.10:0/609189522 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f468c05dd40 con 0x7f46a0152660 2026-02-17T11:56:52.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.036+0000 7f469cff9640 10 client.4666.objecter ms_dispatch2 0x7f46a0000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:52.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.036+0000 7f469cff9640 3 client.4666.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:52.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.036+0000 7f469cff9640 3 client.4666.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:52.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.036+0000 7f469cff9640 20 client.4666.objecter dump_active .. 0 homeless 2026-02-17T11:56:52.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.042+0000 7f469cff9640 1 -- 10.20.193.10:0/609189522 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f468c020020 con 0x7f46a0152660 2026-02-17T11:56:52.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.042+0000 7f469cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:52.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.042+0000 7f469cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:52.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.140+0000 7f46a62bf640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:52.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.140+0000 7f46a62bf640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:52.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.140+0000 7f46a62bf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:56:52.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.140+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f46a014a5a0 con 0x7f46a0152660 2026-02-17T11:56:52.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.143+0000 7f469cff9640 1 -- 10.20.193.10:0/609189522 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f468c061d00 con 0x7f46a0152660 2026-02-17T11:56:52.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.143+0000 7f469cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:52.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.143+0000 7f469cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:52.145 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:52.146 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:52.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 10 librados: watch_flush enter 2026-02-17T11:56:52.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 10 librados: watch_flush exit 2026-02-17T11:56:52.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 20 client.4666.objecter shutdown clearing up homeless session... 2026-02-17T11:56:52.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 10 client.4666.objecter successfully canceled tick 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4670078e00 msgr2=0x7f467007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4670078e00 0x7f467007b2c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f46a00c70e0 tx=0x7f4690009290 comp rx=0 tx=0).stop 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 10 monclient: shutdown 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46a0152660 msgr2=0x7f46a01efd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46a0152660 0x7f46a01efd50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c520 tx=0x7f468c00c9f0 comp rx=0 tx=0).stop 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 shutdown_connections 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4670078e00 0x7f467007b2c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f46a015b030 0x7f46a0158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f46a0152a40 0x7f46a01500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:52.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 --2- 10.20.193.10:0/609189522 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46a0152660 0x7f46a01efd50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:52.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 >> 10.20.193.10:0/609189522 conn(0x7f46a00c9d80 msgr2=0x7f46a014d850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:52.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 shutdown_connections 2026-02-17T11:56:52.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 -- 10.20.193.10:0/609189522 wait complete. 2026-02-17T11:56:52.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:52.144+0000 7f46a62bf640 1 librados: shutdown 2026-02-17T11:56:54.916 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:03:12.084 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:54.919 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:03:12.087 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:54.927 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:03:12.095 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:54.946 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:03:12.074 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:54.946 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:03:12.109 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:54.948 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:03:12.076 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:54.948 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:03:12.111 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:54.956 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:03:12.084 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:54.957 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:03:12.120 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:56:55.155 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:55.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.219+0000 7fa190f6a640 10 monclient: get_monmap_and_config 2026-02-17T11:56:55.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.219+0000 7fa190f6a640 10 monclient: build_initial_monmap 2026-02-17T11:56:55.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.219+0000 7fa190f6a640 10 monclient: monmap: 2026-02-17T11:56:55.222 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:55.222 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:55.221157+0000 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:55.221157+0000 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:55.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 1 Processor -- start 2026-02-17T11:56:55.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 1 -- start start 2026-02-17T11:56:55.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 10 monclient: init 2026-02-17T11:56:55.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:55.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 10 monclient: _add_conns ranks=[0,3,2,5,4,1] 2026-02-17T11:56:55.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa18c15d220 addr v1:10.20.193.10:6789/0 2026-02-17T11:56:55.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa18c0c92f0 0x7fa18c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:55.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 10 monclient(hunting): picked mon.noname-a con 0x7fa18c0c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:55.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa18c074920 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:55.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c0c58a0 con 0x7fa18c15d220 2026-02-17T11:56:55.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c0c55c0 con 0x7fa18c074920 2026-02-17T11:56:55.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:55.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa18c0c7e20 con 0x7fa18c0c92f0 2026-02-17T11:56:55.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:55.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.220+0000 7fa190f6a640 10 monclient(hunting): authenticate will time out at 1084.942871s 2026-02-17T11:56:55.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.221+0000 7fa189d74640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa18c0c92f0 0x7fa18c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:55.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.221+0000 7fa18ad76640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fa18c074920 0x7fa18c153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:47462/0 (socket says 10.20.193.10:47462) 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.221+0000 7fa18ad76640 1 -- 10.20.193.10:0/3462678353 learned_addr learned my addr 10.20.193.10:0/3462678353 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.221+0000 7fa189d74640 10 monclient(hunting): get_auth_request con 0x7fa18c0c92f0 auth_method 0 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.221+0000 7fa189d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.221+0000 7fa189d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.221+0000 7fa189d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.222+0000 7fa189d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.222+0000 7fa189d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.222+0000 7fa189d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.222+0000 7fa189573640 1 -- 10.20.193.10:0/3462678353 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785663990 0 0) 0x7fa18c0c55c0 con 0x7fa18c074920 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.222+0000 7fa189573640 10 monclient(hunting): _negotiate 2026-02-17T11:56:55.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.222+0000 7fa189573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.222+0000 7fa189573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.222+0000 7fa189573640 10 monclient(hunting): my global_id is 4694 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.222+0000 7fa189573640 1 -- 10.20.193.10:0/3462678353 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa178003620 con 0x7fa18c074920 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.223+0000 7fa189d74640 10 monclient(hunting): handle_auth_done global_id 4632 payload 274 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.223+0000 7fa189d74640 1 -- 10.20.193.10:0/3462678353 >> v1:10.20.193.153:6789/0 conn(0x7fa18c074920 legacy=0x7fa18c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.223+0000 7fa189d74640 1 -- 10.20.193.10:0/3462678353 >> v1:10.20.193.10:6789/0 conn(0x7fa18c15d220 legacy=0x7fa18c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.223+0000 7fa189d74640 10 monclient: _finish_hunting 0 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.223+0000 7fa189d74640 1 monclient: found mon.noname-a 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.223+0000 7fa189d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.223+0000 7fa189d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:55.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.223+0000 7fa189d74640 1 -- 10.20.193.10:0/3462678353 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c0c8100 con 0x7fa18c0c92f0 2026-02-17T11:56:55.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.225+0000 7fa189d74640 1 --2- 10.20.193.10:0/3462678353 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c0c92f0 0x7fa18c15d600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa1740098d0 tx=0x7fa17402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255c7b1a9fbacec8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:55.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 1 -- 10.20.193.10:0/3462678353 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17403c070 con 0x7fa18c0c92f0 2026-02-17T11:56:55.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 10 monclient: dump: 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:55.237 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 10 monclient: _finish_auth 0 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 10 monclient: _check_auth_tickets 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 1 -- 10.20.193.10:0/3462678353 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17402fba0 con 0x7fa18c0c92f0 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 1 -- 10.20.193.10:0/3462678353 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174037440 con 0x7fa18c0c92f0 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 5 monclient: authenticate success, global_id 4632 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa189573640 10 monclient: dump: 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:55.238 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 4 set_mon_vals no callback set 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 10 monclient: shutdown 2026-02-17T11:56:55.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 1 -- 10.20.193.10:0/3462678353 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c0c92f0 msgr2=0x7fa18c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 1 --2- 10.20.193.10:0/3462678353 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c0c92f0 0x7fa18c15d600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa1740098d0 tx=0x7fa17402eed0 comp rx=0 tx=0).stop 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 1 -- 10.20.193.10:0/3462678353 shutdown_connections 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 1 --2- 10.20.193.10:0/3462678353 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c0c92f0 0x7fa18c15d600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 1 -- 10.20.193.10:0/3462678353 >> 10.20.193.10:0/3462678353 conn(0x7fa18c0c9d80 msgr2=0x7fa18c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 1 -- 10.20.193.10:0/3462678353 shutdown_connections 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 1 -- 10.20.193.10:0/3462678353 wait complete. 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 10 monclient: build_initial_monmap 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.228+0000 7fa190f6a640 10 monclient: monmap: 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:55.240 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 librados: starting msgr at 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 librados: starting objecter 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 Processor -- start 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 -- start start 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 librados: setting wanted keys 2026-02-17T11:56:55.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 librados: calling monclient init 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient: init 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c074920 0x7fa18c1f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient(hunting): picked mon.noname-a con 0x7fa18c074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa18c0c92f0 0x7fa18c140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient(hunting): picked mon.noname-b con 0x7fa18c0c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa18c15d220 0x7fa18c15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient(hunting): picked mon.noname-c con 0x7fa18c15d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c074d70 con 0x7fa18c074920 2026-02-17T11:56:55.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c0c86c0 con 0x7fa18c0c92f0 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c153d60 con 0x7fa18c15d220 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa190f6a640 10 monclient(hunting): authenticate will time out at 1084.951596s 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa18a575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c074920 0x7fa18c1f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18ad76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa18c15d220 0x7fa18c15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.229+0000 7fa18a575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c074920 0x7fa18c1f3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57440/0 (socket says 10.20.193.10:57440) 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18a575640 1 -- 10.20.193.10:0/2764014930 learned_addr learned my addr 10.20.193.10:0/2764014930 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18a575640 10 monclient(hunting): get_auth_request con 0x7fa18c074920 auth_method 0 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:55.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa189d74640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa18c0c92f0 0x7fa18c140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa189d74640 10 monclient(hunting): get_auth_request con 0x7fa18c0c92f0 auth_method 0 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa189d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa189d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa189d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18ad76640 10 monclient(hunting): get_auth_request con 0x7fa18c15d220 auth_method 0 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:55.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa189d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa189d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa189d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.230+0000 7fa18ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 10 monclient(hunting): handle_auth_done global_id 4697 payload 824 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 1 -- 10.20.193.10:0/2764014930 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa18c0c92f0 msgr2=0x7fa18c140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa18c0c92f0 0x7fa18c140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 1 -- 10.20.193.10:0/2764014930 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c074920 msgr2=0x7fa18c1f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c074920 0x7fa18c1f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:56:55.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 1 monclient: found mon.noname-c 2026-02-17T11:56:55.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:55.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:56:55.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.231+0000 7fa18ad76640 1 -- 10.20.193.10:0/2764014930 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c15b300 con 0x7fa18c15d220 2026-02-17T11:56:55.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.233+0000 7fa18ad76640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa18c15d220 0x7fa18c15bda0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00ca80 tx=0x7fa17c00cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:55.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.233+0000 7fa172ffd640 10 client.?.objecter ms_handle_connect 0x7fa18c15d220 2026-02-17T11:56:55.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.233+0000 7fa172ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:55.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 1 -- 10.20.193.10:0/2764014930 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00ac40 con 0x7fa18c15d220 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 10 monclient: dump: 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:55.248 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 10 monclient: _finish_auth 0 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 1 -- 10.20.193.10:0/2764014930 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17c00ade0 con 0x7fa18c15d220 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa190f6a640 5 monclient: authenticate success, global_id 4697 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa190f6a640 10 monclient: _renew_subs 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa190f6a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18c1f3fe0 con 0x7fa18c15d220 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:55.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 1 -- 10.20.193.10:0/2764014930 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c012600 con 0x7fa18c15d220 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa172ffd640 10 monclient: dump: 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:55.250 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa188d72640 4 set_mon_vals no callback set 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa190f6a640 10 client.4697.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa190f6a640 10 monclient: _renew_subs 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa190f6a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18c1f4590 con 0x7fa18c15d220 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.235+0000 7fa190f6a640 1 librados: init done 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.236+0000 7fa190f6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.236+0000 7fa190f6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.236+0000 7fa190f6a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:55.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.236+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa18c15d600 con 0x7fa18c15d220 2026-02-17T11:56:55.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.247+0000 7fa172ffd640 1 -- 10.20.193.10:0/2764014930 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fa17c0127a0 con 0x7fa18c15d220 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.247+0000 7fa172ffd640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa158078e00 0x7fa15807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.248+0000 7fa18a575640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa158078e00 0x7fa15807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.248+0000 7fa18a575640 10 monclient: get_auth_request con 0x7fa158078e00 auth_method 0 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.248+0000 7fa18a575640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa158078e00 0x7fa15807b2c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa180002770 tx=0x7fa180002990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.248+0000 7fa172ffd640 10 client.4697.objecter ms_handle_connect 0x7fa158078e00 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.250+0000 7fa172ffd640 1 -- 10.20.193.10:0/2764014930 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fa17c05e830 con 0x7fa18c15d220 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.250+0000 7fa172ffd640 10 client.4697.objecter ms_dispatch2 0x7fa18c000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.250+0000 7fa172ffd640 3 client.4697.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.250+0000 7fa172ffd640 3 client.4697.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:55.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.250+0000 7fa172ffd640 20 client.4697.objecter dump_active .. 0 homeless 2026-02-17T11:56:55.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.355+0000 7fa172ffd640 1 -- 10.20.193.10:0/2764014930 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa17c0627f0 con 0x7fa18c15d220 2026-02-17T11:56:55.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.355+0000 7fa172ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:55.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.355+0000 7fa172ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:55.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.454+0000 7fa190f6a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:55.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.454+0000 7fa190f6a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:55.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.454+0000 7fa190f6a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:56:55.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.454+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa18c1573e0 con 0x7fa18c15d220 2026-02-17T11:56:55.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.457+0000 7fa172ffd640 1 -- 10.20.193.10:0/2764014930 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fa17c066af0 con 0x7fa18c15d220 2026-02-17T11:56:55.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.457+0000 7fa172ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:55.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.457+0000 7fa172ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:55.459 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:55.459 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:55.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 10 librados: watch_flush enter 2026-02-17T11:56:55.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 10 librados: watch_flush exit 2026-02-17T11:56:55.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 20 client.4697.objecter shutdown clearing up homeless session... 2026-02-17T11:56:55.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 10 client.4697.objecter successfully canceled tick 2026-02-17T11:56:55.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa158078e00 msgr2=0x7fa15807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:55.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa158078e00 0x7fa15807b2c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa180002770 tx=0x7fa180002990 comp rx=0 tx=0).stop 2026-02-17T11:56:55.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 10 monclient: shutdown 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa18c15d220 msgr2=0x7fa18c15bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa18c15d220 0x7fa18c15bda0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00ca80 tx=0x7fa17c00cf50 comp rx=0 tx=0).stop 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 shutdown_connections 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa158078e00 0x7fa15807b2c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa18c15d220 0x7fa18c15bda0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa18c0c92f0 0x7fa18c140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 --2- 10.20.193.10:0/2764014930 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa18c074920 0x7fa18c1f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 >> 10.20.193.10:0/2764014930 conn(0x7fa18c0c9d80 msgr2=0x7fa18c06fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 shutdown_connections 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 -- 10.20.193.10:0/2764014930 wait complete. 2026-02-17T11:56:55.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:55.458+0000 7fa190f6a640 1 librados: shutdown 2026-02-17T11:56:58.470 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:56:58.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.537+0000 7f83575a7640 10 monclient: get_monmap_and_config 2026-02-17T11:56:58.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.537+0000 7f83575a7640 10 monclient: build_initial_monmap 2026-02-17T11:56:58.540 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.537+0000 7f83575a7640 10 monclient: monmap: 2026-02-17T11:56:58.540 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:58.540 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:58.540 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:56:58.538817+0000 2026-02-17T11:56:58.540 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:56:58.538817+0000 2026-02-17T11:56:58.540 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:58.540 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:58.540 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:56:58.541 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:56:58.541 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:56:58.541 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:56:58.541 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:56:58.541 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:56:58.541 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:58.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 1 Processor -- start 2026-02-17T11:56:58.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 1 -- start start 2026-02-17T11:56:58.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient: init 2026-02-17T11:56:58.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:58.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient: _add_conns ranks=[5,3,2,4,0,1] 2026-02-17T11:56:58.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f835015d220 0x7f835015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient(hunting): picked mon.noname-c con 0x7f835015d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:56:58.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8350074920 0x7f83500c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient(hunting): picked mon.noname-a con 0x7f8350074920 addr v2:10.20.193.10:3300/0 2026-02-17T11:56:58.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f83500c9120 addr v1:10.20.193.153:6789/0 2026-02-17T11:56:58.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83500c95b0 con 0x7f83500c9120 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f83500c58a0 con 0x7f8350074920 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f83500c55c0 con 0x7f835015d220 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.538+0000 7f83575a7640 10 monclient(hunting): authenticate will time out at 1088.260623s 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8350074920 0x7f83500c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f835531c640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f835015d220 0x7f835015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8350074920 0x7f83500c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57444/0 (socket says 10.20.193.10:57444) 2026-02-17T11:56:58.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 1 -- 10.20.193.10:0/3177266101 learned_addr learned my addr 10.20.193.10:0/3177266101 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 10 monclient(hunting): get_auth_request con 0x7f8350074920 auth_method 0 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f835531c640 10 monclient(hunting): get_auth_request con 0x7f835015d220 auth_method 0 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f835531c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f835531c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f835531c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.539+0000 7f8354b1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f835531c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f835531c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f835531c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f8354b1b640 10 monclient(hunting): handle_auth_done global_id 4641 payload 274 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f8354b1b640 1 -- 10.20.193.10:0/3177266101 >> v2:10.20.193.153:3300/0 conn(0x7f835015d220 msgr2=0x7f835015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f8354b1b640 1 --2- 10.20.193.10:0/3177266101 >> v2:10.20.193.153:3300/0 conn(0x7f835015d220 0x7f835015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f8354b1b640 1 -- 10.20.193.10:0/3177266101 >> v1:10.20.193.153:6789/0 conn(0x7f83500c9120 legacy=0x7f8350153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f8354b1b640 10 monclient: _finish_hunting 0 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f8354b1b640 1 monclient: found mon.noname-a 2026-02-17T11:56:58.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f8354b1b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:58.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f8354b1b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:58.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.540+0000 7f8354b1b640 1 -- 10.20.193.10:0/3177266101 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83500c7e20 con 0x7f8350074920 2026-02-17T11:56:58.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.541+0000 7f8354b1b640 1 --2- 10.20.193.10:0/3177266101 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 0x7f83500c8be0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8344009970 tx=0x7f834402eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2e598f273bb829 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:58.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 1 -- 10.20.193.10:0/3177266101 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834403c070 con 0x7f8350074920 2026-02-17T11:56:58.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:58.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 10 monclient: dump: 2026-02-17T11:56:58.555 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:58.555 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 10 monclient: _finish_auth 0 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:58.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 1 -- 10.20.193.10:0/3177266101 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834402fbc0 con 0x7f8350074920 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 1 -- 10.20.193.10:0/3177266101 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344037440 con 0x7f8350074920 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 5 monclient: authenticate success, global_id 4641 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f833ffff640 10 monclient: dump: 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.557 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 10 monclient: get_monmap_and_config success 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 4 set_mon_vals no callback set 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 10 monclient: shutdown 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 1 -- 10.20.193.10:0/3177266101 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 msgr2=0x7f83500c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 1 --2- 10.20.193.10:0/3177266101 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 0x7f83500c8be0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8344009970 tx=0x7f834402eef0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 1 -- 10.20.193.10:0/3177266101 shutdown_connections 2026-02-17T11:56:58.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 1 --2- 10.20.193.10:0/3177266101 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 0x7f83500c8be0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 1 --2- 10.20.193.10:0/3177266101 >> v2:10.20.193.153:3300/0 conn(0x7f835015d220 0x7f835015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 1 -- 10.20.193.10:0/3177266101 >> 10.20.193.10:0/3177266101 conn(0x7f83500c9d80 msgr2=0x7f83500ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 1 -- 10.20.193.10:0/3177266101 shutdown_connections 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.543+0000 7f83575a7640 1 -- 10.20.193.10:0/3177266101 wait complete. 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient: build_initial_monmap 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient: monmap: 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:56:58.559 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 librados: starting msgr at 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 librados: starting objecter 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 Processor -- start 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 -- start start 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 librados: setting wanted keys 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 librados: calling monclient init 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient: init 2026-02-17T11:56:58.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 0x7f83501f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient(hunting): picked mon.noname-a con 0x7f8350074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f83500c9120 0x7f8350072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient(hunting): picked mon.noname-c con 0x7f83500c9120 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f835015d220 0x7f83501456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient(hunting): picked mon.noname-b con 0x7f835015d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f83500c86c0 con 0x7f8350074920 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83500c83e0 con 0x7f835015d220 2026-02-17T11:56:58.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8350074d70 con 0x7f83500c9120 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.544+0000 7f83575a7640 10 monclient(hunting): authenticate will time out at 1088.266743s 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 0x7f83501f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8354b1b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f83500c9120 0x7f8350072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8355b1d640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f835015d220 0x7f83501456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 0x7f83501f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57450/0 (socket says 10.20.193.10:57450) 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 1 -- 10.20.193.10:0/3080031298 learned_addr learned my addr 10.20.193.10:0/3080031298 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 10 monclient(hunting): get_auth_request con 0x7f8350074920 auth_method 0 2026-02-17T11:56:58.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8354b1b640 10 monclient(hunting): get_auth_request con 0x7f83500c9120 auth_method 0 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8354b1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8354b1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8354b1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8355b1d640 10 monclient(hunting): get_auth_request con 0x7f835015d220 auth_method 0 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8355b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8355b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:56:58.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8355b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f835531c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8354b1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8354b1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8354b1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8355b1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8355b1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.545+0000 7f8355b1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 10 monclient(hunting): handle_auth_done global_id 4644 payload 824 2026-02-17T11:56:58.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 1 -- 10.20.193.10:0/3080031298 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f83500c9120 msgr2=0x7f8350072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f83500c9120 0x7f8350072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 1 -- 10.20.193.10:0/3080031298 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f835015d220 msgr2=0x7f83501456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f835015d220 0x7f83501456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 10 monclient: _finish_hunting 0 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 1 monclient: found mon.noname-a 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.546+0000 7f835531c640 1 -- 10.20.193.10:0/3080031298 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83501f3e00 con 0x7f8350074920 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.547+0000 7f835531c640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 0x7f83501f3680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f834000e890 tx=0x7f834000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.547+0000 7f833dffb640 10 client.?.objecter ms_handle_connect 0x7f8350074920 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.547+0000 7f833dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:56:58.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 1 -- 10.20.193.10:0/3080031298 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340017070 con 0x7f8350074920 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 10 monclient: dump: 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:58.566 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 10 monclient: _finish_auth 0 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 1 -- 10.20.193.10:0/3080031298 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834000c940 con 0x7f8350074920 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 1 -- 10.20.193.10:0/3080031298 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834000cd30 con 0x7f8350074920 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:56:58.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833dffb640 10 monclient: dump: 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:56:58.568 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f833f7fe640 4 set_mon_vals no callback set 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f83575a7640 5 monclient: authenticate success, global_id 4644 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f83575a7640 10 monclient: _renew_subs 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f83575a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83501f40e0 con 0x7f8350074920 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f83575a7640 10 client.4644.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f83575a7640 10 monclient: _renew_subs 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f83575a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83500726e0 con 0x7f8350074920 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.549+0000 7f83575a7640 1 librados: init done 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.550+0000 7f83575a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.550+0000 7f83575a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.550+0000 7f83575a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:58.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.550+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83500724d0 con 0x7f8350074920 2026-02-17T11:56:58.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.561+0000 7f833dffb640 1 -- 10.20.193.10:0/3080031298 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f8340013470 con 0x7f8350074920 2026-02-17T11:56:58.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.562+0000 7f833dffb640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8320078e50 0x7f832007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:56:58.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.562+0000 7f8354b1b640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8320078e50 0x7f832007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:56:58.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.562+0000 7f8354b1b640 10 monclient: get_auth_request con 0x7f8320078e50 auth_method 0 2026-02-17T11:56:58.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.562+0000 7f833dffb640 10 client.4644.objecter ms_handle_connect 0x7f8320078e50 2026-02-17T11:56:58.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.562+0000 7f8354b1b640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8320078e50 0x7f832007b310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f83500c6b30 tx=0x7f8344039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:56:58.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.563+0000 7f833dffb640 1 -- 10.20.193.10:0/3080031298 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f834005e3d0 con 0x7f8350074920 2026-02-17T11:56:58.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.563+0000 7f833dffb640 10 client.4644.objecter ms_dispatch2 0x7f8350000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:56:58.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.563+0000 7f833dffb640 3 client.4644.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:56:58.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.563+0000 7f833dffb640 3 client.4644.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:56:58.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.563+0000 7f833dffb640 20 client.4644.objecter dump_active .. 0 homeless 2026-02-17T11:56:58.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.662+0000 7f833dffb640 1 -- 10.20.193.10:0/3080031298 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8340062390 con 0x7f8350074920 2026-02-17T11:56:58.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.662+0000 7f833dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:56:58.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.662+0000 7f833dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:56:58.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.764+0000 7f83575a7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:56:58.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.764+0000 7f83575a7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:58.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.764+0000 7f83575a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:56:58.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.764+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f83500c8be0 con 0x7f8350074920 2026-02-17T11:56:58.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.767+0000 7f833dffb640 1 -- 10.20.193.10:0/3080031298 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f8340066690 con 0x7f8350074920 2026-02-17T11:56:58.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.767+0000 7f833dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:56:58.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.767+0000 7f833dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:56:58.769 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:56:58.769 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:56:58.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.768+0000 7f83575a7640 10 librados: watch_flush enter 2026-02-17T11:56:58.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.768+0000 7f83575a7640 10 librados: watch_flush exit 2026-02-17T11:56:58.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.768+0000 7f83575a7640 20 client.4644.objecter shutdown clearing up homeless session... 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.768+0000 7f83575a7640 10 client.4644.objecter successfully canceled tick 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.768+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8320078e50 msgr2=0x7f832007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.768+0000 7f83575a7640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8320078e50 0x7f832007b310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f83500c6b30 tx=0x7f8344039040 comp rx=0 tx=0).stop 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 10 monclient: shutdown 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 msgr2=0x7f83501f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 0x7f83501f3680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f834000e890 tx=0x7f834000ed60 comp rx=0 tx=0).stop 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 shutdown_connections 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8320078e50 0x7f832007b310 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f835015d220 0x7f83501456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f83500c9120 0x7f8350072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 --2- 10.20.193.10:0/3080031298 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8350074920 0x7f83501f3680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 >> 10.20.193.10:0/3080031298 conn(0x7f83500c9d80 msgr2=0x7f835014ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 shutdown_connections 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 -- 10.20.193.10:0/3080031298 wait complete. 2026-02-17T11:56:58.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:56:58.769+0000 7f83575a7640 1 librados: shutdown 2026-02-17T11:57:01.780 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:01.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.846+0000 7f26b8ee1640 10 monclient: get_monmap_and_config 2026-02-17T11:57:01.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.846+0000 7f26b8ee1640 10 monclient: build_initial_monmap 2026-02-17T11:57:01.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.846+0000 7f26b8ee1640 10 monclient: monmap: 2026-02-17T11:57:01.852 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:01.852 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:01.852 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:01.847202+0000 2026-02-17T11:57:01.852 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:01.847202+0000 2026-02-17T11:57:01.852 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:01.852 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:01.852 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 1 Processor -- start 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 1 -- start start 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient: init 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient: _add_conns ranks=[2,5,3,4,1,0] 2026-02-17T11:57:01.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f26b415d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f26b40c92f0 0x7f26b415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient(hunting): picked mon.noname-c con 0x7f26b40c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f26b4074920 0x7f26b4153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient(hunting): picked mon.noname-a con 0x7f26b4074920 addr v2:10.20.193.10:3300/0 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b40c58a0 con 0x7f26b415d220 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f26b40c55c0 con 0x7f26b4074920 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f26b40c7e20 con 0x7f26b40c92f0 2026-02-17T11:57:01.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:01.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.847+0000 7f26b8ee1640 10 monclient(hunting): authenticate will time out at 1091.568961s 2026-02-17T11:57:01.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f26b4074920 0x7f26b4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:01.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b1d74640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f26b40c92f0 0x7f26b415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:01.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f26b4074920 0x7f26b4153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57460/0 (socket says 10.20.193.10:57460) 2026-02-17T11:57:01.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 1 -- 10.20.193.10:0/2901482645 learned_addr learned my addr 10.20.193.10:0/2901482645 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:01.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 10 monclient(hunting): get_auth_request con 0x7f26b4074920 auth_method 0 2026-02-17T11:57:01.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:01.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:01.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b1d74640 10 monclient(hunting): get_auth_request con 0x7f26b40c92f0 auth_method 0 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.848+0000 7f26b1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:01.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b2d76640 10 monclient(hunting): handle_auth_done global_id 4647 payload 274 2026-02-17T11:57:01.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b2d76640 1 -- 10.20.193.10:0/2901482645 >> v2:10.20.193.153:3300/0 conn(0x7f26b40c92f0 msgr2=0x7f26b415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:01.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b2d76640 1 --2- 10.20.193.10:0/2901482645 >> v2:10.20.193.153:3300/0 conn(0x7f26b40c92f0 0x7f26b415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:01.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b2d76640 1 -- 10.20.193.10:0/2901482645 >> v1:10.20.193.153:6789/0 conn(0x7f26b415d220 legacy=0x7f26b40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:01.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b2d76640 10 monclient: _finish_hunting 0 2026-02-17T11:57:01.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b2d76640 1 monclient: found mon.noname-a 2026-02-17T11:57:01.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:01.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:01.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.849+0000 7f26b2d76640 1 -- 10.20.193.10:0/2901482645 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b40c8100 con 0x7f26b4074920 2026-02-17T11:57:01.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.850+0000 7f26b2d76640 1 --2- 10.20.193.10:0/2901482645 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b4074920 0x7f26b4153650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009e50 tx=0x7f26a402f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8180ffe07749b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:01.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 1 -- 10.20.193.10:0/2901482645 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a402fd60 con 0x7f26b4074920 2026-02-17T11:57:01.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:01.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:01.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 10 monclient: dump: 2026-02-17T11:57:01.865 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:01.865 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 10 monclient: _finish_auth 0 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 10 monclient: _check_auth_tickets 2026-02-17T11:57:01.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 1 -- 10.20.193.10:0/2901482645 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a40373f0 con 0x7f26b4074920 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 1 -- 10.20.193.10:0/2901482645 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a40377c0 con 0x7f26b4074920 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b1573640 10 monclient: dump: 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:01.867 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b8ee1640 5 monclient: authenticate success, global_id 4647 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b8ee1640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.852+0000 7f26b8ee1640 4 set_mon_vals no callback set 2026-02-17T11:57:01.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 10 monclient: shutdown 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 -- 10.20.193.10:0/2901482645 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b4074920 msgr2=0x7f26b4153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 --2- 10.20.193.10:0/2901482645 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b4074920 0x7f26b4153650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009e50 tx=0x7f26a402f2a0 comp rx=0 tx=0).stop 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 -- 10.20.193.10:0/2901482645 shutdown_connections 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 --2- 10.20.193.10:0/2901482645 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b4074920 0x7f26b4153650 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 --2- 10.20.193.10:0/2901482645 >> v2:10.20.193.153:3300/0 conn(0x7f26b40c92f0 0x7f26b415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 -- 10.20.193.10:0/2901482645 >> 10.20.193.10:0/2901482645 conn(0x7f26b40c9d80 msgr2=0x7f26b40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 -- 10.20.193.10:0/2901482645 shutdown_connections 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 -- 10.20.193.10:0/2901482645 wait complete. 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 10 monclient: build_initial_monmap 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 10 monclient: monmap: 2026-02-17T11:57:01.869 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 librados: starting msgr at 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 librados: starting objecter 2026-02-17T11:57:01.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.853+0000 7f26b8ee1640 1 Processor -- start 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 1 -- start start 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 1 librados: setting wanted keys 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 1 librados: calling monclient init 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient: init 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f26b4074920 0x7f26b4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient(hunting): picked mon.noname-c con 0x7f26b4074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b40c92f0 0x7f26b4148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient(hunting): picked mon.noname-a con 0x7f26b40c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26b415d220 0x7f26b406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:01.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient(hunting): picked mon.noname-b con 0x7f26b415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4074d70 con 0x7f26b40c92f0 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f26b40c86c0 con 0x7f26b415d220 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4153b90 con 0x7f26b4074920 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b8ee1640 10 monclient(hunting): authenticate will time out at 1091.575448s 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b1d74640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b40c92f0 0x7f26b4148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b2575640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f26b4074920 0x7f26b4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b1d74640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b40c92f0 0x7f26b4148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57462/0 (socket says 10.20.193.10:57462) 2026-02-17T11:57:01.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b1d74640 1 -- 10.20.193.10:0/3332263794 learned_addr learned my addr 10.20.193.10:0/3332263794 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b1d74640 10 monclient(hunting): get_auth_request con 0x7f26b40c92f0 auth_method 0 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b2575640 10 monclient(hunting): get_auth_request con 0x7f26b4074920 auth_method 0 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.854+0000 7f26b2d76640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26b415d220 0x7f26b406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:01.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2d76640 10 monclient(hunting): get_auth_request con 0x7f26b415d220 auth_method 0 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.855+0000 7f26b2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 10 monclient(hunting): handle_auth_done global_id 4715 payload 824 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 1 -- 10.20.193.10:0/3332263794 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26b415d220 msgr2=0x7f26b406ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:01.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26b415d220 0x7f26b406ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 1 -- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b40c92f0 msgr2=0x7f26b4148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b40c92f0 0x7f26b4148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 10 monclient: _finish_hunting 0 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 1 monclient: found mon.noname-c 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b2575640 1 -- 10.20.193.10:0/3332263794 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b406d250 con 0x7f26b4074920 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.856+0000 7f26b1d74640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b40c92f0 0x7f26b4148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.857+0000 7f26b2575640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f26b4074920 0x7f26b4156b60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f26a800c450 tx=0x7f26a800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.857+0000 7f269affd640 10 client.?.objecter ms_handle_connect 0x7f26b4074920 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.857+0000 7f269affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:01.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 1 -- 10.20.193.10:0/3332263794 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80052d0 con 0x7f26b4074920 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 10 monclient: dump: 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:01.876 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 10 monclient: _finish_auth 0 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 10 monclient: _check_auth_tickets 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 1 -- 10.20.193.10:0/3332263794 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a8005470 con 0x7f26b4074920 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 5 monclient: authenticate success, global_id 4715 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 1 -- 10.20.193.10:0/3332263794 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80038f0 con 0x7f26b4074920 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:01.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f269affd640 10 monclient: dump: 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b0d72640 4 set_mon_vals no callback set 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 10 monclient: _renew_subs 2026-02-17T11:57:01.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b406d4f0 con 0x7f26b4074920 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 10 client.4715.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 10 monclient: _renew_subs 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b406dab0 con 0x7f26b4074920 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 1 librados: init done 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:01.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.859+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b4153f20 con 0x7f26b4074920 2026-02-17T11:57:01.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.870+0000 7f269affd640 1 -- 10.20.193.10:0/3332263794 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f26a8003a90 con 0x7f26b4074920 2026-02-17T11:57:01.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f269affd640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2680078e50 0x7f268007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:01.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f26b1d74640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2680078e50 0x7f268007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:01.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f26b1d74640 10 monclient: get_auth_request con 0x7f2680078e50 auth_method 0 2026-02-17T11:57:01.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f269affd640 10 client.4715.objecter ms_handle_connect 0x7f2680078e50 2026-02-17T11:57:01.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f26b1d74640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2680078e50 0x7f268007b310 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f26b41f37d0 tx=0x7f269c009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:01.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f269affd640 1 -- 10.20.193.10:0/3332263794 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f26a805df30 con 0x7f26b4074920 2026-02-17T11:57:01.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f269affd640 10 client.4715.objecter ms_dispatch2 0x7f26b4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:01.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f269affd640 3 client.4715.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:01.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f269affd640 3 client.4715.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:01.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.871+0000 7f269affd640 20 client.4715.objecter dump_active .. 0 homeless 2026-02-17T11:57:01.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.976+0000 7f269affd640 1 -- 10.20.193.10:0/3332263794 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f26a8061ef0 con 0x7f26b4074920 2026-02-17T11:57:01.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.976+0000 7f269affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:01.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:01.976+0000 7f269affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:02.076 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.074+0000 7f26b8ee1640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:02.076 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.074+0000 7f26b8ee1640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:02.076 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.074+0000 7f26b8ee1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:02.076 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.074+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26b40c4cb0 con 0x7f26b4074920 2026-02-17T11:57:02.077 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.077+0000 7f269affd640 1 -- 10.20.193.10:0/3332263794 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f26a80661f0 con 0x7f26b4074920 2026-02-17T11:57:02.078 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.077+0000 7f269affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:02.078 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.077+0000 7f269affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:02.078 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:02.078 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:02.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 10 librados: watch_flush enter 2026-02-17T11:57:02.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 10 librados: watch_flush exit 2026-02-17T11:57:02.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 20 client.4715.objecter shutdown clearing up homeless session... 2026-02-17T11:57:02.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 10 client.4715.objecter successfully canceled tick 2026-02-17T11:57:02.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2680078e50 msgr2=0x7f268007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:02.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2680078e50 0x7f268007b310 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f26b41f37d0 tx=0x7f269c009290 comp rx=0 tx=0).stop 2026-02-17T11:57:02.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 10 monclient: shutdown 2026-02-17T11:57:02.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f26b4074920 msgr2=0x7f26b4156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f26b4074920 0x7f26b4156b60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f26a800c450 tx=0x7f26a800c920 comp rx=0 tx=0).stop 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 shutdown_connections 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2680078e50 0x7f268007b310 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26b415d220 0x7f26b406ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f26b40c92f0 0x7f26b4148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 --2- 10.20.193.10:0/3332263794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f26b4074920 0x7f26b4156b60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 >> 10.20.193.10:0/3332263794 conn(0x7f26b40c9d80 msgr2=0x7f26b40ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 shutdown_connections 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 -- 10.20.193.10:0/3332263794 wait complete. 2026-02-17T11:57:02.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:02.078+0000 7f26b8ee1640 1 librados: shutdown 2026-02-17T11:57:05.088 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:05.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.157+0000 7f8ffda32640 10 monclient: get_monmap_and_config 2026-02-17T11:57:05.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.157+0000 7f8ffda32640 10 monclient: build_initial_monmap 2026-02-17T11:57:05.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.157+0000 7f8ffda32640 10 monclient: monmap: 2026-02-17T11:57:05.159 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:05.159 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:05.159 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:05.157734+0000 2026-02-17T11:57:05.159 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:05.157734+0000 2026-02-17T11:57:05.159 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:05.159 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.157+0000 7f8ffda32640 1 Processor -- start 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.157+0000 7f8ffda32640 1 -- start start 2026-02-17T11:57:05.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.157+0000 7f8ffda32640 10 monclient: init 2026-02-17T11:57:05.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:05.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 10 monclient: _add_conns ranks=[1,4,0,3,2,5] 2026-02-17T11:57:05.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f8ff815d220 addr v1:10.20.193.71:6789/0 2026-02-17T11:57:05.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8ff80c92f0 0x7f8ff815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 10 monclient(hunting): picked mon.noname-b con 0x7f8ff80c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:57:05.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8ff8074920 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:05.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff80c58a0 con 0x7f8ff8074920 2026-02-17T11:57:05.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff80c55c0 con 0x7f8ff815d220 2026-02-17T11:57:05.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff80c7e20 con 0x7f8ff80c92f0 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ffda32640 10 monclient(hunting): authenticate will time out at 1094.879449s 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ff77fe640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f8ff8074920 0x7f8ff8153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:59230/0 (socket says 10.20.193.10:59230) 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ff77fe640 1 -- 10.20.193.10:0/2774947342 learned_addr learned my addr 10.20.193.10:0/2774947342 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.158+0000 7f8ff67fc640 1 --2- 10.20.193.10:0/2774947342 >> v2:10.20.193.71:3300/0 conn(0x7f8ff80c92f0 0x7f8ff815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.159+0000 7f8ff67fc640 10 monclient(hunting): get_auth_request con 0x7f8ff80c92f0 auth_method 0 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.159+0000 7f8ff67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.159+0000 7f8ff67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.159+0000 7f8ff67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.159+0000 7f8ff67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:05.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.159+0000 7f8ff67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.159+0000 7f8ff67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff5ffb640 1 -- 10.20.193.10:0/2774947342 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793572836 0 0) 0x7f8ff80c58a0 con 0x7f8ff8074920 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff5ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff5ffb640 10 monclient(hunting): my global_id is 4653 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff5ffb640 1 -- 10.20.193.10:0/2774947342 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fe4003620 con 0x7f8ff8074920 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff67fc640 10 monclient(hunting): handle_auth_done global_id 4678 payload 274 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff67fc640 1 -- 10.20.193.10:0/2774947342 >> v1:10.20.193.71:6789/0 conn(0x7f8ff815d220 legacy=0x7f8ff80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff67fc640 1 -- 10.20.193.10:0/2774947342 >> v1:10.20.193.10:6789/0 conn(0x7f8ff8074920 legacy=0x7f8ff8153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:57:05.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff67fc640 1 monclient: found mon.noname-b 2026-02-17T11:57:05.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:05.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff67fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:57:05.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.160+0000 7f8ff67fc640 1 -- 10.20.193.10:0/2774947342 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff80c8100 con 0x7f8ff80c92f0 2026-02-17T11:57:05.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.162+0000 7f8ff67fc640 1 --2- 10.20.193.10:0/2774947342 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ff80c92f0 0x7f8ff815d600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00098d0 tx=0x7f8fe002eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=242c807dba9e052e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:05.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 1 -- 10.20.193.10:0/2774947342 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe003c070 con 0x7f8ff80c92f0 2026-02-17T11:57:05.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:05.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:05.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 10 monclient: dump: 2026-02-17T11:57:05.171 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:05.171 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:05.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 1 -- 10.20.193.10:0/2774947342 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe002fba0 con 0x7f8ff80c92f0 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 1 -- 10.20.193.10:0/2774947342 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0037440 con 0x7f8ff80c92f0 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 5 monclient: authenticate success, global_id 4678 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 4 set_mon_vals no callback set 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ff5ffb640 10 monclient: dump: 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:05.173 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 10 monclient: shutdown 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 1 -- 10.20.193.10:0/2774947342 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ff80c92f0 msgr2=0x7f8ff815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 1 --2- 10.20.193.10:0/2774947342 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ff80c92f0 0x7f8ff815d600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00098d0 tx=0x7f8fe002eed0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 1 -- 10.20.193.10:0/2774947342 shutdown_connections 2026-02-17T11:57:05.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 1 --2- 10.20.193.10:0/2774947342 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ff80c92f0 0x7f8ff815d600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 1 -- 10.20.193.10:0/2774947342 >> 10.20.193.10:0/2774947342 conn(0x7f8ff80c9d80 msgr2=0x7f8ff80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 1 -- 10.20.193.10:0/2774947342 shutdown_connections 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.164+0000 7f8ffda32640 1 -- 10.20.193.10:0/2774947342 wait complete. 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.165+0000 7f8ffda32640 10 monclient: build_initial_monmap 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.165+0000 7f8ffda32640 10 monclient: monmap: 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:05.175 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.165+0000 7f8ffda32640 1 librados: starting msgr at 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.165+0000 7f8ffda32640 1 librados: starting objecter 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.165+0000 7f8ffda32640 1 Processor -- start 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.165+0000 7f8ffda32640 1 -- start start 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.165+0000 7f8ffda32640 1 librados: setting wanted keys 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.165+0000 7f8ffda32640 1 librados: calling monclient init 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.165+0000 7f8ffda32640 10 monclient: init 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:57:05.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ff8074920 0x7f8ff813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient(hunting): picked mon.noname-b con 0x7f8ff8074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ff80c92f0 0x7f8ff8140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient(hunting): picked mon.noname-c con 0x7f8ff80c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ff815d220 0x7f8ff8141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient(hunting): picked mon.noname-a con 0x7f8ff815d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff8074d70 con 0x7f8ff815d220 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff80c86c0 con 0x7f8ff8074920 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff8153d60 con 0x7f8ff80c92f0 2026-02-17T11:57:05.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ffda32640 10 monclient(hunting): authenticate will time out at 1094.887208s 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff6ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ff8074920 0x7f8ff813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ff815d220 0x7f8ff8141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ff815d220 0x7f8ff8141460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:47118/0 (socket says 10.20.193.10:47118) 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 1 -- 10.20.193.10:0/342190990 learned_addr learned my addr 10.20.193.10:0/342190990 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 10 monclient(hunting): get_auth_request con 0x7f8ff815d220 auth_method 0 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff67fc640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ff80c92f0 0x7f8ff8140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff6ffd640 10 monclient(hunting): get_auth_request con 0x7f8ff8074920 auth_method 0 2026-02-17T11:57:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff67fc640 10 monclient(hunting): get_auth_request con 0x7f8ff80c92f0 auth_method 0 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.166+0000 7f8ff6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:05.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.167+0000 7f8ff67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.167+0000 7f8ff67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.167+0000 7f8ff67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 10 monclient(hunting): handle_auth_done global_id 4656 payload 824 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 1 -- 10.20.193.10:0/342190990 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ff80c92f0 msgr2=0x7f8ff8140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ff80c92f0 0x7f8ff8140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 1 -- 10.20.193.10:0/342190990 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ff8074920 msgr2=0x7f8ff813ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ff8074920 0x7f8ff813ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 1 monclient: found mon.noname-a 2026-02-17T11:57:05.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:05.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:05.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.168+0000 7f8ff77fe640 1 -- 10.20.193.10:0/342190990 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff80cbf00 con 0x7f8ff815d220 2026-02-17T11:57:05.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.169+0000 7f8ff77fe640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ff815d220 0x7f8ff8141460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800cbe0 tx=0x7f8fe800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:05.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.169+0000 7f8fcffff640 10 client.?.objecter ms_handle_connect 0x7f8ff815d220 2026-02-17T11:57:05.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.169+0000 7f8fcffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:05.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 1 -- 10.20.193.10:0/342190990 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8017070 con 0x7f8ff815d220 2026-02-17T11:57:05.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:05.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:05.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 10 monclient: dump: 2026-02-17T11:57:05.183 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:05.183 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 10 monclient: _finish_auth 0 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 1 -- 10.20.193.10:0/342190990 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe800ad70 con 0x7f8ff815d220 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:05.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 1 -- 10.20.193.10:0/342190990 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8012640 con 0x7f8ff815d220 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 5 monclient: authenticate success, global_id 4656 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 10 monclient: _renew_subs 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ff57fa640 4 set_mon_vals no callback set 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff80cc1e0 con 0x7f8ff815d220 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8fcffff640 10 monclient: dump: 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:05.185 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 10 client.4656.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 10 monclient: _renew_subs 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff80cc7a0 con 0x7f8ff815d220 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 1 librados: init done 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:05.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.171+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff815d600 con 0x7f8ff815d220 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.183+0000 7f8fcffff640 1 -- 10.20.193.10:0/342190990 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f8fe801b3b0 con 0x7f8ff815d220 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.184+0000 7f8fcffff640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fc8078e50 0x7f8fc807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.184+0000 7f8ff6ffd640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fc8078e50 0x7f8fc807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.184+0000 7f8ff6ffd640 10 monclient: get_auth_request con 0x7f8fc8078e50 auth_method 0 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.184+0000 7f8ff6ffd640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fc8078e50 0x7f8fc807b310 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8fec002410 tx=0x7f8fec007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.184+0000 7f8fcffff640 10 client.4656.objecter ms_handle_connect 0x7f8fc8078e50 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.186+0000 7f8fcffff640 1 -- 10.20.193.10:0/342190990 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f8fe805dcd0 con 0x7f8ff815d220 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.186+0000 7f8fcffff640 10 client.4656.objecter ms_dispatch2 0x7f8ff8000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.186+0000 7f8fcffff640 3 client.4656.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.186+0000 7f8fcffff640 3 client.4656.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:05.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.186+0000 7f8fcffff640 20 client.4656.objecter dump_active .. 0 homeless 2026-02-17T11:57:05.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.287+0000 7f8fcffff640 1 -- 10.20.193.10:0/342190990 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8fe8021020 con 0x7f8ff815d220 2026-02-17T11:57:05.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.287+0000 7f8fcffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:05.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.287+0000 7f8fcffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:05.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.387+0000 7f8ffda32640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:05.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.387+0000 7f8ffda32640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:05.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.387+0000 7f8ffda32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:05.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.387+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8ff81573e0 con 0x7f8ff815d220 2026-02-17T11:57:05.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.390+0000 7f8fcffff640 1 -- 10.20.193.10:0/342190990 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f8fe8061c90 con 0x7f8ff815d220 2026-02-17T11:57:05.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.390+0000 7f8fcffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:05.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.390+0000 7f8fcffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:05.391 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:05.392 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:05.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 10 librados: watch_flush enter 2026-02-17T11:57:05.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 10 librados: watch_flush exit 2026-02-17T11:57:05.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 20 client.4656.objecter shutdown clearing up homeless session... 2026-02-17T11:57:05.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 10 client.4656.objecter successfully canceled tick 2026-02-17T11:57:05.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fc8078e50 msgr2=0x7f8fc807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:05.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fc8078e50 0x7f8fc807b310 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8fec002410 tx=0x7f8fec007ef0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 10 monclient: shutdown 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ff815d220 msgr2=0x7f8ff8141460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ff815d220 0x7f8ff8141460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800cbe0 tx=0x7f8fe800a430 comp rx=0 tx=0).stop 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 shutdown_connections 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fc8078e50 0x7f8fc807b310 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ff815d220 0x7f8ff8141460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ff80c92f0 0x7f8ff8140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 --2- 10.20.193.10:0/342190990 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ff8074920 0x7f8ff813ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 >> 10.20.193.10:0/342190990 conn(0x7f8ff80c9d80 msgr2=0x7f8ff814db60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:05.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 shutdown_connections 2026-02-17T11:57:05.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 -- 10.20.193.10:0/342190990 wait complete. 2026-02-17T11:57:05.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:05.391+0000 7f8ffda32640 1 librados: shutdown 2026-02-17T11:57:08.401 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:08.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.466+0000 7ff69b7de640 10 monclient: get_monmap_and_config 2026-02-17T11:57:08.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.466+0000 7ff69b7de640 10 monclient: build_initial_monmap 2026-02-17T11:57:08.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.466+0000 7ff69b7de640 10 monclient: monmap: 2026-02-17T11:57:08.468 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:08.467724+0000 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:08.467724+0000 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:08.469 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:08.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.466+0000 7ff69b7de640 1 Processor -- start 2026-02-17T11:57:08.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 1 -- start start 2026-02-17T11:57:08.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 10 monclient: init 2026-02-17T11:57:08.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:08.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 10 monclient: _add_conns ranks=[3,0,2,5,1,4] 2026-02-17T11:57:08.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff69415d220 0x7ff69415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:08.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 10 monclient(hunting): picked mon.noname-a con 0x7ff69415d220 addr v2:10.20.193.10:3300/0 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff694074920 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff6940c92f0 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6940c58a0 con 0x7ff694074920 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6940c55c0 con 0x7ff6940c92f0 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7ff6940c7e20 con 0x7ff69415d220 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.467+0000 7ff69b7de640 10 monclient(hunting): authenticate will time out at 1098.189700s 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.468+0000 7ff699553640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff69415d220 0x7ff69415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.468+0000 7ff699d54640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7ff6940c92f0 0x7ff694153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:39616/0 (socket says 10.20.193.10:39616) 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.468+0000 7ff699d54640 1 -- 10.20.193.10:0/202310455 learned_addr learned my addr 10.20.193.10:0/202310455 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.468+0000 7ff699553640 10 monclient(hunting): get_auth_request con 0x7ff69415d220 auth_method 0 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.468+0000 7ff699553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.468+0000 7ff699553640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:08.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.468+0000 7ff699553640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.469+0000 7ff699553640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.469+0000 7ff699553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.469+0000 7ff699553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.469+0000 7ff683fff640 1 -- 10.20.193.10:0/202310455 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1714441138 0 0) 0x7ff6940c55c0 con 0x7ff6940c92f0 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.469+0000 7ff683fff640 10 monclient(hunting): _negotiate 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.469+0000 7ff683fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.469+0000 7ff683fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.469+0000 7ff683fff640 10 monclient(hunting): my global_id is 4721 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.469+0000 7ff683fff640 1 -- 10.20.193.10:0/202310455 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff67c003620 con 0x7ff6940c92f0 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.470+0000 7ff699553640 10 monclient(hunting): handle_auth_done global_id 4659 payload 274 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.470+0000 7ff699553640 1 -- 10.20.193.10:0/202310455 >> v1:10.20.193.153:6789/0 conn(0x7ff6940c92f0 legacy=0x7ff694153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.470+0000 7ff699553640 1 -- 10.20.193.10:0/202310455 >> v1:10.20.193.10:6789/0 conn(0x7ff694074920 legacy=0x7ff6940c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.470+0000 7ff699553640 10 monclient: _finish_hunting 0 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.470+0000 7ff699553640 1 monclient: found mon.noname-a 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.470+0000 7ff699553640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.470+0000 7ff699553640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:08.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.470+0000 7ff699553640 1 -- 10.20.193.10:0/202310455 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6940c8100 con 0x7ff69415d220 2026-02-17T11:57:08.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.472+0000 7ff699553640 1 --2- 10.20.193.10:0/202310455 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff69415d220 0x7ff69415d600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6840098d0 tx=0x7ff68402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911c1260cf87536e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:08.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 1 -- 10.20.193.10:0/202310455 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68403c070 con 0x7ff69415d220 2026-02-17T11:57:08.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:08.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:08.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 10 monclient: dump: 2026-02-17T11:57:08.477 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:08.477 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:08.477 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:08.477 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:08.477 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 10 monclient: _finish_auth 0 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 1 -- 10.20.193.10:0/202310455 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68402fba0 con 0x7ff69415d220 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 5 monclient: authenticate success, global_id 4659 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 1 -- 10.20.193.10:0/202310455 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684037440 con 0x7ff69415d220 2026-02-17T11:57:08.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 4 set_mon_vals no callback set 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff683fff640 10 monclient: dump: 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 10 monclient: shutdown 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:08.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 1 -- 10.20.193.10:0/202310455 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff69415d220 msgr2=0x7ff69415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 1 --2- 10.20.193.10:0/202310455 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff69415d220 0x7ff69415d600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6840098d0 tx=0x7ff68402eed0 comp rx=0 tx=0).stop 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 1 -- 10.20.193.10:0/202310455 shutdown_connections 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 1 --2- 10.20.193.10:0/202310455 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff69415d220 0x7ff69415d600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.474+0000 7ff69b7de640 1 -- 10.20.193.10:0/202310455 >> 10.20.193.10:0/202310455 conn(0x7ff6940c9d80 msgr2=0x7ff6940ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 1 -- 10.20.193.10:0/202310455 shutdown_connections 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 1 -- 10.20.193.10:0/202310455 wait complete. 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 10 monclient: build_initial_monmap 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 10 monclient: monmap: 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:08.480 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:08.481 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:08.481 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:08.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 1 librados: starting msgr at 2026-02-17T11:57:08.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 1 librados: starting objecter 2026-02-17T11:57:08.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 1 Processor -- start 2026-02-17T11:57:08.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 1 -- start start 2026-02-17T11:57:08.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 1 librados: setting wanted keys 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 1 librados: calling monclient init 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.475+0000 7ff69b7de640 10 monclient: init 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff694074920 0x7ff6941f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient(hunting): picked mon.noname-b con 0x7ff694074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff6940c92f0 0x7ff6941f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient(hunting): picked mon.noname-a con 0x7ff6940c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff69415d220 0x7ff6940ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient(hunting): picked mon.noname-c con 0x7ff69415d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff694074d70 con 0x7ff6940c92f0 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff6940c86c0 con 0x7ff694074920 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:08.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff694153d60 con 0x7ff69415d220 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff69b7de640 10 monclient(hunting): authenticate will time out at 1098.198345s 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff698d52640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff6940c92f0 0x7ff6941f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff699d54640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff69415d220 0x7ff6940ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff698d52640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff6940c92f0 0x7ff6941f3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:47140/0 (socket says 10.20.193.10:47140) 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff698d52640 1 -- 10.20.193.10:0/143543 learned_addr learned my addr 10.20.193.10:0/143543 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff698d52640 10 monclient(hunting): get_auth_request con 0x7ff6940c92f0 auth_method 0 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff698d52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff698d52640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff698d52640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff699553640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff694074920 0x7ff6941f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff699d54640 10 monclient(hunting): get_auth_request con 0x7ff69415d220 auth_method 0 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff699d54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff699d54640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.476+0000 7ff699d54640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699553640 10 monclient(hunting): get_auth_request con 0x7ff694074920 auth_method 0 2026-02-17T11:57:08.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699553640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699553640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff698d52640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff698d52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff698d52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699d54640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699d54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699d54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699553640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.477+0000 7ff699553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 10 monclient(hunting): handle_auth_done global_id 4665 payload 824 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 1 -- 10.20.193.10:0/143543 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff69415d220 msgr2=0x7ff6940ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff69415d220 0x7ff6940ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 1 -- 10.20.193.10:0/143543 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff694074920 msgr2=0x7ff6941f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff694074920 0x7ff6941f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:08.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 10 monclient: _finish_hunting 0 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 1 monclient: found mon.noname-a 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.478+0000 7ff698d52640 1 -- 10.20.193.10:0/143543 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6941438e0 con 0x7ff6940c92f0 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.479+0000 7ff698d52640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff6940c92f0 0x7ff6941f3cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c730 tx=0x7ff68800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.479+0000 7ff681ffb640 10 client.?.objecter ms_handle_connect 0x7ff6940c92f0 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.479+0000 7ff681ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 1 -- 10.20.193.10:0/143543 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6880052d0 con 0x7ff6940c92f0 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 10 monclient: dump: 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:08.488 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 1 -- 10.20.193.10:0/143543 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff688005470 con 0x7ff6940c92f0 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 5 monclient: authenticate success, global_id 4665 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 10 monclient: _renew_subs 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6941f75b0 con 0x7ff6940c92f0 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 1 -- 10.20.193.10:0/143543 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6880038d0 con 0x7ff6940c92f0 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff6837fe640 4 set_mon_vals no callback set 2026-02-17T11:57:08.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff681ffb640 10 monclient: dump: 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 10 client.4665.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 10 monclient: _renew_subs 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6941f6d10 con 0x7ff6940c92f0 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 1 librados: init done 2026-02-17T11:57:08.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:08.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:08.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:08.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.481+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69415d600 con 0x7ff6940c92f0 2026-02-17T11:57:08.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.493+0000 7ff681ffb640 1 -- 10.20.193.10:0/143543 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7ff688003a70 con 0x7ff6940c92f0 2026-02-17T11:57:08.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.493+0000 7ff681ffb640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff664078e00 0x7ff66407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:08.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.494+0000 7ff699553640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff664078e00 0x7ff66407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:08.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.494+0000 7ff699553640 10 monclient: get_auth_request con 0x7ff664078e00 auth_method 0 2026-02-17T11:57:08.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.494+0000 7ff681ffb640 10 client.4665.objecter ms_handle_connect 0x7ff664078e00 2026-02-17T11:57:08.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.494+0000 7ff699553640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff664078e00 0x7ff66407b2c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff684039000 tx=0x7ff684033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:08.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.496+0000 7ff681ffb640 1 -- 10.20.193.10:0/143543 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff68805e0a0 con 0x7ff6940c92f0 2026-02-17T11:57:08.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.496+0000 7ff681ffb640 10 client.4665.objecter ms_dispatch2 0x7ff694000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:08.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.496+0000 7ff681ffb640 3 client.4665.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:08.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.496+0000 7ff681ffb640 3 client.4665.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:08.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.496+0000 7ff681ffb640 20 client.4665.objecter dump_active .. 0 homeless 2026-02-17T11:57:08.598 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.596+0000 7ff681ffb640 1 -- 10.20.193.10:0/143543 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff688062060 con 0x7ff6940c92f0 2026-02-17T11:57:08.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.596+0000 7ff681ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:08.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.596+0000 7ff681ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:08.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.700+0000 7ff69b7de640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:08.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.700+0000 7ff69b7de640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:08.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.700+0000 7ff69b7de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:08.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.700+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff6941f3940 con 0x7ff6940c92f0 2026-02-17T11:57:08.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.702+0000 7ff681ffb640 1 -- 10.20.193.10:0/143543 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7ff688066360 con 0x7ff6940c92f0 2026-02-17T11:57:08.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.702+0000 7ff681ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:08.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.702+0000 7ff681ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:08.705 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:08.705 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:08.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 10 librados: watch_flush enter 2026-02-17T11:57:08.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 10 librados: watch_flush exit 2026-02-17T11:57:08.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 20 client.4665.objecter shutdown clearing up homeless session... 2026-02-17T11:57:08.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 10 client.4665.objecter successfully canceled tick 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff664078e00 msgr2=0x7ff66407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff664078e00 0x7ff66407b2c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff684039000 tx=0x7ff684033000 comp rx=0 tx=0).stop 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 10 monclient: shutdown 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff6940c92f0 msgr2=0x7ff6941f3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff6940c92f0 0x7ff6941f3cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c730 tx=0x7ff68800cc00 comp rx=0 tx=0).stop 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 shutdown_connections 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff664078e00 0x7ff66407b2c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff69415d220 0x7ff6940ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff6940c92f0 0x7ff6941f3cb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 --2- 10.20.193.10:0/143543 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff694074920 0x7ff6941f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:08.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 >> 10.20.193.10:0/143543 conn(0x7ff6940c9d80 msgr2=0x7ff69414eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:08.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 shutdown_connections 2026-02-17T11:57:08.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 -- 10.20.193.10:0/143543 wait complete. 2026-02-17T11:57:08.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:08.703+0000 7ff69b7de640 1 librados: shutdown 2026-02-17T11:57:11.714 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:11.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.780+0000 7fcaee93e640 10 monclient: get_monmap_and_config 2026-02-17T11:57:11.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.780+0000 7fcaee93e640 10 monclient: build_initial_monmap 2026-02-17T11:57:11.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.780+0000 7fcaee93e640 10 monclient: monmap: 2026-02-17T11:57:11.783 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:11.783 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:11.783 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:11.782157+0000 2026-02-17T11:57:11.783 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:11.782157+0000 2026-02-17T11:57:11.784 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:11.784 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:11.784 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:11.784 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:11.784 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:11.784 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:11.784 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:11.784 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:11.785 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:11.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.781+0000 7fcaee93e640 1 Processor -- start 2026-02-17T11:57:11.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.781+0000 7fcaee93e640 1 -- start start 2026-02-17T11:57:11.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.781+0000 7fcaee93e640 10 monclient: init 2026-02-17T11:57:11.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:11.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient: _add_conns ranks=[3,5,4,1,2,0] 2026-02-17T11:57:11.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fcae81502f0 0x7fcae8074770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:11.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient(hunting): picked mon.noname-a con 0x7fcae81502f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcae81506d0 0x7fcae80c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient(hunting): picked mon.noname-c con 0x7fcae81506d0 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fcae80c8eb0 0x7fcae815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient(hunting): picked mon.noname-b con 0x7fcae80c8eb0 addr v2:10.20.193.71:3300/0 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fcae80c5380 con 0x7fcae81502f0 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcae80c5660 con 0x7fcae80c8eb0 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcae80c7e90 con 0x7fcae81506d0 2026-02-17T11:57:11.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaee93e640 10 monclient(hunting): authenticate will time out at 1101.504274s 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaeceb4640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fcae80c8eb0 0x7fcae815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcae77fe640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcae81506d0 0x7fcae80c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaeceb4640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fcae80c8eb0 0x7fcae815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:48526/0 (socket says 10.20.193.10:48526) 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaeceb4640 1 -- 10.20.193.10:0/2454260937 learned_addr learned my addr 10.20.193.10:0/2454260937 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaeceb4640 10 monclient(hunting): get_auth_request con 0x7fcae80c8eb0 auth_method 0 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaeceb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaeceb4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.782+0000 7fcaeceb4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcae77fe640 10 monclient(hunting): get_auth_request con 0x7fcae81506d0 auth_method 0 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcae77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:11.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcae77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcae77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcaeceb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcaeceb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcaeceb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcae77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcae77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.783+0000 7fcae77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 10 monclient(hunting): handle_auth_done global_id 4690 payload 274 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 1 -- 10.20.193.10:0/2454260937 >> v2:10.20.193.153:3300/0 conn(0x7fcae81506d0 msgr2=0x7fcae80c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 1 --2- 10.20.193.10:0/2454260937 >> v2:10.20.193.153:3300/0 conn(0x7fcae81506d0 0x7fcae80c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 1 -- 10.20.193.10:0/2454260937 >> v2:10.20.193.10:3300/0 conn(0x7fcae81502f0 msgr2=0x7fcae8074770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 1 --2- 10.20.193.10:0/2454260937 >> v2:10.20.193.10:3300/0 conn(0x7fcae81502f0 0x7fcae8074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:11.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 10 monclient: _finish_hunting 0 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 1 monclient: found mon.noname-b 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.784+0000 7fcaeceb4640 1 -- 10.20.193.10:0/2454260937 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae80c8170 con 0x7fcae80c8eb0 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.785+0000 7fcaeceb4640 1 --2- 10.20.193.10:0/2454260937 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 0x7fcae815d040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcae80c9d20 tx=0x7fcadc02f260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31f945fd0117d36 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.786+0000 7fcae6ffd640 1 -- 10.20.193.10:0/2454260937 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc02fd10 con 0x7fcae80c8eb0 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.786+0000 7fcae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.786+0000 7fcae6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.786+0000 7fcae6ffd640 10 monclient: dump: 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:11.798 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.786+0000 7fcae6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.786+0000 7fcae6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.786+0000 7fcae6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.786+0000 7fcaee93e640 5 monclient: authenticate success, global_id 4690 2026-02-17T11:57:11.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.786+0000 7fcaee93e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcae6ffd640 1 -- 10.20.193.10:0/2454260937 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcadc0373f0 con 0x7fcae80c8eb0 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcae6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcae6ffd640 1 -- 10.20.193.10:0/2454260937 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc0377c0 con 0x7fcae80c8eb0 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcae6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcae6ffd640 10 monclient: dump: 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:11.800 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 4 set_mon_vals no callback set 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 10 monclient: shutdown 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 1 -- 10.20.193.10:0/2454260937 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 msgr2=0x7fcae815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 1 --2- 10.20.193.10:0/2454260937 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 0x7fcae815d040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcae80c9d20 tx=0x7fcadc02f260 comp rx=0 tx=0).stop 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 1 -- 10.20.193.10:0/2454260937 shutdown_connections 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 1 --2- 10.20.193.10:0/2454260937 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 0x7fcae815d040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:11.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 1 --2- 10.20.193.10:0/2454260937 >> v2:10.20.193.153:3300/0 conn(0x7fcae81506d0 0x7fcae80c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 1 --2- 10.20.193.10:0/2454260937 >> v2:10.20.193.10:3300/0 conn(0x7fcae81502f0 0x7fcae8074770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 1 -- 10.20.193.10:0/2454260937 >> 10.20.193.10:0/2454260937 conn(0x7fcae80c9d80 msgr2=0x7fcae80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 1 -- 10.20.193.10:0/2454260937 shutdown_connections 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.787+0000 7fcaee93e640 1 -- 10.20.193.10:0/2454260937 wait complete. 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient: build_initial_monmap 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient: monmap: 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:11.802 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 librados: starting msgr at 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 librados: starting objecter 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 Processor -- start 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 -- start start 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 librados: setting wanted keys 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 librados: calling monclient init 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient: init 2026-02-17T11:57:11.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 0x7fcae814ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient(hunting): picked mon.noname-b con 0x7fcae80c8eb0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcae81502f0 0x7fcae8149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient(hunting): picked mon.noname-a con 0x7fcae81502f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcae81506d0 0x7fcae815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient(hunting): picked mon.noname-c con 0x7fcae81506d0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fcae8074cb0 con 0x7fcae81502f0 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcae80c92d0 con 0x7fcae80c8eb0 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:11.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcae8074e30 con 0x7fcae81506d0 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.788+0000 7fcaee93e640 10 monclient(hunting): authenticate will time out at 1101.510940s 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae77fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcae81502f0 0x7fcae8149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 0x7fcae814ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 0x7fcae814ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:48538/0 (socket says 10.20.193.10:48538) 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 1 -- 10.20.193.10:0/3715654092 learned_addr learned my addr 10.20.193.10:0/3715654092 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 10 monclient(hunting): get_auth_request con 0x7fcae80c8eb0 auth_method 0 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae77fe640 10 monclient(hunting): get_auth_request con 0x7fcae81502f0 auth_method 0 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:11.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcae77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.789+0000 7fcaeceb4640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcae81506d0 0x7fcae815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcaeceb4640 10 monclient(hunting): get_auth_request con 0x7fcae81506d0 auth_method 0 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcaeceb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcaeceb4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:11.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcaeceb4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcaeceb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcaeceb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcaeceb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 10 monclient(hunting): handle_auth_done global_id 4693 payload 824 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 1 -- 10.20.193.10:0/3715654092 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcae81506d0 msgr2=0x7fcae815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcae81506d0 0x7fcae815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 1 -- 10.20.193.10:0/3715654092 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcae81502f0 msgr2=0x7fcae8149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcae81502f0 0x7fcae8149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 1 monclient: found mon.noname-b 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:11.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:57:11.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.790+0000 7fcae7fff640 1 -- 10.20.193.10:0/3715654092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae806ed00 con 0x7fcae80c8eb0 2026-02-17T11:57:11.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.792+0000 7fcae7fff640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 0x7fcae814ab30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcad400b500 tx=0x7fcad400b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:11.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.792+0000 7fcae4ff9640 10 client.?.objecter ms_handle_connect 0x7fcae80c8eb0 2026-02-17T11:57:11.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.792+0000 7fcae4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:11.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 1 -- 10.20.193.10:0/3715654092 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4004480 con 0x7fcae80c8eb0 2026-02-17T11:57:11.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 10 monclient: dump: 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:11.811 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 1 -- 10.20.193.10:0/3715654092 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad4014070 con 0x7fcae80c8eb0 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 1 -- 10.20.193.10:0/3715654092 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4002920 con 0x7fcae80c8eb0 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae4ff9640 10 monclient: dump: 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:11.812 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcae67fc640 4 set_mon_vals no callback set 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 5 monclient: authenticate success, global_id 4693 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 10 monclient: _renew_subs 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:11.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae806dea0 con 0x7fcae80c8eb0 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 10 client.4693.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 10 monclient: _renew_subs 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae806e460 con 0x7fcae80c8eb0 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 1 librados: init done 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.794+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae8074750 con 0x7fcae80c8eb0 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.806+0000 7fcae4ff9640 1 -- 10.20.193.10:0/3715654092 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fcad4002ac0 con 0x7fcae80c8eb0 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.806+0000 7fcae4ff9640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcab8078e30 0x7fcab807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:11.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.806+0000 7fcae77fe640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcab8078e30 0x7fcab807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:11.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.806+0000 7fcae77fe640 10 monclient: get_auth_request con 0x7fcab8078e30 auth_method 0 2026-02-17T11:57:11.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.806+0000 7fcae4ff9640 10 client.4693.objecter ms_handle_connect 0x7fcab8078e30 2026-02-17T11:57:11.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.806+0000 7fcae77fe640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcab8078e30 0x7fcab807b2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcae8143640 tx=0x7fcad8009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:11.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.808+0000 7fcae4ff9640 1 -- 10.20.193.10:0/3715654092 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fcad405dd40 con 0x7fcae80c8eb0 2026-02-17T11:57:11.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.808+0000 7fcae4ff9640 10 client.4693.objecter ms_dispatch2 0x7fcae8000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:11.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.808+0000 7fcae4ff9640 3 client.4693.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:11.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.808+0000 7fcae4ff9640 3 client.4693.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:11.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.808+0000 7fcae4ff9640 20 client.4693.objecter dump_active .. 0 homeless 2026-02-17T11:57:11.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.911+0000 7fcae4ff9640 1 -- 10.20.193.10:0/3715654092 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcad4061d00 con 0x7fcae80c8eb0 2026-02-17T11:57:11.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.911+0000 7fcae4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:11.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:11.911+0000 7fcae4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:12.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.010+0000 7fcaee93e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:12.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.010+0000 7fcaee93e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:12.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.010+0000 7fcaee93e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:12.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.010+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcae80ca340 con 0x7fcae80c8eb0 2026-02-17T11:57:12.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.013+0000 7fcae4ff9640 1 -- 10.20.193.10:0/3715654092 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fcad4066000 con 0x7fcae80c8eb0 2026-02-17T11:57:12.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.013+0000 7fcae4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:12.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.013+0000 7fcae4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:12.015 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:12.016 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:12.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 10 librados: watch_flush enter 2026-02-17T11:57:12.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 10 librados: watch_flush exit 2026-02-17T11:57:12.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 20 client.4693.objecter shutdown clearing up homeless session... 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 10 client.4693.objecter successfully canceled tick 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcab8078e30 msgr2=0x7fcab807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcab8078e30 0x7fcab807b2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcae8143640 tx=0x7fcad8009290 comp rx=0 tx=0).stop 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 10 monclient: shutdown 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 msgr2=0x7fcae814ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 0x7fcae814ab30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcad400b500 tx=0x7fcad400b9d0 comp rx=0 tx=0).stop 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 shutdown_connections 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcab8078e30 0x7fcab807b2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcae81506d0 0x7fcae815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcae81502f0 0x7fcae8149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:12.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 --2- 10.20.193.10:0/3715654092 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcae80c8eb0 0x7fcae814ab30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:12.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 >> 10.20.193.10:0/3715654092 conn(0x7fcae80c9d80 msgr2=0x7fcae814e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:12.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 shutdown_connections 2026-02-17T11:57:12.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 -- 10.20.193.10:0/3715654092 wait complete. 2026-02-17T11:57:12.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:12.014+0000 7fcaee93e640 1 librados: shutdown 2026-02-17T11:57:14.946 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:03:32.114 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:14.948 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:03:32.117 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:14.958 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:03:32.126 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:14.974 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:03:32.103 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:14.976 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:03:32.139 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:14.978 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:03:32.107 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:14.980 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:03:32.144 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:14.988 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:03:32.116 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:14.990 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:03:32.153 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:15.026 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.092+0000 7f4cc1761640 10 monclient: get_monmap_and_config 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.092+0000 7f4cc1761640 10 monclient: build_initial_monmap 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.092+0000 7f4cc1761640 10 monclient: monmap: 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:15.093382+0000 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:15.093382+0000 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:15.094 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:15.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.092+0000 7f4cc1761640 1 Processor -- start 2026-02-17T11:57:15.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.092+0000 7f4cc1761640 1 -- start start 2026-02-17T11:57:15.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.092+0000 7f4cc1761640 10 monclient: init 2026-02-17T11:57:15.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:15.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 10 monclient: _add_conns ranks=[1,5,2,4,3,0] 2026-02-17T11:57:15.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f4cbc0c3e80 addr v1:10.20.193.71:6789/0 2026-02-17T11:57:15.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f4cbc15f920 0x7f4cbc06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 10 monclient(hunting): picked mon.noname-c con 0x7f4cbc15f920 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4cbc0c92e0 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc0c9710 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc0c7c80 con 0x7f4cbc0c92e0 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4cbc0c8e50 con 0x7f4cbc15f920 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cc1761640 10 monclient(hunting): authenticate will time out at 1104.815244s 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cbaffd640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f4cbc0c3e80 0x7f4cbc15f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:50800/0 (socket says 10.20.193.10:50800) 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.093+0000 7f4cbaffd640 1 -- 10.20.193.10:0/2487126865 learned_addr learned my addr 10.20.193.10:0/2487126865 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.094+0000 7f4cba7fc640 1 --2- 10.20.193.10:0/2487126865 >> v2:10.20.193.153:3300/0 conn(0x7f4cbc15f920 0x7f4cbc06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.095+0000 7f4cba7fc640 10 monclient(hunting): get_auth_request con 0x7f4cbc15f920 auth_method 0 2026-02-17T11:57:15.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.095+0000 7f4cba7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.095+0000 7f4cba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.095+0000 7f4cba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.096+0000 7f4cba7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.096+0000 7f4cba7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.096+0000 7f4cba7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.096+0000 7f4cb9ffb640 1 -- 10.20.193.10:0/2487126865 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161097894 0 0) 0x7f4cbc0c9710 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.096+0000 7f4cb9ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:57:15.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.096+0000 7f4cb9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.096+0000 7f4cb9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.096+0000 7f4cb9ffb640 10 monclient(hunting): my global_id is 4696 2026-02-17T11:57:15.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.096+0000 7f4cb9ffb640 1 -- 10.20.193.10:0/2487126865 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ca8003620 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.098+0000 7f4cba7fc640 10 monclient(hunting): handle_auth_done global_id 4733 payload 274 2026-02-17T11:57:15.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.098+0000 7f4cba7fc640 1 -- 10.20.193.10:0/2487126865 >> v1:10.20.193.153:6789/0 conn(0x7f4cbc0c92e0 legacy=0x7f4cbc0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.098+0000 7f4cba7fc640 1 -- 10.20.193.10:0/2487126865 >> v1:10.20.193.71:6789/0 conn(0x7f4cbc0c3e80 legacy=0x7f4cbc15f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.098+0000 7f4cba7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:57:15.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.098+0000 7f4cba7fc640 1 monclient: found mon.noname-c 2026-02-17T11:57:15.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.098+0000 7f4cba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:15.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.098+0000 7f4cba7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:15.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.098+0000 7f4cba7fc640 1 -- 10.20.193.10:0/2487126865 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc0c7f60 con 0x7f4cbc15f920 2026-02-17T11:57:15.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.101+0000 7f4cba7fc640 1 --2- 10.20.193.10:0/2487126865 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc15f920 0x7f4cbc06d1b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40098a0 tx=0x7f4ca402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c3cfbdb5e827e91 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 1 -- 10.20.193.10:0/2487126865 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca403c070 con 0x7f4cbc15f920 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 10 monclient: dump: 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:15.105 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 1 -- 10.20.193.10:0/2487126865 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca402fb70 con 0x7f4cbc15f920 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 5 monclient: authenticate success, global_id 4733 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 1 -- 10.20.193.10:0/2487126865 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4037440 con 0x7f4cbc15f920 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 4 set_mon_vals no callback set 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cb9ffb640 10 monclient: dump: 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.106 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 10 monclient: shutdown 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 1 -- 10.20.193.10:0/2487126865 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc15f920 msgr2=0x7f4cbc06d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 1 --2- 10.20.193.10:0/2487126865 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc15f920 0x7f4cbc06d1b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40098a0 tx=0x7f4ca402ee60 comp rx=0 tx=0).stop 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 1 -- 10.20.193.10:0/2487126865 shutdown_connections 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 1 --2- 10.20.193.10:0/2487126865 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc15f920 0x7f4cbc06d1b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 1 -- 10.20.193.10:0/2487126865 >> 10.20.193.10:0/2487126865 conn(0x7f4cbc0c9d80 msgr2=0x7f4cbc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 1 -- 10.20.193.10:0/2487126865 shutdown_connections 2026-02-17T11:57:15.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.103+0000 7f4cc1761640 1 -- 10.20.193.10:0/2487126865 wait complete. 2026-02-17T11:57:15.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient: build_initial_monmap 2026-02-17T11:57:15.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient: monmap: 2026-02-17T11:57:15.109 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:15.109 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 librados: starting msgr at 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 librados: starting objecter 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 Processor -- start 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 -- start start 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 librados: setting wanted keys 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 librados: calling monclient init 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient: init 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc0c3e80 0x7f4cbc14b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient(hunting): picked mon.noname-c con 0x7f4cbc0c3e80 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4cbc0c92e0 0x7f4cbc148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient(hunting): picked mon.noname-a con 0x7f4cbc0c92e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:15.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4cbc15f920 0x7f4cbc149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient(hunting): picked mon.noname-b con 0x7f4cbc15f920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0c8800 con 0x7f4cbc0c92e0 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0c8520 con 0x7f4cbc15f920 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0c8ae0 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.104+0000 7f4cc1761640 10 monclient(hunting): authenticate will time out at 1104.826705s 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc0c3e80 0x7f4cbc14b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cba7fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4cbc0c92e0 0x7f4cbc148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbb7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4cbc15f920 0x7f4cbc149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc0c3e80 0x7f4cbc14b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:56760/0 (socket says 10.20.193.10:56760) 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 1 -- 10.20.193.10:0/3986995316 learned_addr learned my addr 10.20.193.10:0/3986995316 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 10 monclient(hunting): get_auth_request con 0x7f4cbc0c3e80 auth_method 0 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cba7fc640 10 monclient(hunting): get_auth_request con 0x7f4cbc0c92e0 auth_method 0 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cba7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbb7fe640 10 monclient(hunting): get_auth_request con 0x7f4cbc15f920 auth_method 0 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cba7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cba7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cba7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.105+0000 7f4cbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 10 monclient(hunting): handle_auth_done global_id 4739 payload 824 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 1 -- 10.20.193.10:0/3986995316 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4cbc15f920 msgr2=0x7f4cbc149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4cbc15f920 0x7f4cbc149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 1 -- 10.20.193.10:0/3986995316 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4cbc0c92e0 msgr2=0x7f4cbc148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4cbc0c92e0 0x7f4cbc148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 1 monclient: found mon.noname-c 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.106+0000 7f4cbaffd640 1 -- 10.20.193.10:0/3986995316 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc14b7d0 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.107+0000 7f4cbaffd640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc0c3e80 0x7f4cbc14b290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000c500 tx=0x7f4cb000c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.107+0000 7f4c9b7fe640 10 client.?.objecter ms_handle_connect 0x7f4cbc0c3e80 2026-02-17T11:57:15.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.107+0000 7f4c9b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4c9b7fe640 1 -- 10.20.193.10:0/3986995316 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0017070 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4c9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4c9b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4c9b7fe640 10 monclient: dump: 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4c9b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4c9b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4c9b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4cc1761640 5 monclient: authenticate success, global_id 4739 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4cc1761640 10 monclient: _renew_subs 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4cc1761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:15.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc1f7370 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4cc1761640 10 client.4739.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4cc1761640 10 monclient: _renew_subs 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4cc1761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc1f3350 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.108+0000 7f4cc1761640 1 librados: init done 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4c9b7fe640 1 -- 10.20.193.10:0/3986995316 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb0005de0 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4c9b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4c9b7fe640 1 -- 10.20.193.10:0/3986995316 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0021060 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4c9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4c9b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4c9b7fe640 10 monclient: dump: 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4cb97fa640 4 set_mon_vals no callback set 2026-02-17T11:57:15.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4cc1761640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4cc1761640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4cc1761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:15.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.109+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc070d90 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.218+0000 7f4c9b7fe640 1 -- 10.20.193.10:0/3986995316 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f4cb0024080 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.218+0000 7f4c9b7fe640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4c88078e00 0x7f4c8807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:15.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.218+0000 7f4cba7fc640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4c88078e00 0x7f4c8807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:15.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.218+0000 7f4cba7fc640 10 monclient: get_auth_request con 0x7f4c88078e00 auth_method 0 2026-02-17T11:57:15.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.219+0000 7f4c9b7fe640 10 client.4739.objecter ms_handle_connect 0x7f4c88078e00 2026-02-17T11:57:15.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.219+0000 7f4cba7fc640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4c88078e00 0x7f4c8807b2c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4039000 tx=0x7f4ca4033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:15.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.220+0000 7f4c9b7fe640 1 -- 10.20.193.10:0/3986995316 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f4cb005d4a0 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.220+0000 7f4c9b7fe640 10 client.4739.objecter ms_dispatch2 0x7f4cbc000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:15.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.220+0000 7f4c9b7fe640 3 client.4739.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:15.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.220+0000 7f4c9b7fe640 3 client.4739.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:15.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.221+0000 7f4c9b7fe640 20 client.4739.objecter dump_active .. 0 homeless 2026-02-17T11:57:15.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.227+0000 7f4c9b7fe640 1 -- 10.20.193.10:0/3986995316 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4cb0061460 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.227+0000 7f4c9b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:15.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.227+0000 7f4c9b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:15.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.325+0000 7f4cc1761640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:15.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.325+0000 7f4cc1761640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:15.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.325+0000 7f4cc1761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:15.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.325+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4cbc06d120 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4c9b7fe640 1 -- 10.20.193.10:0/3986995316 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f4cb0065760 con 0x7f4cbc0c3e80 2026-02-17T11:57:15.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4c9b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:15.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4c9b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:15.330 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:15.330 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:15.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 10 librados: watch_flush enter 2026-02-17T11:57:15.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 10 librados: watch_flush exit 2026-02-17T11:57:15.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 20 client.4739.objecter shutdown clearing up homeless session... 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 10 client.4739.objecter successfully canceled tick 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4c88078e00 msgr2=0x7f4c8807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4c88078e00 0x7f4c8807b2c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4039000 tx=0x7f4ca4033000 comp rx=0 tx=0).stop 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 10 monclient: shutdown 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc0c3e80 msgr2=0x7f4cbc14b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc0c3e80 0x7f4cbc14b290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000c500 tx=0x7f4cb000c9d0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 shutdown_connections 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4c88078e00 0x7f4c8807b2c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4cbc15f920 0x7f4cbc149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4cbc0c92e0 0x7f4cbc148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 --2- 10.20.193.10:0/3986995316 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4cbc0c3e80 0x7f4cbc14b290 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 >> 10.20.193.10:0/3986995316 conn(0x7f4cbc0c9d80 msgr2=0x7f4cbc06d640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 shutdown_connections 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 -- 10.20.193.10:0/3986995316 wait complete. 2026-02-17T11:57:15.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:15.329+0000 7f4cc1761640 1 librados: shutdown 2026-02-17T11:57:18.340 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:18.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.405+0000 7ff513cb0640 10 monclient: get_monmap_and_config 2026-02-17T11:57:18.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.405+0000 7ff513cb0640 10 monclient: build_initial_monmap 2026-02-17T11:57:18.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.405+0000 7ff513cb0640 10 monclient: monmap: 2026-02-17T11:57:18.413 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:18.413 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:18.413 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:18.407179+0000 2026-02-17T11:57:18.413 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:18.407179+0000 2026-02-17T11:57:18.413 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:18.414 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:18.414 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:18.414 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:18.414 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:18.414 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:18.414 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:18.414 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:18.415 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:18.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 1 Processor -- start 2026-02-17T11:57:18.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 1 -- start start 2026-02-17T11:57:18.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient: init 2026-02-17T11:57:18.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:18.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient: _add_conns ranks=[2,5,3,0,4,1] 2026-02-17T11:57:18.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff50c15d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:18.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff50c0c92f0 0x7ff50c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:18.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient(hunting): picked mon.noname-c con 0x7ff50c0c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:18.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff50c074920 0x7ff50c153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:18.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient(hunting): picked mon.noname-a con 0x7ff50c074920 addr v2:10.20.193.10:3300/0 2026-02-17T11:57:18.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c0c58a0 con 0x7ff50c15d220 2026-02-17T11:57:18.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:18.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7ff50c0c55c0 con 0x7ff50c074920 2026-02-17T11:57:18.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:18.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff50c0c7e20 con 0x7ff50c0c92f0 2026-02-17T11:57:18.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:18.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.406+0000 7ff513cb0640 10 monclient(hunting): authenticate will time out at 1108.128902s 2026-02-17T11:57:18.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff50c074920 0x7ff50c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:18.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff511224640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff50c0c92f0 0x7ff50c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:18.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff50c074920 0x7ff50c153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:50706/0 (socket says 10.20.193.10:50706) 2026-02-17T11:57:18.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 1 -- 10.20.193.10:0/3973838032 learned_addr learned my addr 10.20.193.10:0/3973838032 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:18.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 10 monclient(hunting): get_auth_request con 0x7ff50c074920 auth_method 0 2026-02-17T11:57:18.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:18.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:18.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:18.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:18.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:18.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff512226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:18.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff511224640 10 monclient(hunting): get_auth_request con 0x7ff50c0c92f0 auth_method 0 2026-02-17T11:57:18.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff511224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:18.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff511224640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:18.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.407+0000 7ff511224640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:18.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff511224640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:18.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff511224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:18.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff511224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:18.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff512226640 10 monclient(hunting): handle_auth_done global_id 4674 payload 274 2026-02-17T11:57:18.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff512226640 1 -- 10.20.193.10:0/3973838032 >> v2:10.20.193.153:3300/0 conn(0x7ff50c0c92f0 msgr2=0x7ff50c15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:18.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff512226640 1 --2- 10.20.193.10:0/3973838032 >> v2:10.20.193.153:3300/0 conn(0x7ff50c0c92f0 0x7ff50c15d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff512226640 1 -- 10.20.193.10:0/3973838032 >> v1:10.20.193.153:6789/0 conn(0x7ff50c15d220 legacy=0x7ff50c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:18.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff512226640 10 monclient: _finish_hunting 0 2026-02-17T11:57:18.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff512226640 1 monclient: found mon.noname-a 2026-02-17T11:57:18.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff512226640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:18.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff512226640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:18.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.408+0000 7ff512226640 1 -- 10.20.193.10:0/3973838032 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c0c8100 con 0x7ff50c074920 2026-02-17T11:57:18.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.409+0000 7ff512226640 1 --2- 10.20.193.10:0/3973838032 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c074920 0x7ff50c153650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff508009e50 tx=0x7ff50802f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37165c845df78a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:18.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 1 -- 10.20.193.10:0/3973838032 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50802fd60 con 0x7ff50c074920 2026-02-17T11:57:18.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 10 monclient: dump: 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:18.434 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 10 monclient: _finish_auth 0 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 10 monclient: _check_auth_tickets 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 1 -- 10.20.193.10:0/3973838032 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5080373f0 con 0x7ff50c074920 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff513cb0640 5 monclient: authenticate success, global_id 4674 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff513cb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 1 -- 10.20.193.10:0/3973838032 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5080377c0 con 0x7ff50c074920 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff513cb0640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff513cb0640 4 set_mon_vals no callback set 2026-02-17T11:57:18.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.411+0000 7ff510a23640 10 monclient: dump: 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:18.436 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 10 monclient: shutdown 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 1 -- 10.20.193.10:0/3973838032 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c074920 msgr2=0x7ff50c153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 1 --2- 10.20.193.10:0/3973838032 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c074920 0x7ff50c153650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff508009e50 tx=0x7ff50802f2a0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 1 -- 10.20.193.10:0/3973838032 shutdown_connections 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 1 --2- 10.20.193.10:0/3973838032 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c074920 0x7ff50c153650 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 1 --2- 10.20.193.10:0/3973838032 >> v2:10.20.193.153:3300/0 conn(0x7ff50c0c92f0 0x7ff50c15d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 1 -- 10.20.193.10:0/3973838032 >> 10.20.193.10:0/3973838032 conn(0x7ff50c0c9d80 msgr2=0x7ff50c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 1 -- 10.20.193.10:0/3973838032 shutdown_connections 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 1 -- 10.20.193.10:0/3973838032 wait complete. 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 10 monclient: build_initial_monmap 2026-02-17T11:57:18.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.412+0000 7ff513cb0640 10 monclient: monmap: 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 librados: starting msgr at 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 librados: starting objecter 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 Processor -- start 2026-02-17T11:57:18.438 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 -- start start 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 librados: setting wanted keys 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 librados: calling monclient init 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient: init 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff50c074920 0x7ff50c0cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient(hunting): picked mon.noname-c con 0x7ff50c074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff50c0c92f0 0x7ff50c0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient(hunting): picked mon.noname-b con 0x7ff50c0c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c15d220 0x7ff50c1f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient(hunting): picked mon.noname-a con 0x7ff50c15d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c074d70 con 0x7ff50c15d220 2026-02-17T11:57:18.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c0c86c0 con 0x7ff50c0c92f0 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c153b90 con 0x7ff50c074920 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff513cb0640 10 monclient(hunting): authenticate will time out at 1108.135562s 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff512226640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c15d220 0x7ff50c1f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff511a25640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff50c074920 0x7ff50c0cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff512226640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c15d220 0x7ff50c1f4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:50712/0 (socket says 10.20.193.10:50712) 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff512226640 1 -- 10.20.193.10:0/3226982126 learned_addr learned my addr 10.20.193.10:0/3226982126 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff512226640 10 monclient(hunting): get_auth_request con 0x7ff50c15d220 auth_method 0 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff512226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff512226640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:18.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.413+0000 7ff512226640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511a25640 10 monclient(hunting): get_auth_request con 0x7ff50c074920 auth_method 0 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511a25640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511a25640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511224640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff50c0c92f0 0x7ff50c0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff512226640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff512226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff512226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511224640 10 monclient(hunting): get_auth_request con 0x7ff50c0c92f0 auth_method 0 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511224640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511224640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:18.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511a25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511224640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.414+0000 7ff511224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 10 monclient(hunting): handle_auth_done global_id 4745 payload 824 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 1 -- 10.20.193.10:0/3226982126 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff50c0c92f0 msgr2=0x7ff50c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff50c0c92f0 0x7ff50c0ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 1 -- 10.20.193.10:0/3226982126 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c15d220 msgr2=0x7ff50c1f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c15d220 0x7ff50c1f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 10 monclient: _finish_hunting 0 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 1 monclient: found mon.noname-c 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.415+0000 7ff511a25640 1 -- 10.20.193.10:0/3226982126 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c1f7270 con 0x7ff50c074920 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.416+0000 7ff511a25640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff50c074920 0x7ff50c0cc860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c480 tx=0x7ff4fc00c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.416+0000 7ff4fa7fc640 10 client.?.objecter ms_handle_connect 0x7ff50c074920 2026-02-17T11:57:18.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.416+0000 7ff4fa7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff4fa7fc640 1 -- 10.20.193.10:0/3226982126 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc017070 con 0x7ff50c074920 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff4fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff4fa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff4fa7fc640 10 monclient: dump: 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff4fa7fc640 10 monclient: _finish_auth 0 2026-02-17T11:57:18.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff4fa7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff4fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff513cb0640 5 monclient: authenticate success, global_id 4745 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff513cb0640 10 monclient: _renew_subs 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff513cb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c1f7530 con 0x7ff50c074920 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff513cb0640 10 client.4745.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff513cb0640 10 monclient: _renew_subs 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff513cb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c1f7af0 con 0x7ff50c074920 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.417+0000 7ff513cb0640 1 librados: init done 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff513cb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff513cb0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff513cb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c153f20 con 0x7ff50c074920 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff4fa7fc640 1 -- 10.20.193.10:0/3226982126 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0052d0 con 0x7ff50c074920 2026-02-17T11:57:18.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff4fa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff4fa7fc640 1 -- 10.20.193.10:0/3226982126 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0036f0 con 0x7ff50c074920 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff4fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff4fa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff4fa7fc640 10 monclient: dump: 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.418+0000 7ff4fbfff640 4 set_mon_vals no callback set 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.430+0000 7ff4fa7fc640 1 -- 10.20.193.10:0/3226982126 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7ff4fc003890 con 0x7ff50c074920 2026-02-17T11:57:18.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.430+0000 7ff4fa7fc640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff4dc078e30 0x7ff4dc07b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:18.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.430+0000 7ff511224640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff4dc078e30 0x7ff4dc07b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:18.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.430+0000 7ff511224640 10 monclient: get_auth_request con 0x7ff4dc078e30 auth_method 0 2026-02-17T11:57:18.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.431+0000 7ff4fa7fc640 10 client.4745.objecter ms_handle_connect 0x7ff4dc078e30 2026-02-17T11:57:18.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.431+0000 7ff511224640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff4dc078e30 0x7ff4dc07b2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0c5f40 tx=0x7ff500009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:18.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.531+0000 7ff4fa7fc640 1 -- 10.20.193.10:0/3226982126 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff4fc05d150 con 0x7ff50c074920 2026-02-17T11:57:18.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.531+0000 7ff4fa7fc640 10 client.4745.objecter ms_dispatch2 0x7ff50c000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:18.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.531+0000 7ff4fa7fc640 3 client.4745.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:18.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.531+0000 7ff4fa7fc640 3 client.4745.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:18.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.531+0000 7ff4fa7fc640 20 client.4745.objecter dump_active .. 0 homeless 2026-02-17T11:57:18.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.538+0000 7ff4fa7fc640 1 -- 10.20.193.10:0/3226982126 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff4fc022080 con 0x7ff50c074920 2026-02-17T11:57:18.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.538+0000 7ff4fa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:18.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.538+0000 7ff4fa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:18.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.635+0000 7ff513cb0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:18.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.635+0000 7ff513cb0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:18.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.635+0000 7ff513cb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:18.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.635+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff50c0ca1f0 con 0x7ff50c074920 2026-02-17T11:57:18.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff4fa7fc640 1 -- 10.20.193.10:0/3226982126 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7ff4fc061110 con 0x7ff50c074920 2026-02-17T11:57:18.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff4fa7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:18.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff4fa7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:18.639 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:18.639 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:18.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 10 librados: watch_flush enter 2026-02-17T11:57:18.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 10 librados: watch_flush exit 2026-02-17T11:57:18.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 20 client.4745.objecter shutdown clearing up homeless session... 2026-02-17T11:57:18.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 10 client.4745.objecter successfully canceled tick 2026-02-17T11:57:18.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff4dc078e30 msgr2=0x7ff4dc07b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff4dc078e30 0x7ff4dc07b2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0c5f40 tx=0x7ff500009290 comp rx=0 tx=0).stop 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 10 monclient: shutdown 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff50c074920 msgr2=0x7ff50c0cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff50c074920 0x7ff50c0cc860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c480 tx=0x7ff4fc00c950 comp rx=0 tx=0).stop 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 shutdown_connections 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff4dc078e30 0x7ff4dc07b2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff50c15d220 0x7ff50c1f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff50c0c92f0 0x7ff50c0ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 --2- 10.20.193.10:0/3226982126 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff50c074920 0x7ff50c0cc860 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 >> 10.20.193.10:0/3226982126 conn(0x7ff50c0c9d80 msgr2=0x7ff50c149380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 shutdown_connections 2026-02-17T11:57:18.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 -- 10.20.193.10:0/3226982126 wait complete. 2026-02-17T11:57:18.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:18.638+0000 7ff513cb0640 1 librados: shutdown 2026-02-17T11:57:21.649 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:21.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.719+0000 7fbafa696640 10 monclient: get_monmap_and_config 2026-02-17T11:57:21.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.719+0000 7fbafa696640 10 monclient: build_initial_monmap 2026-02-17T11:57:21.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.719+0000 7fbafa696640 10 monclient: monmap: 2026-02-17T11:57:21.723 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:21.723 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:21.723 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:21.720456+0000 2026-02-17T11:57:21.723 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:21.720456+0000 2026-02-17T11:57:21.723 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:21.723 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:21.723 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.719+0000 7fbafa696640 1 Processor -- start 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.719+0000 7fbafa696640 1 -- start start 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.719+0000 7fbafa696640 10 monclient: init 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 10 monclient: _add_conns ranks=[2,1,0,3,5,4] 2026-02-17T11:57:21.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbaf415d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:21.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbaf40c92f0 addr v1:10.20.193.71:6789/0 2026-02-17T11:57:21.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbaf4153d60 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:21.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf40c58a0 con 0x7fbaf4153d60 2026-02-17T11:57:21.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf40c55c0 con 0x7fbaf40c92f0 2026-02-17T11:57:21.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf40c7e20 con 0x7fbaf415d220 2026-02-17T11:57:21.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:21.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbafa696640 10 monclient(hunting): authenticate will time out at 1111.442173s 2026-02-17T11:57:21.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbaf37fe640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fbaf40c92f0 0x7fbaf4153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:50816/0 (socket says 10.20.193.10:50816) 2026-02-17T11:57:21.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.720+0000 7fbaf37fe640 1 -- 10.20.193.10:0/1677407277 learned_addr learned my addr 10.20.193.10:0/1677407277 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:21.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870688052 0 0) 0x7fbaf40c55c0 con 0x7fbaf40c92f0 2026-02-17T11:57:21.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:57:21.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:21.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:21.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 10 monclient(hunting): my global_id is 4705 2026-02-17T11:57:21.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad8003620 con 0x7fbaf40c92f0 2026-02-17T11:57:21.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659475762 0 0) 0x7fbaf40c7e20 con 0x7fbaf415d220 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 10 monclient(hunting): my global_id is 4748 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.722+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf40c55c0 con 0x7fbaf415d220 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.723+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582905186 0 0) 0x7fbaf40c58a0 con 0x7fbaf4153d60 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.723+0000 7fbaf2ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.723+0000 7fbaf2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.723+0000 7fbaf2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:21.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.723+0000 7fbaf2ffd640 10 monclient(hunting): my global_id is 4680 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.723+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf40c7e20 con 0x7fbaf4153d60 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf3fff640 1 -- 10.20.193.10:0/1677407277 >> v1:10.20.193.153:6789/0 conn(0x7fbaf415d220 legacy=0x7fbaf40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf3fff640 1 -- 10.20.193.10:0/1677407277 >> v1:10.20.193.153:6789/0 conn(0x7fbaf415d220 legacy=0x7fbaf40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf3fff640 1 --1- 10.20.193.10:0/1677407277 >> v1:10.20.193.153:6789/0 conn(0x7fbaf415d220 0x7fbaf40c8be0 :-1 s=OPENED pgs=160 cs=1 l=1).handle_message read tag failed 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf3fff640 1 --1- 10.20.193.10:0/1677407277 >> v1:10.20.193.153:6789/0 conn(0x7fbaf415d220 0x7fbaf40c8be0 :-1 s=OPENED pgs=160 cs=1 l=1).fault on lossy channel, failing 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.153:6789/0 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2211952122 0 0) 0x7fbad8003620 con 0x7fbaf40c92f0 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 >> v1:10.20.193.153:6789/0 conn(0x7fbaf415d220 legacy=0x7fbaf40c8be0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 >> v1:10.20.193.10:6789/0 conn(0x7fbaf4153d60 legacy=0x7fbaf40c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:57:21.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf40c8100 con 0x7fbaf40c92f0 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fbae4002f00 con 0x7fbaf40c92f0 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient: dump: 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:21.734 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 >> v1:10.20.193.71:6789/0 conn(0x7fbaf40c92f0 legacy=0x7fbaf4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:21.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8003f60 0x7fbad8004340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient(hunting): picked mon.b con 0x7fbad8003f60 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbad8004a10 0x7fbad8004e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient(hunting): picked mon.a con 0x7fbad8004a10 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbad8009ab0 0x7fbad800bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient(hunting): picked mon.c con 0x7fbad8009ab0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fbad800c4c0 con 0x7fbad8004a10 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbad800c670 con 0x7fbad8003f60 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:21.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbad800c870 con 0x7fbad8009ab0 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.724+0000 7fbaf2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.725+0000 7fbaf8c0c640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbad8009ab0 0x7fbad800bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.725+0000 7fbaf8c0c640 10 monclient(hunting): get_auth_request con 0x7fbad8009ab0 auth_method 0 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.725+0000 7fbaf8c0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.725+0000 7fbaf8c0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.725+0000 7fbaf8c0c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.725+0000 7fbaf37fe640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbad8004a10 0x7fbad8004e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf8c0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf8c0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:21.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf8c0c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf37fe640 10 monclient(hunting): get_auth_request con 0x7fbad8004a10 auth_method 0 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf3fff640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8003f60 0x7fbad8004340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf37fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf3fff640 10 monclient(hunting): get_auth_request con 0x7fbad8003f60 auth_method 0 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:21.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.726+0000 7fbaf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 10 monclient(hunting): handle_auth_done global_id 4705 payload 293 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 1 -- 10.20.193.10:0/1677407277 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8003f60 msgr2=0x7fbad8004340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8003f60 0x7fbad8004340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 1 -- 10.20.193.10:0/1677407277 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbad8004a10 msgr2=0x7fbad8004e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbad8004a10 0x7fbad8004e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 10 monclient: _finish_hunting 0 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 1 monclient: found mon.c 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:21.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:21.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 1 -- 10.20.193.10:0/1677407277 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad8003620 con 0x7fbad8009ab0 2026-02-17T11:57:21.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 10 monclient: _finish_auth 0 2026-02-17T11:57:21.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 10 monclient: _check_auth_tickets 2026-02-17T11:57:21.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:21.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbafa696640 5 monclient: authenticate success, global_id 4705 2026-02-17T11:57:21.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbafa696640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:21.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.727+0000 7fbaf8c0c640 1 -- 10.20.193.10:0/1677407277 reap_dead start 2026-02-17T11:57:21.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.728+0000 7fbaf8c0c640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbad8009ab0 0x7fbad800bea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbae800c2f0 tx=0x7fbae802f5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=601136ac13f57c81 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:21.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8003860 con 0x7fbad8009ab0 2026-02-17T11:57:21.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:21.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:21.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 10 monclient: dump: 2026-02-17T11:57:21.747 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:21.747 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbafa696640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae8003c70 con 0x7fbad8009ab0 2026-02-17T11:57:21.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 1 -- 10.20.193.10:0/1677407277 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8005310 con 0x7fbad8009ab0 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbafa696640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbafa696640 4 set_mon_vals no callback set 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.729+0000 7fbaf2ffd640 10 monclient: dump: 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.749 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 10 monclient: shutdown 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 -- 10.20.193.10:0/1677407277 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbad8009ab0 msgr2=0x7fbad800bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbad8009ab0 0x7fbad800bea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbae800c2f0 tx=0x7fbae802f5e0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 -- 10.20.193.10:0/1677407277 shutdown_connections 2026-02-17T11:57:21.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 --2- 10.20.193.10:0/1677407277 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbad8009ab0 0x7fbad800bea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 -- 10.20.193.10:0/1677407277 >> 10.20.193.10:0/1677407277 conn(0x7fbaf40c9d80 msgr2=0x7fbaf40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 -- 10.20.193.10:0/1677407277 shutdown_connections 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 -- 10.20.193.10:0/1677407277 wait complete. 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 10 monclient: build_initial_monmap 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 10 monclient: monmap: 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:21.751 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 librados: starting msgr at 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 librados: starting objecter 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 Processor -- start 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 -- start start 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 librados: setting wanted keys 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 1 librados: calling monclient init 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.730+0000 7fbafa696640 10 monclient: init 2026-02-17T11:57:21.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8009ab0 0x7fbaf41f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient(hunting): picked mon.noname-b con 0x7fbad8009ab0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbaf415c470 0x7fbaf40728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient(hunting): picked mon.noname-c con 0x7fbaf415c470 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbaf41456d0 0x7fbaf4073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient(hunting): picked mon.noname-a con 0x7fbaf41456d0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf415d600 con 0x7fbaf41456d0 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:21.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf40c86c0 con 0x7fbad8009ab0 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf415d780 con 0x7fbaf415c470 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbafa696640 10 monclient(hunting): authenticate will time out at 1111.453224s 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf8c0c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbaf41456d0 0x7fbaf4073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8009ab0 0x7fbaf41f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf37fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbaf415c470 0x7fbaf40728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8009ab0 0x7fbaf41f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:52958/0 (socket says 10.20.193.10:52958) 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 1 -- 10.20.193.10:0/3079116016 learned_addr learned my addr 10.20.193.10:0/3079116016 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:21.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 10 monclient(hunting): get_auth_request con 0x7fbad8009ab0 auth_method 0 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf8c0c640 10 monclient(hunting): get_auth_request con 0x7fbaf41456d0 auth_method 0 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf8c0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf8c0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf8c0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf37fe640 10 monclient(hunting): get_auth_request con 0x7fbaf415c470 auth_method 0 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:21.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf8c0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf8c0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.731+0000 7fbaf8c0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.732+0000 7fbaf37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.732+0000 7fbaf37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.732+0000 7fbaf37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 10 monclient(hunting): handle_auth_done global_id 4683 payload 824 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 1 -- 10.20.193.10:0/3079116016 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbaf415c470 msgr2=0x7fbaf40728f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbaf415c470 0x7fbaf40728f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 1 -- 10.20.193.10:0/3079116016 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8009ab0 msgr2=0x7fbaf41f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8009ab0 0x7fbaf41f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 10 monclient: _finish_hunting 0 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 1 monclient: found mon.noname-a 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.733+0000 7fbaf8c0c640 1 -- 10.20.193.10:0/3079116016 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf4072e30 con 0x7fbaf41456d0 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.734+0000 7fbaf8c0c640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbaf41456d0 0x7fbaf4073c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4070dc0 tx=0x7fbae8002e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.734+0000 7fbaf0ff9640 10 client.?.objecter ms_handle_connect 0x7fbaf41456d0 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.734+0000 7fbaf0ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 1 -- 10.20.193.10:0/3079116016 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8003860 con 0x7fbaf41456d0 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 10 monclient: dump: 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:21.757 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 10 monclient: _finish_auth 0 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 1 -- 10.20.193.10:0/3079116016 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae8003e20 con 0x7fbaf41456d0 2026-02-17T11:57:21.758 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbafa696640 5 monclient: authenticate success, global_id 4683 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 1 -- 10.20.193.10:0/3079116016 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8003a70 con 0x7fbaf41456d0 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf0ff9640 10 monclient: dump: 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:21.759 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbaf27fc640 4 set_mon_vals no callback set 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbafa696640 10 monclient: _renew_subs 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbafa696640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.735+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf415b0f0 con 0x7fbaf41456d0 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.736+0000 7fbafa696640 10 client.4683.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.736+0000 7fbafa696640 10 monclient: _renew_subs 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.736+0000 7fbafa696640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.736+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf415b6b0 con 0x7fbaf41456d0 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.736+0000 7fbafa696640 1 librados: init done 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.736+0000 7fbafa696640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.736+0000 7fbafa696640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.736+0000 7fbafa696640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:21.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.736+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf4069900 con 0x7fbaf41456d0 2026-02-17T11:57:21.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.748+0000 7fbaf0ff9640 1 -- 10.20.193.10:0/3079116016 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fbae802fce0 con 0x7fbaf41456d0 2026-02-17T11:57:21.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.748+0000 7fbaf0ff9640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbac4078e80 0x7fbac407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:21.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.748+0000 7fbaf3fff640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbac4078e80 0x7fbac407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:21.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.748+0000 7fbaf3fff640 10 monclient: get_auth_request con 0x7fbac4078e80 auth_method 0 2026-02-17T11:57:21.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.748+0000 7fbaf3fff640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbac4078e80 0x7fbac407b340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbae0002800 tx=0x7fbae0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:21.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.748+0000 7fbaf0ff9640 10 client.4683.objecter ms_handle_connect 0x7fbac4078e80 2026-02-17T11:57:21.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.749+0000 7fbaf0ff9640 1 -- 10.20.193.10:0/3079116016 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fbae8003c10 con 0x7fbaf41456d0 2026-02-17T11:57:21.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.749+0000 7fbaf0ff9640 10 client.4683.objecter ms_dispatch2 0x7fbaf4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:21.762 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.749+0000 7fbaf0ff9640 3 client.4683.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:21.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.749+0000 7fbaf0ff9640 3 client.4683.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:21.763 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.749+0000 7fbaf0ff9640 20 client.4683.objecter dump_active .. 0 homeless 2026-02-17T11:57:21.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.847+0000 7fbaf0ff9640 1 -- 10.20.193.10:0/3079116016 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbaf4069900 con 0x7fbaf41456d0 2026-02-17T11:57:21.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.847+0000 7fbaf0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:21.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.847+0000 7fbaf0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:21.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.944+0000 7fbafa696640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:21.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.944+0000 7fbafa696640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:21.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.944+0000 7fbafa696640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:21.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.944+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbaf4074920 con 0x7fbaf41456d0 2026-02-17T11:57:21.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.947+0000 7fbaf0ff9640 1 -- 10.20.193.10:0/3079116016 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fbae8086d30 con 0x7fbaf41456d0 2026-02-17T11:57:21.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.947+0000 7fbaf0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:21.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.947+0000 7fbaf0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:21.949 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:21.949 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 10 librados: watch_flush enter 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 10 librados: watch_flush exit 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 20 client.4683.objecter shutdown clearing up homeless session... 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 10 client.4683.objecter successfully canceled tick 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbac4078e80 msgr2=0x7fbac407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbac4078e80 0x7fbac407b340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbae0002800 tx=0x7fbae0009040 comp rx=0 tx=0).stop 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 10 monclient: shutdown 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbaf41456d0 msgr2=0x7fbaf4073c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbaf41456d0 0x7fbaf4073c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4070dc0 tx=0x7fbae8002e00 comp rx=0 tx=0).stop 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 shutdown_connections 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbac4078e80 0x7fbac407b340 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbaf41456d0 0x7fbaf4073c90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbaf415c470 0x7fbaf40728f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 --2- 10.20.193.10:0/3079116016 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbad8009ab0 0x7fbaf41f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:21.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 >> 10.20.193.10:0/3079116016 conn(0x7fbaf40c9d80 msgr2=0x7fbaf414e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:21.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 shutdown_connections 2026-02-17T11:57:21.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 -- 10.20.193.10:0/3079116016 wait complete. 2026-02-17T11:57:21.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:21.948+0000 7fbafa696640 1 librados: shutdown 2026-02-17T11:57:24.960 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:25.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.026+0000 7f13eb50a640 10 monclient: get_monmap_and_config 2026-02-17T11:57:25.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.026+0000 7f13eb50a640 10 monclient: build_initial_monmap 2026-02-17T11:57:25.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.026+0000 7f13eb50a640 10 monclient: monmap: 2026-02-17T11:57:25.028 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:25.028 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:25.028 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:25.027963+0000 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:25.027963+0000 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.027+0000 7f13eb50a640 1 Processor -- start 2026-02-17T11:57:25.029 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.027+0000 7f13eb50a640 1 -- start start 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.027+0000 7f13eb50a640 10 monclient: init 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.027+0000 7f13eb50a640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.027+0000 7f13eb50a640 10 monclient: _add_conns ranks=[3,5,2,1,0,4] 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.027+0000 7f13eb50a640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f13e41502f0 0x7f13e4074770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 10 monclient(hunting): picked mon.noname-a con 0x7f13e41502f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f13e41506d0 0x7f13e40c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 10 monclient(hunting): picked mon.noname-c con 0x7f13e41506d0 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f13e40c8eb0 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e40c5380 con 0x7f13e40c8eb0 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f13e40c5660 con 0x7f13e41502f0 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f13e40c7e90 con 0x7f13e41506d0 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13eb50a640 10 monclient(hunting): authenticate will time out at 1114.750107s 2026-02-17T11:57:25.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e927f640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f13e41502f0 0x7f13e4074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e8a7e640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f13e41506d0 0x7f13e40c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e927f640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f13e41502f0 0x7f13e4074770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:55312/0 (socket says 10.20.193.10:55312) 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e927f640 1 -- 10.20.193.10:0/344345795 learned_addr learned my addr 10.20.193.10:0/344345795 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e927f640 10 monclient(hunting): get_auth_request con 0x7f13e41502f0 auth_method 0 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e927f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e927f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e927f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e8a7e640 10 monclient(hunting): get_auth_request con 0x7f13e41506d0 auth_method 0 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e8a7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e8a7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e8a7e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e927f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.028+0000 7f13e927f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.029+0000 7f13e927f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.029+0000 7f13e8a7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.029+0000 7f13e8a7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:25.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.029+0000 7f13e8a7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.030+0000 7f13e927f640 10 monclient(hunting): handle_auth_done global_id 4686 payload 274 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.030+0000 7f13e927f640 1 -- 10.20.193.10:0/344345795 >> v2:10.20.193.153:3300/0 conn(0x7f13e41506d0 msgr2=0x7f13e40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.030+0000 7f13e927f640 1 --2- 10.20.193.10:0/344345795 >> v2:10.20.193.153:3300/0 conn(0x7f13e41506d0 0x7f13e40c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.030+0000 7f13e927f640 1 -- 10.20.193.10:0/344345795 >> v1:10.20.193.153:6789/0 conn(0x7f13e40c8eb0 legacy=0x7f13e415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.030+0000 7f13e927f640 10 monclient: _finish_hunting 0 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.030+0000 7f13e927f640 1 monclient: found mon.noname-a 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.030+0000 7f13e927f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.030+0000 7f13e927f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.030+0000 7f13e927f640 1 -- 10.20.193.10:0/344345795 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e40c8170 con 0x7f13e41502f0 2026-02-17T11:57:25.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.031+0000 7f13e927f640 1 --2- 10.20.193.10:0/344345795 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 0x7f13e4074770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13e40709e0 tx=0x7f13d402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b39752d0592a60e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 1 -- 10.20.193.10:0/344345795 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d403c070 con 0x7f13e41502f0 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 10 monclient: dump: 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 10 monclient: _finish_auth 0 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 1 -- 10.20.193.10:0/344345795 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d402fbe0 con 0x7f13e41502f0 2026-02-17T11:57:25.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 1 -- 10.20.193.10:0/344345795 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4037440 con 0x7f13e41502f0 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13d3fff640 10 monclient: dump: 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 5 monclient: authenticate success, global_id 4686 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 4 set_mon_vals no callback set 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 10 monclient: shutdown 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 1 -- 10.20.193.10:0/344345795 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 msgr2=0x7f13e4074770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 1 --2- 10.20.193.10:0/344345795 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 0x7f13e4074770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13e40709e0 tx=0x7f13d402eed0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 1 -- 10.20.193.10:0/344345795 shutdown_connections 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 1 --2- 10.20.193.10:0/344345795 >> v2:10.20.193.153:3300/0 conn(0x7f13e41506d0 0x7f13e40c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 1 --2- 10.20.193.10:0/344345795 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 0x7f13e4074770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 1 -- 10.20.193.10:0/344345795 >> 10.20.193.10:0/344345795 conn(0x7f13e40c9d80 msgr2=0x7f13e40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 1 -- 10.20.193.10:0/344345795 shutdown_connections 2026-02-17T11:57:25.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 1 -- 10.20.193.10:0/344345795 wait complete. 2026-02-17T11:57:25.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 10 monclient: build_initial_monmap 2026-02-17T11:57:25.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.033+0000 7f13eb50a640 10 monclient: monmap: 2026-02-17T11:57:25.038 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:25.038 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:25.038 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 librados: starting msgr at 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 librados: starting objecter 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 Processor -- start 2026-02-17T11:57:25.039 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 -- start start 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 librados: setting wanted keys 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 librados: calling monclient init 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient: init 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f13e40c8eb0 0x7f13e41f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient(hunting): picked mon.noname-c con 0x7f13e40c8eb0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 0x7f13e40c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient(hunting): picked mon.noname-a con 0x7f13e41502f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13e41506d0 0x7f13e414f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient(hunting): picked mon.noname-b con 0x7f13e41506d0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:25.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4074cb0 con 0x7f13e41502f0 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13e40c92d0 con 0x7f13e41506d0 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4074e30 con 0x7f13e40c8eb0 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13eb50a640 10 monclient(hunting): authenticate will time out at 1114.756756s 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.034+0000 7f13e8a7e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 0x7f13e40c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e8a7e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 0x7f13e40c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:55318/0 (socket says 10.20.193.10:55318) 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e8a7e640 1 -- 10.20.193.10:0/3911483935 learned_addr learned my addr 10.20.193.10:0/3911483935 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e8a7e640 10 monclient(hunting): get_auth_request con 0x7f13e41502f0 auth_method 0 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e8a7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:25.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e8a7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e8a7e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e9a80640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13e41506d0 0x7f13e414f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e927f640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f13e40c8eb0 0x7f13e41f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e9a80640 10 monclient(hunting): get_auth_request con 0x7f13e41506d0 auth_method 0 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e9a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e9a80640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e9a80640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e8a7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e8a7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e8a7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e927f640 10 monclient(hunting): get_auth_request con 0x7f13e40c8eb0 auth_method 0 2026-02-17T11:57:25.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e927f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:25.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e927f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:25.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e927f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:25.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e9a80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:25.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e9a80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:25.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e9a80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:25.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e927f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:25.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e927f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:25.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.035+0000 7f13e927f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:25.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 10 monclient(hunting): handle_auth_done global_id 4689 payload 824 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 1 -- 10.20.193.10:0/3911483935 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f13e40c8eb0 msgr2=0x7f13e41f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f13e40c8eb0 0x7f13e41f7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 1 -- 10.20.193.10:0/3911483935 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13e41506d0 msgr2=0x7f13e414f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13e41506d0 0x7f13e414f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 10 monclient: _finish_hunting 0 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 1 monclient: found mon.noname-a 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.037+0000 7f13e8a7e640 1 -- 10.20.193.10:0/3911483935 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e40c4230 con 0x7f13e41502f0 2026-02-17T11:57:25.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.038+0000 7f13e8a7e640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 0x7f13e40c3cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13d800ebb0 tx=0x7f13d800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.038+0000 7f13d1ffb640 10 client.?.objecter ms_handle_connect 0x7f13e41502f0 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.038+0000 7f13d1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 1 -- 10.20.193.10:0/3911483935 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8017070 con 0x7f13e41502f0 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 10 monclient: dump: 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:25.047 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 1 -- 10.20.193.10:0/3911483935 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d800cc40 con 0x7f13e41502f0 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13eb50a640 5 monclient: authenticate success, global_id 4689 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 1 -- 10.20.193.10:0/3911483935 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8013470 con 0x7f13e41502f0 2026-02-17T11:57:25.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d37fe640 4 set_mon_vals no callback set 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13d1ffb640 10 monclient: dump: 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:25.049 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13eb50a640 10 monclient: _renew_subs 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13eb50a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e41f3bc0 con 0x7f13e41502f0 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13eb50a640 10 client.4689.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13eb50a640 10 monclient: _renew_subs 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13eb50a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e41f4180 con 0x7f13e41502f0 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.039+0000 7f13eb50a640 1 librados: init done 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.040+0000 7f13eb50a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.040+0000 7f13eb50a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.040+0000 7f13eb50a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:25.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.040+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e4074770 con 0x7f13e41502f0 2026-02-17T11:57:25.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.052+0000 7f13d1ffb640 1 -- 10.20.193.10:0/3911483935 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f13d8024060 con 0x7f13e41502f0 2026-02-17T11:57:25.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.052+0000 7f13d1ffb640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13b4078e00 0x7f13b407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:25.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.052+0000 7f13e927f640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13b4078e00 0x7f13b407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:25.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.052+0000 7f13e927f640 10 monclient: get_auth_request con 0x7f13b4078e00 auth_method 0 2026-02-17T11:57:25.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.052+0000 7f13d1ffb640 10 client.4689.objecter ms_handle_connect 0x7f13b4078e00 2026-02-17T11:57:25.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.052+0000 7f13e927f640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13b4078e00 0x7f13b407b2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13e40c9d20 tx=0x7f13d4039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:25.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.054+0000 7f13d1ffb640 1 -- 10.20.193.10:0/3911483935 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f13d805e210 con 0x7f13e41502f0 2026-02-17T11:57:25.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.054+0000 7f13d1ffb640 10 client.4689.objecter ms_dispatch2 0x7f13e4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:25.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.054+0000 7f13d1ffb640 3 client.4689.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:25.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.054+0000 7f13d1ffb640 3 client.4689.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:25.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.054+0000 7f13d1ffb640 20 client.4689.objecter dump_active .. 0 homeless 2026-02-17T11:57:25.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.157+0000 7f13d1ffb640 1 -- 10.20.193.10:0/3911483935 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f13d80621d0 con 0x7f13e41502f0 2026-02-17T11:57:25.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.157+0000 7f13d1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:25.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.157+0000 7f13d1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:25.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.259+0000 7f13eb50a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:25.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.259+0000 7f13eb50a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:25.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.259+0000 7f13eb50a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:25.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.259+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f13e414a500 con 0x7f13e41502f0 2026-02-17T11:57:25.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.262+0000 7f13d1ffb640 1 -- 10.20.193.10:0/3911483935 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f13d80664d0 con 0x7f13e41502f0 2026-02-17T11:57:25.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.262+0000 7f13d1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:25.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.262+0000 7f13d1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:25.264 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:25.264 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 10 librados: watch_flush enter 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 10 librados: watch_flush exit 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 20 client.4689.objecter shutdown clearing up homeless session... 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 10 client.4689.objecter successfully canceled tick 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13b4078e00 msgr2=0x7f13b407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13b4078e00 0x7f13b407b2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13e40c9d20 tx=0x7f13d4039040 comp rx=0 tx=0).stop 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 10 monclient: shutdown 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 msgr2=0x7f13e40c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 0x7f13e40c3cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13d800ebb0 tx=0x7f13d800c520 comp rx=0 tx=0).stop 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 shutdown_connections 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13b4078e00 0x7f13b407b2c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f13e41506d0 0x7f13e414f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f13e41502f0 0x7f13e40c3cf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 --2- 10.20.193.10:0/3911483935 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f13e40c8eb0 0x7f13e41f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:25.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 >> 10.20.193.10:0/3911483935 conn(0x7f13e40c9d80 msgr2=0x7f13e40ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:25.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.263+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 shutdown_connections 2026-02-17T11:57:25.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.264+0000 7f13eb50a640 1 -- 10.20.193.10:0/3911483935 wait complete. 2026-02-17T11:57:25.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:25.264+0000 7f13eb50a640 1 librados: shutdown 2026-02-17T11:57:28.275 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:28.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.339+0000 7fa0ad0a7640 10 monclient: get_monmap_and_config 2026-02-17T11:57:28.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.339+0000 7fa0ad0a7640 10 monclient: build_initial_monmap 2026-02-17T11:57:28.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.339+0000 7fa0ad0a7640 10 monclient: monmap: 2026-02-17T11:57:28.342 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:28.342 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:28.342 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:28.340901+0000 2026-02-17T11:57:28.342 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:28.340901+0000 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 1 Processor -- start 2026-02-17T11:57:28.343 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 1 -- start start 2026-02-17T11:57:28.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 10 monclient: init 2026-02-17T11:57:28.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:28.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 10 monclient: _add_conns ranks=[3,1,0,5,4,2] 2026-02-17T11:57:28.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa0a815d220 0x7fa0a815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:28.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 10 monclient(hunting): picked mon.noname-a con 0x7fa0a815d220 addr v2:10.20.193.10:3300/0 2026-02-17T11:57:28.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa0a8074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:57:28.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa0a80c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a80c58a0 con 0x7fa0a80c92f0 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a80c55c0 con 0x7fa0a8074920 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa0a80c7e20 con 0x7fa0a815d220 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0ad0a7640 10 monclient(hunting): authenticate will time out at 1118.062603s 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.340+0000 7fa0a6d76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa0a815d220 0x7fa0a815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.341+0000 7fa0a6575640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fa0a8074920 0x7fa0a80c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:47722/0 (socket says 10.20.193.10:47722) 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.341+0000 7fa0a6575640 1 -- 10.20.193.10:0/2428168736 learned_addr learned my addr 10.20.193.10:0/2428168736 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.341+0000 7fa0a6d76640 10 monclient(hunting): get_auth_request con 0x7fa0a815d220 auth_method 0 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.341+0000 7fa0a6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:28.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.341+0000 7fa0a6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:28.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.341+0000 7fa0a6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:28.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.341+0000 7fa0a6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:28.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.341+0000 7fa0a6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:28.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.341+0000 7fa0a6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:28.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a5d74640 1 -- 10.20.193.10:0/2428168736 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229769223 0 0) 0x7fa0a80c55c0 con 0x7fa0a8074920 2026-02-17T11:57:28.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a5d74640 10 monclient(hunting): _negotiate 2026-02-17T11:57:28.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a5d74640 10 monclient(hunting): my global_id is 4714 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a5d74640 1 -- 10.20.193.10:0/2428168736 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa094003620 con 0x7fa0a8074920 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a6d76640 10 monclient(hunting): handle_auth_done global_id 4692 payload 274 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a6d76640 1 -- 10.20.193.10:0/2428168736 >> v1:10.20.193.71:6789/0 conn(0x7fa0a8074920 legacy=0x7fa0a80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a6d76640 1 -- 10.20.193.10:0/2428168736 >> v1:10.20.193.10:6789/0 conn(0x7fa0a80c92f0 legacy=0x7fa0a8153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a6d76640 10 monclient: _finish_hunting 0 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a6d76640 1 monclient: found mon.noname-a 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a6d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:28.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.342+0000 7fa0a6d76640 1 -- 10.20.193.10:0/2428168736 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a80c8100 con 0x7fa0a815d220 2026-02-17T11:57:28.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.345+0000 7fa0a6d76640 1 --2- 10.20.193.10:0/2428168736 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a815d220 0x7fa0a815d600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0098d0 tx=0x7fa09c02eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5894160e62192d26 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:28.354 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 1 -- 10.20.193.10:0/2428168736 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c03c070 con 0x7fa0a815d220 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 10 monclient: dump: 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:28.355 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 10 monclient: _finish_auth 0 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 10 monclient: _check_auth_tickets 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 1 -- 10.20.193.10:0/2428168736 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09c02fba0 con 0x7fa0a815d220 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 1 -- 10.20.193.10:0/2428168736 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c037440 con 0x7fa0a815d220 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0a5d74640 10 monclient: dump: 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:28.356 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 5 monclient: authenticate success, global_id 4692 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 4 set_mon_vals no callback set 2026-02-17T11:57:28.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 10 monclient: shutdown 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/2428168736 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a815d220 msgr2=0x7fa0a815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 1 --2- 10.20.193.10:0/2428168736 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a815d220 0x7fa0a815d600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0098d0 tx=0x7fa09c02eed0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/2428168736 shutdown_connections 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 1 --2- 10.20.193.10:0/2428168736 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a815d220 0x7fa0a815d600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/2428168736 >> 10.20.193.10:0/2428168736 conn(0x7fa0a80c9d80 msgr2=0x7fa0a80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/2428168736 shutdown_connections 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/2428168736 wait complete. 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 10 monclient: build_initial_monmap 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.347+0000 7fa0ad0a7640 10 monclient: monmap: 2026-02-17T11:57:28.358 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:28.359 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:28.359 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:28.359 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:28.359 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:28.359 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:28.359 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:28.359 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:28.360 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:28.360 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:28.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 librados: starting msgr at 2026-02-17T11:57:28.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 librados: starting objecter 2026-02-17T11:57:28.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 Processor -- start 2026-02-17T11:57:28.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 -- start start 2026-02-17T11:57:28.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 librados: setting wanted keys 2026-02-17T11:57:28.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 librados: calling monclient init 2026-02-17T11:57:28.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient: init 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a8074920 0x7fa0a80724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient(hunting): picked mon.noname-a con 0x7fa0a8074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa0a80c92f0 0x7fa0a80ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient(hunting): picked mon.noname-c con 0x7fa0a80c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa0a815d220 0x7fa0a806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient(hunting): picked mon.noname-b con 0x7fa0a815d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a8074d70 con 0x7fa0a8074920 2026-02-17T11:57:28.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:28.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a80c86c0 con 0x7fa0a815d220 2026-02-17T11:57:28.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:28.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a8153d60 con 0x7fa0a80c92f0 2026-02-17T11:57:28.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:28.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0ad0a7640 10 monclient(hunting): authenticate will time out at 1118.070635s 2026-02-17T11:57:28.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0a6d76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a8074920 0x7fa0a80724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:28.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.348+0000 7fa0a7577640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa0a815d220 0x7fa0a806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:28.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6d76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a8074920 0x7fa0a80724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:55338/0 (socket says 10.20.193.10:55338) 2026-02-17T11:57:28.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6d76640 1 -- 10.20.193.10:0/3335328487 learned_addr learned my addr 10.20.193.10:0/3335328487 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6d76640 10 monclient(hunting): get_auth_request con 0x7fa0a8074920 auth_method 0 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a7577640 10 monclient(hunting): get_auth_request con 0x7fa0a815d220 auth_method 0 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a7577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a7577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a7577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6575640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa0a80c92f0 0x7fa0a80ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6575640 10 monclient(hunting): get_auth_request con 0x7fa0a80c92f0 auth_method 0 2026-02-17T11:57:28.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a7577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a7577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a7577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:28.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.349+0000 7fa0a6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 10 monclient(hunting): handle_auth_done global_id 4698 payload 824 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 1 -- 10.20.193.10:0/3335328487 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa0a80c92f0 msgr2=0x7fa0a80ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa0a80c92f0 0x7fa0a80ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 1 -- 10.20.193.10:0/3335328487 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa0a815d220 msgr2=0x7fa0a806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa0a815d220 0x7fa0a806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 10 monclient: _finish_hunting 0 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 1 monclient: found mon.noname-a 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:28.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.350+0000 7fa0a6d76640 1 -- 10.20.193.10:0/3335328487 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a8072d70 con 0x7fa0a8074920 2026-02-17T11:57:28.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.351+0000 7fa0a6d76640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a8074920 0x7fa0a80724d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa09c03a040 tx=0x7fa09c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:28.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.351+0000 7fa0877fe640 10 client.?.objecter ms_handle_connect 0x7fa0a8074920 2026-02-17T11:57:28.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.351+0000 7fa0877fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:28.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 1 -- 10.20.193.10:0/3335328487 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c046020 con 0x7fa0a8074920 2026-02-17T11:57:28.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:28.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:28.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 10 monclient: dump: 2026-02-17T11:57:28.368 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:28.368 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:28.368 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:28.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:28.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 1 -- 10.20.193.10:0/3335328487 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09c004230 con 0x7fa0a8074920 2026-02-17T11:57:28.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:28.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 1 -- 10.20.193.10:0/3335328487 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c03c040 con 0x7fa0a8074920 2026-02-17T11:57:28.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:28.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:28.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0877fe640 10 monclient: dump: 2026-02-17T11:57:28.370 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:28.370 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:28.370 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0a5573640 4 set_mon_vals no callback set 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0ad0a7640 5 monclient: authenticate success, global_id 4698 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0ad0a7640 10 monclient: _renew_subs 2026-02-17T11:57:28.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0ad0a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a8073050 con 0x7fa0a8074920 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0ad0a7640 10 client.4698.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0ad0a7640 10 monclient: _renew_subs 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0ad0a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a8073610 con 0x7fa0a8074920 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.353+0000 7fa0ad0a7640 1 librados: init done 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.354+0000 7fa0ad0a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.354+0000 7fa0ad0a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.354+0000 7fa0ad0a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:28.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.354+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a815d600 con 0x7fa0a8074920 2026-02-17T11:57:28.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.460+0000 7fa0877fe640 1 -- 10.20.193.10:0/3335328487 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fa09c053070 con 0x7fa0a8074920 2026-02-17T11:57:28.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.460+0000 7fa0877fe640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa074078e80 0x7fa07407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:28.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.460+0000 7fa0a6575640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa074078e80 0x7fa07407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:28.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.460+0000 7fa0a6575640 10 monclient: get_auth_request con 0x7fa074078e80 auth_method 0 2026-02-17T11:57:28.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.461+0000 7fa0a6575640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa074078e80 0x7fa07407b340 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8146400 tx=0x7fa090007dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:28.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.461+0000 7fa0877fe640 10 client.4698.objecter ms_handle_connect 0x7fa074078e80 2026-02-17T11:57:28.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.469+0000 7fa0877fe640 1 -- 10.20.193.10:0/3335328487 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fa09c02fa60 con 0x7fa0a8074920 2026-02-17T11:57:28.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.469+0000 7fa0877fe640 10 client.4698.objecter ms_dispatch2 0x7fa0a8000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:28.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.469+0000 7fa0877fe640 3 client.4698.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:28.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.469+0000 7fa0877fe640 3 client.4698.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:28.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.469+0000 7fa0877fe640 20 client.4698.objecter dump_active .. 0 homeless 2026-02-17T11:57:28.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.469+0000 7fa0877fe640 1 -- 10.20.193.10:0/3335328487 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa09c050020 con 0x7fa0a8074920 2026-02-17T11:57:28.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.469+0000 7fa0877fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:28.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.469+0000 7fa0877fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:28.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.567+0000 7fa0ad0a7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:28.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.567+0000 7fa0ad0a7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:28.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.567+0000 7fa0ad0a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:28.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.567+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa0a814f1b0 con 0x7fa0a8074920 2026-02-17T11:57:28.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.570+0000 7fa0877fe640 1 -- 10.20.193.10:0/3335328487 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fa09c087070 con 0x7fa0a8074920 2026-02-17T11:57:28.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.570+0000 7fa0877fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:28.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.570+0000 7fa0877fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:28.572 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:28.572 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:28.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 10 librados: watch_flush enter 2026-02-17T11:57:28.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 10 librados: watch_flush exit 2026-02-17T11:57:28.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 20 client.4698.objecter shutdown clearing up homeless session... 2026-02-17T11:57:28.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 10 client.4698.objecter successfully canceled tick 2026-02-17T11:57:28.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa074078e80 msgr2=0x7fa07407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:28.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa074078e80 0x7fa07407b340 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8146400 tx=0x7fa090007dd0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 10 monclient: shutdown 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a8074920 msgr2=0x7fa0a80724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a8074920 0x7fa0a80724d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa09c03a040 tx=0x7fa09c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 shutdown_connections 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa074078e80 0x7fa07407b340 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa0a815d220 0x7fa0a806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa0a80c92f0 0x7fa0a80ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 --2- 10.20.193.10:0/3335328487 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa0a8074920 0x7fa0a80724d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 >> 10.20.193.10:0/3335328487 conn(0x7fa0a80c9d80 msgr2=0x7fa0a80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 shutdown_connections 2026-02-17T11:57:28.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 -- 10.20.193.10:0/3335328487 wait complete. 2026-02-17T11:57:28.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:28.571+0000 7fa0ad0a7640 1 librados: shutdown 2026-02-17T11:57:31.582 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:31.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.651+0000 7f3862c3b640 10 monclient: get_monmap_and_config 2026-02-17T11:57:31.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.651+0000 7f3862c3b640 10 monclient: build_initial_monmap 2026-02-17T11:57:31.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.651+0000 7f3862c3b640 10 monclient: monmap: 2026-02-17T11:57:31.653 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:31.653 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:31.653 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:31.651757+0000 2026-02-17T11:57:31.653 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:31.651757+0000 2026-02-17T11:57:31.653 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:31.654 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:31.654 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:31.654 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:31.654 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:31.654 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:31.654 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:31.654 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:31.654 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:31.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.651+0000 7f3862c3b640 1 Processor -- start 2026-02-17T11:57:31.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.651+0000 7f3862c3b640 1 -- start start 2026-02-17T11:57:31.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.651+0000 7f3862c3b640 10 monclient: init 2026-02-17T11:57:31.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:31.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 10 monclient: _add_conns ranks=[5,4,0,2,3,1] 2026-02-17T11:57:31.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f385c15d220 0x7f385c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:31.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 10 monclient(hunting): picked mon.noname-c con 0x7f385c15d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:31.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f385c074920 0x7f385c0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:31.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 10 monclient(hunting): picked mon.noname-b con 0x7f385c074920 addr v2:10.20.193.71:3300/0 2026-02-17T11:57:31.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f385c0c9120 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:31.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f385c0c95b0 con 0x7f385c0c9120 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f385c0c58a0 con 0x7f385c074920 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f385c0c55c0 con 0x7f385c15d220 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f3862c3b640 10 monclient(hunting): authenticate will time out at 1121.373491s 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f38611b1640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f385c0c9120 0x7f385c153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:60466/0 (socket says 10.20.193.10:60466) 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.652+0000 7f38611b1640 1 -- 10.20.193.10:0/241571089 learned_addr learned my addr 10.20.193.10:0/241571089 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f3853fff640 1 --2- 10.20.193.10:0/241571089 >> v2:10.20.193.71:3300/0 conn(0x7f385c074920 0x7f385c0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f38609b0640 1 --2- 10.20.193.10:0/241571089 >> v2:10.20.193.153:3300/0 conn(0x7f385c15d220 0x7f385c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:31.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f3853fff640 10 monclient(hunting): get_auth_request con 0x7f385c074920 auth_method 0 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f3853fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f3853fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f3853fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f38609b0640 10 monclient(hunting): get_auth_request con 0x7f385c15d220 auth_method 0 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f38609b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f38609b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f38609b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f3853fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f3853fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:31.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f3853fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f38609b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f38609b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.653+0000 7f38609b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38537fe640 1 -- 10.20.193.10:0/241571089 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075524738 0 0) 0x7f385c0c95b0 con 0x7f385c0c9120 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38537fe640 10 monclient(hunting): _negotiate 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38537fe640 10 monclient(hunting): my global_id is 4701 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38537fe640 1 -- 10.20.193.10:0/241571089 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3848003620 con 0x7f385c0c9120 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38609b0640 10 monclient(hunting): handle_auth_done global_id 4766 payload 274 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38609b0640 1 -- 10.20.193.10:0/241571089 >> v2:10.20.193.71:3300/0 conn(0x7f385c074920 msgr2=0x7f385c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38609b0640 1 --2- 10.20.193.10:0/241571089 >> v2:10.20.193.71:3300/0 conn(0x7f385c074920 0x7f385c0c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:31.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38609b0640 1 -- 10.20.193.10:0/241571089 >> v1:10.20.193.10:6789/0 conn(0x7f385c0c9120 legacy=0x7f385c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:31.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38609b0640 10 monclient: _finish_hunting 0 2026-02-17T11:57:31.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38609b0640 1 monclient: found mon.noname-c 2026-02-17T11:57:31.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38609b0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:31.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38609b0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:31.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.654+0000 7f38609b0640 1 -- 10.20.193.10:0/241571089 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c0c7e20 con 0x7f385c15d220 2026-02-17T11:57:31.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.655+0000 7f38609b0640 1 --2- 10.20.193.10:0/241571089 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f385c15d220 0x7f385c15d600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f384c0098a0 tx=0x7f384c02ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd5ccb0778bafa38 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:31.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 1 -- 10.20.193.10:0/241571089 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c03c070 con 0x7f385c15d220 2026-02-17T11:57:31.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:31.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:31.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 10 monclient: dump: 2026-02-17T11:57:31.670 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:31.670 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:31.670 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:31.670 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:31.670 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 1 -- 10.20.193.10:0/241571089 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f384c02fae0 con 0x7f385c15d220 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f3862c3b640 5 monclient: authenticate success, global_id 4766 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:31.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f3862c3b640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 1 -- 10.20.193.10:0/241571089 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c037440 con 0x7f385c15d220 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f3862c3b640 4 set_mon_vals no callback set 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.657+0000 7f38537fe640 10 monclient: dump: 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:31.672 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 10 monclient: shutdown 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 -- 10.20.193.10:0/241571089 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f385c15d220 msgr2=0x7f385c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 --2- 10.20.193.10:0/241571089 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f385c15d220 0x7f385c15d600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f384c0098a0 tx=0x7f384c02ee10 comp rx=0 tx=0).stop 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 -- 10.20.193.10:0/241571089 shutdown_connections 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 --2- 10.20.193.10:0/241571089 >> v2:10.20.193.71:3300/0 conn(0x7f385c074920 0x7f385c0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 --2- 10.20.193.10:0/241571089 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f385c15d220 0x7f385c15d600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 -- 10.20.193.10:0/241571089 >> 10.20.193.10:0/241571089 conn(0x7f385c0c9d80 msgr2=0x7f385c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:31.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 -- 10.20.193.10:0/241571089 shutdown_connections 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 -- 10.20.193.10:0/241571089 wait complete. 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 10 monclient: build_initial_monmap 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 10 monclient: monmap: 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:31.674 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 librados: starting msgr at 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 librados: starting objecter 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 Processor -- start 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 -- start start 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 librados: setting wanted keys 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 1 librados: calling monclient init 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.658+0000 7f3862c3b640 10 monclient: init 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f385c074920 0x7f385c1f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:31.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient(hunting): picked mon.noname-c con 0x7f385c074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f385c0c9120 0x7f385c06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient(hunting): picked mon.noname-a con 0x7f385c0c9120 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f385c15d220 0x7f385c0c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient(hunting): picked mon.noname-b con 0x7f385c15d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f385c0c86c0 con 0x7f385c0c9120 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f385c0c83e0 con 0x7f385c15d220 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f385c074d70 con 0x7f385c074920 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3862c3b640 10 monclient(hunting): authenticate will time out at 1121.380311s 2026-02-17T11:57:31.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3853fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f385c0c9120 0x7f385c06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f38611b1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f385c15d220 0x7f385c0c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f38609b0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f385c074920 0x7f385c1f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3853fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f385c0c9120 0x7f385c06d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:55340/0 (socket says 10.20.193.10:55340) 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3853fff640 1 -- 10.20.193.10:0/4145232130 learned_addr learned my addr 10.20.193.10:0/4145232130 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3853fff640 10 monclient(hunting): get_auth_request con 0x7f385c0c9120 auth_method 0 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3853fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3853fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f3853fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f38611b1640 10 monclient(hunting): get_auth_request con 0x7f385c15d220 auth_method 0 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f38611b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:31.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f38611b1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f38611b1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.659+0000 7f38609b0640 10 monclient(hunting): get_auth_request con 0x7f385c074920 auth_method 0 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f38609b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f38609b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f38609b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f38611b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f38611b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f38611b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f3853fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f3853fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f3853fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f38609b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:31.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f38609b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.660+0000 7f38609b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 10 monclient(hunting): handle_auth_done global_id 4723 payload 824 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 1 -- 10.20.193.10:0/4145232130 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f385c074920 msgr2=0x7f385c1f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f385c074920 0x7f385c1f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 1 -- 10.20.193.10:0/4145232130 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f385c0c9120 msgr2=0x7f385c06d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f385c0c9120 0x7f385c06d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 10 monclient: _finish_hunting 0 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 1 monclient: found mon.noname-b 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:31.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.661+0000 7f38611b1640 1 -- 10.20.193.10:0/4145232130 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c1f3540 con 0x7f385c15d220 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.662+0000 7f38611b1640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f385c15d220 0x7f385c0c3b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f385800ca80 tx=0x7f385800cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.662+0000 7f38517fa640 10 client.?.objecter ms_handle_connect 0x7f385c15d220 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.662+0000 7f38517fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 1 -- 10.20.193.10:0/4145232130 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385800ac40 con 0x7f385c15d220 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 10 monclient: dump: 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:31.680 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 10 monclient: _finish_auth 0 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 10 monclient: _check_auth_tickets 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 5 monclient: authenticate success, global_id 4723 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 1 -- 10.20.193.10:0/4145232130 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385800ade0 con 0x7f385c15d220 2026-02-17T11:57:31.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 1 -- 10.20.193.10:0/4145232130 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858012600 con 0x7f385c15d220 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3852ffd640 4 set_mon_vals no callback set 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f38517fa640 10 monclient: dump: 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:31.682 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 10 monclient: _renew_subs 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385c06d6f0 con 0x7f385c15d220 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 10 client.4723.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 10 monclient: _renew_subs 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385c1f3800 con 0x7f385c15d220 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 1 librados: init done 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:31.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:31.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:31.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.664+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385c0c8be0 con 0x7f385c15d220 2026-02-17T11:57:31.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.772+0000 7f38517fa640 1 -- 10.20.193.10:0/4145232130 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f38580127a0 con 0x7f385c15d220 2026-02-17T11:57:31.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.772+0000 7f38517fa640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f382c078e30 0x7f382c07b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:31.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.773+0000 7f38609b0640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f382c078e30 0x7f382c07b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:31.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.773+0000 7f38609b0640 10 monclient: get_auth_request con 0x7f382c078e30 auth_method 0 2026-02-17T11:57:31.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.773+0000 7f38517fa640 10 client.4723.objecter ms_handle_connect 0x7f382c078e30 2026-02-17T11:57:31.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.773+0000 7f38609b0640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f382c078e30 0x7f382c07b2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f384c039000 tx=0x7f384c033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:31.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.774+0000 7f38517fa640 1 -- 10.20.193.10:0/4145232130 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f385805e7b0 con 0x7f385c15d220 2026-02-17T11:57:31.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.774+0000 7f38517fa640 10 client.4723.objecter ms_dispatch2 0x7f385c000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:31.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.774+0000 7f38517fa640 3 client.4723.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:31.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.774+0000 7f38517fa640 3 client.4723.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:31.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.774+0000 7f38517fa640 20 client.4723.objecter dump_active .. 0 homeless 2026-02-17T11:57:31.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.780+0000 7f38517fa640 1 -- 10.20.193.10:0/4145232130 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3858062770 con 0x7f385c15d220 2026-02-17T11:57:31.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.780+0000 7f38517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:31.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.780+0000 7f38517fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:31.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.879+0000 7f3862c3b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:31.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.879+0000 7f3862c3b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:31.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.879+0000 7f3862c3b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:31.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.879+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f385c0cbbe0 con 0x7f385c15d220 2026-02-17T11:57:31.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.882+0000 7f38517fa640 1 -- 10.20.193.10:0/4145232130 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f3858066a70 con 0x7f385c15d220 2026-02-17T11:57:31.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.882+0000 7f38517fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:31.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.882+0000 7f38517fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:31.884 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:31.884 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:31.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 10 librados: watch_flush enter 2026-02-17T11:57:31.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 10 librados: watch_flush exit 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 20 client.4723.objecter shutdown clearing up homeless session... 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 10 client.4723.objecter successfully canceled tick 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f382c078e30 msgr2=0x7f382c07b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f382c078e30 0x7f382c07b2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f384c039000 tx=0x7f384c033000 comp rx=0 tx=0).stop 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 10 monclient: shutdown 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f385c15d220 msgr2=0x7f385c0c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f385c15d220 0x7f385c0c3b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f385800ca80 tx=0x7f385800cf50 comp rx=0 tx=0).stop 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 shutdown_connections 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f382c078e30 0x7f382c07b2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:31.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f385c15d220 0x7f385c0c3b80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:31.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f385c0c9120 0x7f385c06d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:31.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 --2- 10.20.193.10:0/4145232130 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f385c074920 0x7f385c1f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:31.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 >> 10.20.193.10:0/4145232130 conn(0x7f385c0c9d80 msgr2=0x7f385c153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:31.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 shutdown_connections 2026-02-17T11:57:31.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 -- 10.20.193.10:0/4145232130 wait complete. 2026-02-17T11:57:31.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:31.883+0000 7f3862c3b640 1 librados: shutdown 2026-02-17T11:57:34.894 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:34.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.965+0000 7f61dfa32640 10 monclient: get_monmap_and_config 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.965+0000 7f61dfa32640 10 monclient: build_initial_monmap 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.965+0000 7f61dfa32640 10 monclient: monmap: 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:34.965892+0000 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:34.965892+0000 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:34.967 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:34.968 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:34.968 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:34.968 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:34.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 1 Processor -- start 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 1 -- start start 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 10 monclient: init 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 10 monclient: _add_conns ranks=[5,1,0,4,2,3] 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f61d815d220 0x7f61d815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 10 monclient(hunting): picked mon.noname-c con 0x7f61d815d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f61d8074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f61d80c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d80c58a0 con 0x7f61d80c92f0 2026-02-17T11:57:34.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d80c55c0 con 0x7f61d8074920 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f61d80c7e20 con 0x7f61d815d220 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.966+0000 7f61dfa32640 10 monclient(hunting): authenticate will time out at 1124.687632s 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dcfa6640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f61d8074920 0x7f61d80c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:33008/0 (socket says 10.20.193.10:33008) 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dcfa6640 1 -- 10.20.193.10:0/3733529142 learned_addr learned my addr 10.20.193.10:0/3733529142 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dd7a7640 1 --2- 10.20.193.10:0/3733529142 >> v2:10.20.193.153:3300/0 conn(0x7f61d815d220 0x7f61d815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dd7a7640 10 monclient(hunting): get_auth_request con 0x7f61d815d220 auth_method 0 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dd7a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dd7a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dd7a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:34.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dd7a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dd7a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.967+0000 7f61dd7a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.968+0000 7f61dd7a7640 10 monclient(hunting): handle_auth_done global_id 4772 payload 274 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.968+0000 7f61dd7a7640 1 -- 10.20.193.10:0/3733529142 >> v1:10.20.193.71:6789/0 conn(0x7f61d8074920 legacy=0x7f61d80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.968+0000 7f61dd7a7640 1 -- 10.20.193.10:0/3733529142 >> v1:10.20.193.10:6789/0 conn(0x7f61d80c92f0 legacy=0x7f61d8153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.968+0000 7f61dd7a7640 10 monclient: _finish_hunting 0 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.968+0000 7f61dd7a7640 1 monclient: found mon.noname-c 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.968+0000 7f61dd7a7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.968+0000 7f61dd7a7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.968+0000 7f61dd7a7640 1 -- 10.20.193.10:0/3733529142 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d80c8100 con 0x7f61d815d220 2026-02-17T11:57:34.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.970+0000 7f61dd7a7640 1 --2- 10.20.193.10:0/3733529142 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f61d815d220 0x7f61d815d600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61c80098d0 tx=0x7f61c802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985933882f2a26c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:34.974 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:03:52.140 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 1 -- 10.20.193.10:0/3733529142 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c803c070 con 0x7f61d815d220 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 10 monclient: dump: 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:34.977 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 10 monclient: _finish_auth 0 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 1 -- 10.20.193.10:0/3733529142 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c802fb00 con 0x7f61d815d220 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 5 monclient: authenticate success, global_id 4772 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:34.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 1 -- 10.20.193.10:0/3733529142 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8037440 con 0x7f61d815d220 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61c7fff640 10 monclient: dump: 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:34.979 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 4 set_mon_vals no callback set 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 10 monclient: shutdown 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 1 -- 10.20.193.10:0/3733529142 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f61d815d220 msgr2=0x7f61d815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 1 --2- 10.20.193.10:0/3733529142 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f61d815d220 0x7f61d815d600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61c80098d0 tx=0x7f61c802ee80 comp rx=0 tx=0).stop 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 1 -- 10.20.193.10:0/3733529142 shutdown_connections 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 1 --2- 10.20.193.10:0/3733529142 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f61d815d220 0x7f61d815d600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 1 -- 10.20.193.10:0/3733529142 >> 10.20.193.10:0/3733529142 conn(0x7f61d80c9d80 msgr2=0x7f61d80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 1 -- 10.20.193.10:0/3733529142 shutdown_connections 2026-02-17T11:57:34.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 1 -- 10.20.193.10:0/3733529142 wait complete. 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 10 monclient: build_initial_monmap 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.972+0000 7f61dfa32640 10 monclient: monmap: 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:34.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 librados: starting msgr at 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 librados: starting objecter 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 Processor -- start 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 -- start start 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 librados: setting wanted keys 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 librados: calling monclient init 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient: init 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f61d8074920 0x7f61d81f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient(hunting): picked mon.noname-b con 0x7f61d8074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:34.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f61d80c92f0 0x7f61d8072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:34.983 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:03:52.142 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:34.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient(hunting): picked mon.noname-c con 0x7f61d80c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:34.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f61d815d220 0x7f61d81e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:34.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient(hunting): picked mon.noname-a con 0x7f61d815d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:34.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:34.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8074d70 con 0x7f61d815d220 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61d80c86c0 con 0x7f61d8074920 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8153d60 con 0x7f61d80c92f0 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.973+0000 7f61dfa32640 10 monclient(hunting): authenticate will time out at 1124.694760s 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.975+0000 7f61dcfa6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f61d80c92f0 0x7f61d8072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.978+0000 7f61ddfa8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f61d815d220 0x7f61d81e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.979+0000 7f61ddfa8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f61d815d220 0x7f61d81e74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:58478/0 (socket says 10.20.193.10:58478) 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.979+0000 7f61ddfa8640 1 -- 10.20.193.10:0/1619729498 learned_addr learned my addr 10.20.193.10:0/1619729498 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.979+0000 7f61ddfa8640 10 monclient(hunting): get_auth_request con 0x7f61d815d220 auth_method 0 2026-02-17T11:57:34.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.979+0000 7f61ddfa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.979+0000 7f61ddfa8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.979+0000 7f61ddfa8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.980+0000 7f61ddfa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.980+0000 7f61ddfa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.980+0000 7f61ddfa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 10 monclient(hunting): handle_auth_done global_id 4707 payload 824 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 1 -- 10.20.193.10:0/1619729498 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f61d80c92f0 msgr2=0x7f61d8072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f61d80c92f0 0x7f61d8072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 1 -- 10.20.193.10:0/1619729498 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f61d8074920 msgr2=0x7f61d81f3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f61d8074920 0x7f61d81f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 10 monclient: _finish_hunting 0 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 1 monclient: found mon.noname-a 2026-02-17T11:57:34.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:34.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:34.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.982+0000 7f61ddfa8640 1 -- 10.20.193.10:0/1619729498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d81f5270 con 0x7f61d815d220 2026-02-17T11:57:34.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.986+0000 7f61ddfa8640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f61d815d220 0x7f61d81e74f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b990 tx=0x7f61d400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:34.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.986+0000 7f61c5ffb640 10 client.?.objecter ms_handle_connect 0x7f61d815d220 2026-02-17T11:57:34.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.986+0000 7f61c5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:34.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 1 -- 10.20.193.10:0/1619729498 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4006e60 con 0x7f61d815d220 2026-02-17T11:57:34.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:34.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:34.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 10 monclient: dump: 2026-02-17T11:57:34.991 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:34.991 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:34.991 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:34.991 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:34.991 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:34.991 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 1 -- 10.20.193.10:0/1619729498 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d4010070 con 0x7f61d815d220 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:34.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 1 -- 10.20.193.10:0/1619729498 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d400c9d0 con 0x7f61d815d220 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c77fe640 4 set_mon_vals no callback set 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61c5ffb640 10 monclient: dump: 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:34.993 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 5 monclient: authenticate success, global_id 4707 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 10 monclient: _renew_subs 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d81f4d70 con 0x7f61d815d220 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 10 client.4707.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 10 monclient: _renew_subs 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:34.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d8148dc0 con 0x7f61d815d220 2026-02-17T11:57:34.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 1 librados: init done 2026-02-17T11:57:34.995 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:03:52.158 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:34.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:34.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:34.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:34.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:34.989+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d815d600 con 0x7f61d815d220 2026-02-17T11:57:35.002 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:03:52.166 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:35.004 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:03:52.132 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:35.004 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:03:52.168 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:35.005 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:03:52.134 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:35.014 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:03:52.177 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:35.016 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:03:52.145 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:57:35.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.096+0000 7f61c5ffb640 1 -- 10.20.193.10:0/1619729498 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f61d400cb70 con 0x7f61d815d220 2026-02-17T11:57:35.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.096+0000 7f61c5ffb640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f61a8078e50 0x7f61a807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:35.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.097+0000 7f61dd7a7640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f61a8078e50 0x7f61a807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:35.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.097+0000 7f61dd7a7640 10 monclient: get_auth_request con 0x7f61a8078e50 auth_method 0 2026-02-17T11:57:35.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.097+0000 7f61c5ffb640 10 client.4707.objecter ms_handle_connect 0x7f61a8078e50 2026-02-17T11:57:35.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.097+0000 7f61dd7a7640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f61a8078e50 0x7f61a807b310 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f61c8039000 tx=0x7f61c8031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:35.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.106+0000 7f61c5ffb640 1 -- 10.20.193.10:0/1619729498 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f61d4012de0 con 0x7f61d815d220 2026-02-17T11:57:35.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.106+0000 7f61c5ffb640 10 client.4707.objecter ms_dispatch2 0x7f61d8000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:35.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.106+0000 7f61c5ffb640 3 client.4707.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:35.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.106+0000 7f61c5ffb640 3 client.4707.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:35.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.106+0000 7f61c5ffb640 20 client.4707.objecter dump_active .. 0 homeless 2026-02-17T11:57:35.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.106+0000 7f61c5ffb640 1 -- 10.20.193.10:0/1619729498 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f61d81f5270 con 0x7f61d815d220 2026-02-17T11:57:35.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.106+0000 7f61c5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:35.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.106+0000 7f61c5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:35.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.208+0000 7f61dfa32640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:35.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.208+0000 7f61dfa32640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:35.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.208+0000 7f61dfa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:35.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.208+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f61d80c9b60 con 0x7f61d815d220 2026-02-17T11:57:35.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.211+0000 7f61c5ffb640 1 -- 10.20.193.10:0/1619729498 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f61d40621c0 con 0x7f61d815d220 2026-02-17T11:57:35.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.211+0000 7f61c5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:35.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.211+0000 7f61c5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:35.213 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:35.213 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 10 librados: watch_flush enter 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 10 librados: watch_flush exit 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 20 client.4707.objecter shutdown clearing up homeless session... 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 10 client.4707.objecter successfully canceled tick 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f61a8078e50 msgr2=0x7f61a807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f61a8078e50 0x7f61a807b310 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f61c8039000 tx=0x7f61c8031000 comp rx=0 tx=0).stop 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 10 monclient: shutdown 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f61d815d220 msgr2=0x7f61d81e74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:35.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f61d815d220 0x7f61d81e74f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b990 tx=0x7f61d400be60 comp rx=0 tx=0).stop 2026-02-17T11:57:35.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 shutdown_connections 2026-02-17T11:57:35.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f61a8078e50 0x7f61a807b310 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f61d815d220 0x7f61d81e74f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f61d80c92f0 0x7f61d8072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 --2- 10.20.193.10:0/1619729498 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f61d8074920 0x7f61d81f3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:35.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 >> 10.20.193.10:0/1619729498 conn(0x7f61d80c9d80 msgr2=0x7f61d814dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:35.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 shutdown_connections 2026-02-17T11:57:35.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 -- 10.20.193.10:0/1619729498 wait complete. 2026-02-17T11:57:35.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:35.213+0000 7f61dfa32640 1 librados: shutdown 2026-02-17T11:57:38.223 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:38.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.292+0000 7fc01b3ba640 10 monclient: get_monmap_and_config 2026-02-17T11:57:38.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.292+0000 7fc01b3ba640 10 monclient: build_initial_monmap 2026-02-17T11:57:38.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.292+0000 7fc01b3ba640 10 monclient: monmap: 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:38.293644+0000 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:38.293644+0000 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:38.295 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:38.296 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:38.296 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:38.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.292+0000 7fc01b3ba640 1 Processor -- start 2026-02-17T11:57:38.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.292+0000 7fc01b3ba640 1 -- start start 2026-02-17T11:57:38.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.292+0000 7fc01b3ba640 10 monclient: init 2026-02-17T11:57:38.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:38.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 10 monclient: _add_conns ranks=[0,5,1,2,3,4] 2026-02-17T11:57:38.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc01415d220 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:38.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc0140c92f0 0x7fc01415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 10 monclient(hunting): picked mon.noname-c con 0x7fc0140c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc014074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0140c58a0 con 0x7fc01415d220 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0140c55c0 con 0x7fc014074920 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc0140c7e20 con 0x7fc0140c92f0 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01b3ba640 10 monclient(hunting): authenticate will time out at 1128.015493s 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01912f640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fc01415d220 0x7fc0140c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:45676/0 (socket says 10.20.193.10:45676) 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.293+0000 7fc01912f640 1 -- 10.20.193.10:0/3630865082 learned_addr learned my addr 10.20.193.10:0/3630865082 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.294+0000 7fc01892e640 1 --2- 10.20.193.10:0/3630865082 >> v2:10.20.193.153:3300/0 conn(0x7fc0140c92f0 0x7fc01415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.294+0000 7fc01892e640 10 monclient(hunting): get_auth_request con 0x7fc0140c92f0 auth_method 0 2026-02-17T11:57:38.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.294+0000 7fc01892e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.294+0000 7fc01892e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.294+0000 7fc01892e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.294+0000 7fc01892e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.294+0000 7fc01892e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.294+0000 7fc01892e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 1 -- 10.20.193.10:0/3630865082 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424154042 0 0) 0x7fc0140c58a0 con 0x7fc01415d220 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 10 monclient(hunting): _negotiate 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 10 monclient(hunting): my global_id is 4710 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 1 -- 10.20.193.10:0/3630865082 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbffc003620 con 0x7fc01415d220 2026-02-17T11:57:38.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 1 -- 10.20.193.10:0/3630865082 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485118140 0 0) 0x7fc0140c55c0 con 0x7fc014074920 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 10 monclient(hunting): _negotiate 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 10 monclient(hunting): my global_id is 4726 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.295+0000 7fc003fff640 1 -- 10.20.193.10:0/3630865082 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0140c58a0 con 0x7fc014074920 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.296+0000 7fc01892e640 10 monclient(hunting): handle_auth_done global_id 4775 payload 274 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.296+0000 7fc01892e640 1 -- 10.20.193.10:0/3630865082 >> v1:10.20.193.71:6789/0 conn(0x7fc014074920 legacy=0x7fc014153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.296+0000 7fc01892e640 1 -- 10.20.193.10:0/3630865082 >> v1:10.20.193.10:6789/0 conn(0x7fc01415d220 legacy=0x7fc0140c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.296+0000 7fc01892e640 10 monclient: _finish_hunting 0 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.296+0000 7fc01892e640 1 monclient: found mon.noname-c 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.296+0000 7fc01892e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.296+0000 7fc01892e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:38.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.296+0000 7fc01892e640 1 -- 10.20.193.10:0/3630865082 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0140c8100 con 0x7fc0140c92f0 2026-02-17T11:57:38.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.297+0000 7fc01892e640 1 --2- 10.20.193.10:0/3630865082 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc0140c92f0 0x7fc01415d600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc0080098d0 tx=0x7fc00802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8963c141c2f5a7e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 1 -- 10.20.193.10:0/3630865082 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00803c070 con 0x7fc0140c92f0 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 10 monclient: dump: 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:38.309 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 10 monclient: _finish_auth 0 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 1 -- 10.20.193.10:0/3630865082 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00802fba0 con 0x7fc0140c92f0 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 5 monclient: authenticate success, global_id 4775 2026-02-17T11:57:38.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 1 -- 10.20.193.10:0/3630865082 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008037440 con 0x7fc0140c92f0 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 4 set_mon_vals no callback set 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc003fff640 10 monclient: dump: 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:38.311 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 10 monclient: shutdown 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3630865082 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc0140c92f0 msgr2=0x7fc01415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 1 --2- 10.20.193.10:0/3630865082 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc0140c92f0 0x7fc01415d600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc0080098d0 tx=0x7fc00802eed0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3630865082 shutdown_connections 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 1 --2- 10.20.193.10:0/3630865082 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc0140c92f0 0x7fc01415d600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3630865082 >> 10.20.193.10:0/3630865082 conn(0x7fc0140c9d80 msgr2=0x7fc0140ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3630865082 shutdown_connections 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.299+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3630865082 wait complete. 2026-02-17T11:57:38.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient: build_initial_monmap 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient: monmap: 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:38.313 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 librados: starting msgr at 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 librados: starting objecter 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 Processor -- start 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 -- start start 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 librados: setting wanted keys 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 librados: calling monclient init 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient: init 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc014074920 0x7fc0141f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.314 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient(hunting): picked mon.noname-c con 0x7fc014074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0140c92f0 0x7fc01406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient(hunting): picked mon.noname-a con 0x7fc0140c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc01415d220 0x7fc0141f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient(hunting): picked mon.noname-b con 0x7fc01415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc014074d70 con 0x7fc0140c92f0 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0140c86c0 con 0x7fc01415d220 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc014153d60 con 0x7fc014074920 2026-02-17T11:57:38.315 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.300+0000 7fc01b3ba640 10 monclient(hunting): authenticate will time out at 1128.022783s 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0140c92f0 0x7fc01406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01912f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc014074920 0x7fc0141f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0140c92f0 0x7fc01406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:58490/0 (socket says 10.20.193.10:58490) 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 1 -- 10.20.193.10:0/3955811952 learned_addr learned my addr 10.20.193.10:0/3955811952 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 10 monclient(hunting): get_auth_request con 0x7fc0140c92f0 auth_method 0 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc019930640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc01415d220 0x7fc0141f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01912f640 10 monclient(hunting): get_auth_request con 0x7fc014074920 auth_method 0 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01912f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01912f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01912f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01892e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc019930640 10 monclient(hunting): get_auth_request con 0x7fc01415d220 auth_method 0 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc019930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc019930640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc019930640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01912f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01912f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:38.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc01912f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc019930640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc019930640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.301+0000 7fc019930640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 10 monclient(hunting): handle_auth_done global_id 4778 payload 824 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 1 -- 10.20.193.10:0/3955811952 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc01415d220 msgr2=0x7fc0141f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc01415d220 0x7fc0141f3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 1 -- 10.20.193.10:0/3955811952 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0140c92f0 msgr2=0x7fc01406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0140c92f0 0x7fc01406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 10 monclient: _finish_hunting 0 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 1 monclient: found mon.noname-c 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.302+0000 7fc01912f640 1 -- 10.20.193.10:0/3955811952 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0141f4c30 con 0x7fc014074920 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.303+0000 7fc01912f640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc014074920 0x7fc0141f7c70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc00400c480 tx=0x7fc00400c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.303+0000 7fc001ffb640 10 client.?.objecter ms_handle_connect 0x7fc014074920 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.303+0000 7fc001ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc001ffb640 1 -- 10.20.193.10:0/3955811952 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004017070 con 0x7fc014074920 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc001ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc001ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc001ffb640 10 monclient: dump: 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:38.319 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc001ffb640 10 monclient: _finish_auth 0 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc001ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc001ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc01b3ba640 5 monclient: authenticate success, global_id 4778 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc01b3ba640 10 monclient: _renew_subs 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc01b3ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:38.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0141f4950 con 0x7fc014074920 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc01b3ba640 10 client.4778.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc01b3ba640 10 monclient: _renew_subs 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc01b3ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc014072850 con 0x7fc014074920 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.304+0000 7fc01b3ba640 1 librados: init done 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc01b3ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc01b3ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc01b3ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01415d600 con 0x7fc014074920 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc001ffb640 1 -- 10.20.193.10:0/3955811952 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc004005de0 con 0x7fc014074920 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc001ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc001ffb640 1 -- 10.20.193.10:0/3955811952 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004021060 con 0x7fc014074920 2026-02-17T11:57:38.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc001ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc001ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc0037fe640 4 set_mon_vals no callback set 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.305+0000 7fc001ffb640 10 monclient: dump: 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:38.322 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:38.323 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:38.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.416+0000 7fc001ffb640 1 -- 10.20.193.10:0/3955811952 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc004024080 con 0x7fc014074920 2026-02-17T11:57:38.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.416+0000 7fc001ffb640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbfe4078e00 0x7fbfe407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:38.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.416+0000 7fc01892e640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbfe4078e00 0x7fbfe407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:38.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.416+0000 7fc01892e640 10 monclient: get_auth_request con 0x7fbfe4078e00 auth_method 0 2026-02-17T11:57:38.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.417+0000 7fc001ffb640 10 client.4778.objecter ms_handle_connect 0x7fbfe4078e00 2026-02-17T11:57:38.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.417+0000 7fc01892e640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbfe4078e00 0x7fbfe407b2c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc008009130 tx=0x7fc008033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:38.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.418+0000 7fc001ffb640 1 -- 10.20.193.10:0/3955811952 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc00405d530 con 0x7fc014074920 2026-02-17T11:57:38.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.418+0000 7fc001ffb640 10 client.4778.objecter ms_dispatch2 0x7fc014000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:38.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.418+0000 7fc001ffb640 3 client.4778.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:38.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.418+0000 7fc001ffb640 3 client.4778.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:38.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.418+0000 7fc001ffb640 20 client.4778.objecter dump_active .. 0 homeless 2026-02-17T11:57:38.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.424+0000 7fc001ffb640 1 -- 10.20.193.10:0/3955811952 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc0040614f0 con 0x7fc014074920 2026-02-17T11:57:38.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.424+0000 7fc001ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:38.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.424+0000 7fc001ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:38.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.523+0000 7fc01b3ba640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:38.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.523+0000 7fc01b3ba640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:38.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.523+0000 7fc01b3ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:38.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.523+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc0140c9b60 con 0x7fc014074920 2026-02-17T11:57:38.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.525+0000 7fc001ffb640 1 -- 10.20.193.10:0/3955811952 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fc0040657f0 con 0x7fc014074920 2026-02-17T11:57:38.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.525+0000 7fc001ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:38.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.525+0000 7fc001ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:38.528 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:38.528 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:38.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 10 librados: watch_flush enter 2026-02-17T11:57:38.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 10 librados: watch_flush exit 2026-02-17T11:57:38.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 20 client.4778.objecter shutdown clearing up homeless session... 2026-02-17T11:57:38.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 10 client.4778.objecter successfully canceled tick 2026-02-17T11:57:38.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbfe4078e00 msgr2=0x7fbfe407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbfe4078e00 0x7fbfe407b2c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc008009130 tx=0x7fc008033000 comp rx=0 tx=0).stop 2026-02-17T11:57:38.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 10 monclient: shutdown 2026-02-17T11:57:38.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:38.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc014074920 msgr2=0x7fc0141f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc014074920 0x7fc0141f7c70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc00400c480 tx=0x7fc00400c950 comp rx=0 tx=0).stop 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 shutdown_connections 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbfe4078e00 0x7fbfe407b2c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc01415d220 0x7fc0141f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0140c92f0 0x7fc01406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 --2- 10.20.193.10:0/3955811952 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc014074920 0x7fc0141f7c70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 >> 10.20.193.10:0/3955811952 conn(0x7fc0140c9d80 msgr2=0x7fc014153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 shutdown_connections 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 -- 10.20.193.10:0/3955811952 wait complete. 2026-02-17T11:57:38.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:38.527+0000 7fc01b3ba640 1 librados: shutdown 2026-02-17T11:57:41.538 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.604+0000 7f973aaf2640 10 monclient: get_monmap_and_config 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.604+0000 7f973aaf2640 10 monclient: build_initial_monmap 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.604+0000 7f973aaf2640 10 monclient: monmap: 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:41.606049+0000 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:41.606049+0000 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:41.606 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 1 Processor -- start 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 1 -- start start 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient: init 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient: _add_conns ranks=[4,2,5,3,1,0] 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f973415d220 0x7f973415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient(hunting): picked mon.noname-b con 0x7f973415d220 addr v2:10.20.193.71:3300/0 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9734074920 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f97340c92f0 0x7f9734153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient(hunting): picked mon.noname-c con 0x7f97340c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97340c58a0 con 0x7f9734074920 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f97340c55c0 con 0x7f973415d220 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f97340c7e20 con 0x7f97340c92f0 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:41.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.605+0000 7f973aaf2640 10 monclient(hunting): authenticate will time out at 1131.327807s 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9738867640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f973415d220 0x7f973415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9739068640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f97340c92f0 0x7f9734153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f972bfff640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f9734074920 0x7f97340c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:38692/0 (socket says 10.20.193.10:38692) 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f972bfff640 1 -- 10.20.193.10:0/4126827383 learned_addr learned my addr 10.20.193.10:0/4126827383 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9738867640 10 monclient(hunting): get_auth_request con 0x7f973415d220 auth_method 0 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9738867640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9738867640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9738867640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9739068640 10 monclient(hunting): get_auth_request con 0x7f97340c92f0 auth_method 0 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9739068640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9739068640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9739068640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9738867640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9738867640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.606+0000 7f9738867640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9739068640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9739068640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:41.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9739068640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:41.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9738867640 10 monclient(hunting): handle_auth_done global_id 4732 payload 274 2026-02-17T11:57:41.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9738867640 1 -- 10.20.193.10:0/4126827383 >> v2:10.20.193.153:3300/0 conn(0x7f97340c92f0 msgr2=0x7f9734153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:41.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9738867640 1 --2- 10.20.193.10:0/4126827383 >> v2:10.20.193.153:3300/0 conn(0x7f97340c92f0 0x7f9734153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9738867640 1 -- 10.20.193.10:0/4126827383 >> v1:10.20.193.153:6789/0 conn(0x7f9734074920 legacy=0x7f97340c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:41.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9738867640 10 monclient: _finish_hunting 0 2026-02-17T11:57:41.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9738867640 1 monclient: found mon.noname-b 2026-02-17T11:57:41.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9738867640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:41.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9738867640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:57:41.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.607+0000 7f9738867640 1 -- 10.20.193.10:0/4126827383 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97340c8100 con 0x7f973415d220 2026-02-17T11:57:41.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.608+0000 7f9738867640 1 --2- 10.20.193.10:0/4126827383 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 0x7f973415d600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f97240098a0 tx=0x7f972402ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e70ab2b6428e89bc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 1 -- 10.20.193.10:0/4126827383 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972403c070 con 0x7f973415d220 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 10 monclient: dump: 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 1 -- 10.20.193.10:0/4126827383 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972402fae0 con 0x7f973415d220 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 5 monclient: authenticate success, global_id 4732 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 1 -- 10.20.193.10:0/4126827383 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724037440 con 0x7f973415d220 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f972b7fe640 10 monclient: dump: 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:41.612 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:41.613 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:41.613 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:41.613 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:41.613 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:41.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:41.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 4 set_mon_vals no callback set 2026-02-17T11:57:41.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 10 monclient: shutdown 2026-02-17T11:57:41.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 1 -- 10.20.193.10:0/4126827383 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 msgr2=0x7f973415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 1 --2- 10.20.193.10:0/4126827383 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 0x7f973415d600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f97240098a0 tx=0x7f972402ee10 comp rx=0 tx=0).stop 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 1 -- 10.20.193.10:0/4126827383 shutdown_connections 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 1 --2- 10.20.193.10:0/4126827383 >> v2:10.20.193.153:3300/0 conn(0x7f97340c92f0 0x7f9734153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 1 --2- 10.20.193.10:0/4126827383 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 0x7f973415d600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 1 -- 10.20.193.10:0/4126827383 >> 10.20.193.10:0/4126827383 conn(0x7f97340c9d80 msgr2=0x7f97340ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 1 -- 10.20.193.10:0/4126827383 shutdown_connections 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.610+0000 7f973aaf2640 1 -- 10.20.193.10:0/4126827383 wait complete. 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient: build_initial_monmap 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient: monmap: 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 librados: starting msgr at 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 librados: starting objecter 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 Processor -- start 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 -- start start 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 librados: setting wanted keys 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 librados: calling monclient init 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient: init 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9734074920 0x7f97341542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient(hunting): picked mon.noname-a con 0x7f9734074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97340c92f0 0x7f97341f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient(hunting): picked mon.noname-c con 0x7f97340c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 0x7f97340c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient(hunting): picked mon.noname-b con 0x7f973415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:41.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f9734074d70 con 0x7f9734074920 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97340c86c0 con 0x7f973415d220 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9734153b90 con 0x7f97340c92f0 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.611+0000 7f973aaf2640 10 monclient(hunting): authenticate will time out at 1131.333986s 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f972bfff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97340c92f0 0x7f97341f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 0x7f97340c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9738867640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9734074920 0x7f97341542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 0x7f97340c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:41392/0 (socket says 10.20.193.10:41392) 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 1 -- 10.20.193.10:0/709009372 learned_addr learned my addr 10.20.193.10:0/709009372 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 10 monclient(hunting): get_auth_request con 0x7f973415d220 auth_method 0 2026-02-17T11:57:41.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f972bfff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97340c92f0 0x7f97341f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:57352/0 (socket says 10.20.193.10:57352) 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f972bfff640 10 monclient(hunting): get_auth_request con 0x7f97340c92f0 auth_method 0 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f972bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f972bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f972bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9738867640 10 monclient(hunting): get_auth_request con 0x7f9734074920 auth_method 0 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9738867640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9738867640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9738867640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9739068640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f972bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f972bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f972bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9738867640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.612+0000 7f9738867640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.613+0000 7f9738867640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 10 monclient(hunting): handle_auth_done global_id 4787 payload 824 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 1 -- 10.20.193.10:0/709009372 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 msgr2=0x7f97340c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 0x7f97340c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 1 -- 10.20.193.10:0/709009372 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9734074920 msgr2=0x7f97341542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9734074920 0x7f97341542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 1 monclient: found mon.noname-c 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.614+0000 7f972bfff640 1 -- 10.20.193.10:0/709009372 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97341f4680 con 0x7f97340c92f0 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.615+0000 7f972bfff640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97340c92f0 0x7f97341f4140 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f971c00c500 tx=0x7f971c00c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.615+0000 7f97297fa640 10 client.?.objecter ms_handle_connect 0x7f97340c92f0 2026-02-17T11:57:41.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.615+0000 7f97297fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:41.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 1 -- 10.20.193.10:0/709009372 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c017070 con 0x7f97340c92f0 2026-02-17T11:57:41.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:41.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:41.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 10 monclient: dump: 2026-02-17T11:57:41.618 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:41.618 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:41.618 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:41.618 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:41.618 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 10 monclient: _finish_auth 0 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 10 monclient: _check_auth_tickets 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 1 -- 10.20.193.10:0/709009372 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f971c005de0 con 0x7f97340c92f0 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f973aaf2640 5 monclient: authenticate success, global_id 4787 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f973aaf2640 10 monclient: _renew_subs 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f973aaf2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9734073820 con 0x7f97340c92f0 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 1 -- 10.20.193.10:0/709009372 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c0072b0 con 0x7f97340c92f0 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f972affd640 4 set_mon_vals no callback set 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f97297fa640 10 monclient: dump: 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f973aaf2640 10 client.4787.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f973aaf2640 10 monclient: _renew_subs 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f973aaf2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9734073de0 con 0x7f97340c92f0 2026-02-17T11:57:41.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.616+0000 7f973aaf2640 1 librados: init done 2026-02-17T11:57:41.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.617+0000 7f973aaf2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:41.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.617+0000 7f973aaf2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:41.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.617+0000 7f973aaf2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:41.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.617+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9734153f70 con 0x7f97340c92f0 2026-02-17T11:57:41.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.725+0000 7f97297fa640 1 -- 10.20.193.10:0/709009372 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f971c007450 con 0x7f97340c92f0 2026-02-17T11:57:41.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.725+0000 7f97297fa640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9704078e30 0x7f970407b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:41.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.725+0000 7f9738867640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9704078e30 0x7f970407b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:41.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.725+0000 7f9738867640 10 monclient: get_auth_request con 0x7f9704078e30 auth_method 0 2026-02-17T11:57:41.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.726+0000 7f97297fa640 10 client.4787.objecter ms_handle_connect 0x7f9704078e30 2026-02-17T11:57:41.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.726+0000 7f9738867640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9704078e30 0x7f970407b2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9724039000 tx=0x7f9724033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:41.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.726+0000 7f97297fa640 1 -- 10.20.193.10:0/709009372 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f971c007770 con 0x7f97340c92f0 2026-02-17T11:57:41.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.726+0000 7f97297fa640 10 client.4787.objecter ms_dispatch2 0x7f9734000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:41.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.726+0000 7f97297fa640 3 client.4787.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:41.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.726+0000 7f97297fa640 3 client.4787.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:41.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.726+0000 7f97297fa640 20 client.4787.objecter dump_active .. 0 homeless 2026-02-17T11:57:41.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.732+0000 7f97297fa640 1 -- 10.20.193.10:0/709009372 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f971c021020 con 0x7f97340c92f0 2026-02-17T11:57:41.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.732+0000 7f97297fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:41.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.732+0000 7f97297fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:41.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.833+0000 7f973aaf2640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:41.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.833+0000 7f973aaf2640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:41.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.833+0000 7f973aaf2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:41.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.833+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f973414f820 con 0x7f97340c92f0 2026-02-17T11:57:41.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.836+0000 7f97297fa640 1 -- 10.20.193.10:0/709009372 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f971c061350 con 0x7f97340c92f0 2026-02-17T11:57:41.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.836+0000 7f97297fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:41.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.836+0000 7f97297fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:41.838 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:41.838 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:41.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.836+0000 7f973aaf2640 10 librados: watch_flush enter 2026-02-17T11:57:41.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.836+0000 7f973aaf2640 10 librados: watch_flush exit 2026-02-17T11:57:41.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 20 client.4787.objecter shutdown clearing up homeless session... 2026-02-17T11:57:41.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 10 client.4787.objecter successfully canceled tick 2026-02-17T11:57:41.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9704078e30 msgr2=0x7f970407b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:41.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9704078e30 0x7f970407b2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9724039000 tx=0x7f9724033000 comp rx=0 tx=0).stop 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 10 monclient: shutdown 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97340c92f0 msgr2=0x7f97341f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97340c92f0 0x7f97341f4140 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f971c00c500 tx=0x7f971c00c9d0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 shutdown_connections 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9704078e30 0x7f970407b2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f973415d220 0x7f97340c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f97340c92f0 0x7f97341f4140 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 --2- 10.20.193.10:0/709009372 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9734074920 0x7f97341542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:41.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 >> 10.20.193.10:0/709009372 conn(0x7f97340c9d80 msgr2=0x7f9734153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:41.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 shutdown_connections 2026-02-17T11:57:41.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 -- 10.20.193.10:0/709009372 wait complete. 2026-02-17T11:57:41.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:41.837+0000 7f973aaf2640 1 librados: shutdown 2026-02-17T11:57:44.849 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:44.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.920+0000 7f38b4c96640 10 monclient: get_monmap_and_config 2026-02-17T11:57:44.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.920+0000 7f38b4c96640 10 monclient: build_initial_monmap 2026-02-17T11:57:44.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.920+0000 7f38b4c96640 10 monclient: monmap: 2026-02-17T11:57:44.923 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:44.923 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:44.922076+0000 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:44.922076+0000 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:44.924 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:44.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 1 Processor -- start 2026-02-17T11:57:44.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 1 -- start start 2026-02-17T11:57:44.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 10 monclient: init 2026-02-17T11:57:44.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 10 monclient: _add_conns ranks=[2,1,0,5,4,3] 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f38b015d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f38b00c92f0 addr v1:10.20.193.71:6789/0 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f38b0153d60 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b00c58a0 con 0x7f38b0153d60 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b00c55c0 con 0x7f38b00c92f0 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b00c7e20 con 0x7f38b015d220 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.921+0000 7f38b4c96640 10 monclient(hunting): authenticate will time out at 1134.643815s 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.922+0000 7f38aed76640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f38b0153d60 0x7f38b00c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:43496/0 (socket says 10.20.193.10:43496) 2026-02-17T11:57:44.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.922+0000 7f38aed76640 1 -- 10.20.193.10:0/1612819226 learned_addr learned my addr 10.20.193.10:0/1612819226 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478141305 0 0) 0x7f38b00c58a0 con 0x7f38b0153d60 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): _negotiate 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): my global_id is 4719 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f389c003620 con 0x7f38b0153d60 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904746793 0 0) 0x7f38b00c7e20 con 0x7f38b015d220 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): _negotiate 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): my global_id is 4790 2026-02-17T11:57:44.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b00c58a0 con 0x7f38b015d220 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4074643312 0 0) 0x7f38b00c55c0 con 0x7f38b00c92f0 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): _negotiate 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 10 monclient(hunting): my global_id is 4738 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.923+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b00c7e20 con 0x7f38b00c92f0 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1607433852 0 0) 0x7f389c003620 con 0x7f38b0153d60 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 >> v1:10.20.193.153:6789/0 conn(0x7f38b015d220 legacy=0x7f38b00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 >> v1:10.20.193.71:6789/0 conn(0x7f38b00c92f0 legacy=0x7f38b0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient: _finish_hunting 0 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:57:44.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b00c8100 con 0x7f38b0153d60 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient: _finish_auth 0 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient: _check_auth_tickets 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f38a0003280 con 0x7f38b0153d60 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient: dump: 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.934 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 >> v1:10.20.193.10:6789/0 conn(0x7f38b0153d60 legacy=0x7f38b00c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f389c003fe0 0x7f389c004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:44.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient(hunting): picked mon.a con 0x7f389c003fe0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f389c004e40 0x7f389c0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient(hunting): picked mon.b con 0x7f389c004e40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 0x7f389c00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient(hunting): picked mon.c con 0x7f389c009ab0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f389c00c570 con 0x7f389c003fe0 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f389c00c6f0 con 0x7f389c004e40 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f389c00c8f0 con 0x7f389c009ab0 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:44.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.925+0000 7f38ad573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38add74640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f389c004e40 0x7f389c0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38aed76640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 0x7f389c00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38add74640 10 monclient(hunting): get_auth_request con 0x7f389c004e40 auth_method 0 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38add74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38add74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38add74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38ae575640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f389c003fe0 0x7f389c004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38aed76640 10 monclient(hunting): get_auth_request con 0x7f389c009ab0 auth_method 0 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38aed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38aed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.926+0000 7f38aed76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:44.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38ae575640 10 monclient(hunting): get_auth_request con 0x7f389c003fe0 auth_method 0 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38ae575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38add74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38add74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38add74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38aed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38aed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38aed76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.927+0000 7f38ae575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 10 monclient(hunting): handle_auth_done global_id 4719 payload 293 2026-02-17T11:57:44.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 1 -- 10.20.193.10:0/1612819226 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f389c004e40 msgr2=0x7f389c0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f389c004e40 0x7f389c0052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 1 -- 10.20.193.10:0/1612819226 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f389c003fe0 msgr2=0x7f389c004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f389c003fe0 0x7f389c004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 10 monclient: _finish_hunting 0 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 1 monclient: found mon.c 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 1 -- 10.20.193.10:0/1612819226 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c003620 con 0x7f389c009ab0 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 10 monclient: _finish_auth 0 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 10 monclient: _check_auth_tickets 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:44.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38b4c96640 5 monclient: authenticate success, global_id 4719 2026-02-17T11:57:44.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38b4c96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:44.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.928+0000 7f38aed76640 1 -- 10.20.193.10:0/1612819226 reap_dead start 2026-02-17T11:57:44.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.929+0000 7f38aed76640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 0x7f389c00bea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38a000a750 tx=0x7f38a002fb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a63ebe4d298720f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:44.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0037020 con 0x7f389c009ab0 2026-02-17T11:57:44.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:44.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:44.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 10 monclient: dump: 2026-02-17T11:57:44.947 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:44.947 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:44.947 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.947 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.947 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a0033620 con 0x7f389c009ab0 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 1 -- 10.20.193.10:0/1612819226 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a000a370 con 0x7f389c009ab0 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 4 set_mon_vals no callback set 2026-02-17T11:57:44.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38ad573640 10 monclient: dump: 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:44.949 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 10 monclient: shutdown 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 -- 10.20.193.10:0/1612819226 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 msgr2=0x7f389c00bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 0x7f389c00bea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38a000a750 tx=0x7f38a002fb10 comp rx=0 tx=0).stop 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 -- 10.20.193.10:0/1612819226 shutdown_connections 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 --2- 10.20.193.10:0/1612819226 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 0x7f389c00bea0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 -- 10.20.193.10:0/1612819226 >> 10.20.193.10:0/1612819226 conn(0x7f38b00c9d80 msgr2=0x7f38b00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 -- 10.20.193.10:0/1612819226 shutdown_connections 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 -- 10.20.193.10:0/1612819226 wait complete. 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 10 monclient: build_initial_monmap 2026-02-17T11:57:44.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 10 monclient: monmap: 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 librados: starting msgr at 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 librados: starting objecter 2026-02-17T11:57:44.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.932+0000 7f38b4c96640 1 Processor -- start 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 1 -- start start 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 1 librados: setting wanted keys 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 1 librados: calling monclient init 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient: init 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 0x7f38b0147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient(hunting): picked mon.noname-c con 0x7f389c009ab0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f38b0148450 0x7f38b01f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient(hunting): picked mon.noname-b con 0x7f38b0148450 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f38b01f56c0 0x7f38b01450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:44.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient(hunting): picked mon.noname-a con 0x7f38b01f56c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f38b015d600 con 0x7f38b01f56c0 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f38b00c86c0 con 0x7f38b0148450 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38b015d780 con 0x7f389c009ab0 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38b4c96640 10 monclient(hunting): authenticate will time out at 1134.655427s 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38aed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f38b01f56c0 0x7f38b01450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38ae575640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 0x7f38b0147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38aed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f38b01f56c0 0x7f38b01450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:49274/0 (socket says 10.20.193.10:49274) 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38aed76640 1 -- 10.20.193.10:0/2846703465 learned_addr learned my addr 10.20.193.10:0/2846703465 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:44.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38aed76640 10 monclient(hunting): get_auth_request con 0x7f38b01f56c0 auth_method 0 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38aed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38aed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38aed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38add74640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f38b0148450 0x7f38b01f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38ae575640 10 monclient(hunting): get_auth_request con 0x7f389c009ab0 auth_method 0 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.933+0000 7f38ae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38add74640 10 monclient(hunting): get_auth_request con 0x7f38b0148450 auth_method 0 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38add74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38add74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:44.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38add74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38aed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38aed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38aed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38ae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38add74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38add74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.934+0000 7f38add74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 10 monclient(hunting): handle_auth_done global_id 4722 payload 824 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 1 -- 10.20.193.10:0/2846703465 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 msgr2=0x7f38b0147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 0x7f38b0147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 1 -- 10.20.193.10:0/2846703465 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f38b0148450 msgr2=0x7f38b01f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f38b0148450 0x7f38b01f5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 10 monclient: _finish_hunting 0 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 1 monclient: found mon.noname-a 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.935+0000 7f38aed76640 1 -- 10.20.193.10:0/2846703465 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b015bfa0 con 0x7f38b01f56c0 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.936+0000 7f38aed76640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f38b01f56c0 0x7f38b01450f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38a0002790 tx=0x7f38b00c82d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.936+0000 7f3896ffd640 10 client.?.objecter ms_handle_connect 0x7f38b01f56c0 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.936+0000 7f3896ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 1 -- 10.20.193.10:0/2846703465 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0037030 con 0x7f38b01f56c0 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:44.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 10 monclient: dump: 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 10 monclient: _finish_auth 0 2026-02-17T11:57:44.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38b4c96640 5 monclient: authenticate success, global_id 4722 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 1 -- 10.20.193.10:0/2846703465 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a0035270 con 0x7f38b01f56c0 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38b4c96640 10 monclient: _renew_subs 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38b4c96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b015c280 con 0x7f38b01f56c0 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 1 -- 10.20.193.10:0/2846703465 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a000a370 con 0x7f38b01f56c0 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38acd72640 4 set_mon_vals no callback set 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f3896ffd640 10 monclient: dump: 2026-02-17T11:57:44.958 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38b4c96640 10 client.4722.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38b4c96640 10 monclient: _renew_subs 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38b4c96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:44.959 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b015c840 con 0x7f38b01f56c0 2026-02-17T11:57:44.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.938+0000 7f38b4c96640 1 librados: init done 2026-02-17T11:57:44.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.939+0000 7f38b4c96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:44.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.939+0000 7f38b4c96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:44.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.939+0000 7f38b4c96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:44.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.939+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b015e100 con 0x7f38b01f56c0 2026-02-17T11:57:44.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.950+0000 7f3896ffd640 1 -- 10.20.193.10:0/2846703465 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f38a0033620 con 0x7f38b01f56c0 2026-02-17T11:57:44.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.950+0000 7f3896ffd640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f387c078e00 0x7f387c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:44.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.950+0000 7f38ae575640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f387c078e00 0x7f387c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:44.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.950+0000 7f38ae575640 10 monclient: get_auth_request con 0x7f387c078e00 auth_method 0 2026-02-17T11:57:44.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.950+0000 7f38ae575640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f387c078e00 0x7f387c07b2c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f38a4002910 tx=0x7f38a4007da0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:44.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.951+0000 7f3896ffd640 10 client.4722.objecter ms_handle_connect 0x7f387c078e00 2026-02-17T11:57:44.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.952+0000 7f3896ffd640 1 -- 10.20.193.10:0/2846703465 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f38a0083320 con 0x7f38b01f56c0 2026-02-17T11:57:44.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.952+0000 7f3896ffd640 10 client.4722.objecter ms_dispatch2 0x7f38b0000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:44.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.952+0000 7f3896ffd640 3 client.4722.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:44.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.952+0000 7f3896ffd640 3 client.4722.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:44.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:44.952+0000 7f3896ffd640 20 client.4722.objecter dump_active .. 0 homeless 2026-02-17T11:57:45.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.053+0000 7f3896ffd640 1 -- 10.20.193.10:0/2846703465 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f38b015e100 con 0x7f38b01f56c0 2026-02-17T11:57:45.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.053+0000 7f3896ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:45.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.053+0000 7f3896ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:45.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.154+0000 7f38b4c96640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:45.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.154+0000 7f38b4c96640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:45.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.154+0000 7f38b4c96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:45.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.154+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f38b0074920 con 0x7f38b01f56c0 2026-02-17T11:57:45.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.157+0000 7f3896ffd640 1 -- 10.20.193.10:0/2846703465 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f38a00879e0 con 0x7f38b01f56c0 2026-02-17T11:57:45.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.157+0000 7f3896ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:45.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.157+0000 7f3896ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:45.159 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:45.159 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:45.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 10 librados: watch_flush enter 2026-02-17T11:57:45.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 10 librados: watch_flush exit 2026-02-17T11:57:45.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 20 client.4722.objecter shutdown clearing up homeless session... 2026-02-17T11:57:45.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 10 client.4722.objecter successfully canceled tick 2026-02-17T11:57:45.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f387c078e00 msgr2=0x7f387c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:45.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f387c078e00 0x7f387c07b2c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f38a4002910 tx=0x7f38a4007da0 comp rx=0 tx=0).stop 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 10 monclient: shutdown 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f38b01f56c0 msgr2=0x7f38b01450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f38b01f56c0 0x7f38b01450f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38a0002790 tx=0x7f38b00c82d0 comp rx=0 tx=0).stop 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 shutdown_connections 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f387c078e00 0x7f387c07b2c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f38b01f56c0 0x7f38b01450f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f38b0148450 0x7f38b01f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 --2- 10.20.193.10:0/2846703465 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f389c009ab0 0x7f38b0147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 >> 10.20.193.10:0/2846703465 conn(0x7f38b00c9d80 msgr2=0x7f38b0153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:45.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 shutdown_connections 2026-02-17T11:57:45.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 -- 10.20.193.10:0/2846703465 wait complete. 2026-02-17T11:57:45.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:45.158+0000 7f38b4c96640 1 librados: shutdown 2026-02-17T11:57:48.169 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:48.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.235+0000 7ff7f65f8640 10 monclient: get_monmap_and_config 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.235+0000 7ff7f65f8640 10 monclient: build_initial_monmap 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.235+0000 7ff7f65f8640 10 monclient: monmap: 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:48.237115+0000 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:48.237115+0000 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:48.238 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:48.239 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:48.239 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:48.239 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:48.239 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:48.239 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:48.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 1 Processor -- start 2026-02-17T11:57:48.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 1 -- start start 2026-02-17T11:57:48.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient: init 2026-02-17T11:57:48.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:48.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient: _add_conns ranks=[3,0,4,2,5,1] 2026-02-17T11:57:48.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff7f0152660 0x7ff7f015a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient(hunting): picked mon.noname-a con 0x7ff7f0152660 addr v2:10.20.193.10:3300/0 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff7f0152a40 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff7f00c94e0 0x7ff7f015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient(hunting): picked mon.noname-b con 0x7ff7f00c94e0 addr v2:10.20.193.71:3300/0 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f00c71e0 con 0x7ff7f0152a40 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f00c77a0 con 0x7ff7f0152660 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f00c74c0 con 0x7ff7f00c94e0 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.236+0000 7ff7f65f8640 10 monclient(hunting): authenticate will time out at 1137.958833s 2026-02-17T11:57:48.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7effff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff7f0152660 0x7ff7f015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7f4b6e640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff7f00c94e0 0x7ff7f015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7f4b6e640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff7f00c94e0 0x7ff7f015ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:58554/0 (socket says 10.20.193.10:58554) 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7f4b6e640 1 -- 10.20.193.10:0/806960552 learned_addr learned my addr 10.20.193.10:0/806960552 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7f4b6e640 10 monclient(hunting): get_auth_request con 0x7ff7f00c94e0 auth_method 0 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7f4b6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7f4b6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7f4b6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7effff640 10 monclient(hunting): get_auth_request con 0x7ff7f0152660 auth_method 0 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.237+0000 7ff7effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.238+0000 7ff7f4b6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:48.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.238+0000 7ff7f4b6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.238+0000 7ff7f4b6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.238+0000 7ff7effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.238+0000 7ff7effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.238+0000 7ff7effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.239+0000 7ff7f4b6e640 10 monclient(hunting): handle_auth_done global_id 4744 payload 274 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.239+0000 7ff7f4b6e640 1 -- 10.20.193.10:0/806960552 >> v2:10.20.193.10:3300/0 conn(0x7ff7f0152660 msgr2=0x7ff7f015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.239+0000 7ff7f4b6e640 1 --2- 10.20.193.10:0/806960552 >> v2:10.20.193.10:3300/0 conn(0x7ff7f0152660 0x7ff7f015a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.239+0000 7ff7f4b6e640 1 -- 10.20.193.10:0/806960552 >> v1:10.20.193.10:6789/0 conn(0x7ff7f0152a40 legacy=0x7ff7f00c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.239+0000 7ff7f4b6e640 10 monclient: _finish_hunting 0 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.239+0000 7ff7f4b6e640 1 monclient: found mon.noname-b 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.239+0000 7ff7f4b6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.239+0000 7ff7f4b6e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:57:48.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.239+0000 7ff7f4b6e640 1 -- 10.20.193.10:0/806960552 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f0159e40 con 0x7ff7f00c94e0 2026-02-17T11:57:48.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.240+0000 7ff7f4b6e640 1 --2- 10.20.193.10:0/806960552 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff7f00c94e0 0x7ff7f015ae60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0072150 tx=0x7ff7e402f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d13f6fc2728a3cd9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:48.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 1 -- 10.20.193.10:0/806960552 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e402fd70 con 0x7ff7f00c94e0 2026-02-17T11:57:48.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:48.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:48.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 10 monclient: dump: 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:48.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 10 monclient: _finish_auth 0 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 1 -- 10.20.193.10:0/806960552 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e40373f0 con 0x7ff7f00c94e0 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 5 monclient: authenticate success, global_id 4744 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 1 -- 10.20.193.10:0/806960552 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40377c0 con 0x7ff7f00c94e0 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7eeffd640 10 monclient: dump: 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:48.254 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 4 set_mon_vals no callback set 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 10 monclient: shutdown 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:48.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 1 -- 10.20.193.10:0/806960552 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff7f00c94e0 msgr2=0x7ff7f015ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 1 --2- 10.20.193.10:0/806960552 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff7f00c94e0 0x7ff7f015ae60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0072150 tx=0x7ff7e402f270 comp rx=0 tx=0).stop 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 1 -- 10.20.193.10:0/806960552 shutdown_connections 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 1 --2- 10.20.193.10:0/806960552 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff7f00c94e0 0x7ff7f015ae60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 1 --2- 10.20.193.10:0/806960552 >> v2:10.20.193.10:3300/0 conn(0x7ff7f0152660 0x7ff7f015a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 1 -- 10.20.193.10:0/806960552 >> 10.20.193.10:0/806960552 conn(0x7ff7f00c9d80 msgr2=0x7ff7f00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 1 -- 10.20.193.10:0/806960552 shutdown_connections 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.242+0000 7ff7f65f8640 1 -- 10.20.193.10:0/806960552 wait complete. 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.243+0000 7ff7f65f8640 10 monclient: build_initial_monmap 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.243+0000 7ff7f65f8640 10 monclient: monmap: 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:48.256 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.243+0000 7ff7f65f8640 1 librados: starting msgr at 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.243+0000 7ff7f65f8640 1 librados: starting objecter 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.243+0000 7ff7f65f8640 1 Processor -- start 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.243+0000 7ff7f65f8640 1 -- start start 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.243+0000 7ff7f65f8640 1 librados: setting wanted keys 2026-02-17T11:57:48.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.243+0000 7ff7f65f8640 1 librados: calling monclient init 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.243+0000 7ff7f65f8640 10 monclient: init 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff7f00c94e0 0x7ff7f013f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient(hunting): picked mon.noname-c con 0x7ff7f00c94e0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff7f0152660 0x7ff7f0140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient(hunting): picked mon.noname-a con 0x7ff7f0152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff7f0152a40 0x7ff7f01466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient(hunting): picked mon.noname-b con 0x7ff7f0152a40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:48.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:48.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f00c7c80 con 0x7ff7f0152660 2026-02-17T11:57:48.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:48.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f015a400 con 0x7ff7f0152a40 2026-02-17T11:57:48.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:48.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f00c7e00 con 0x7ff7f00c94e0 2026-02-17T11:57:48.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:48.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f65f8640 10 monclient(hunting): authenticate will time out at 1137.966098s 2026-02-17T11:57:48.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff7f0152660 0x7ff7f0140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:48.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f4b6e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff7f0152a40 0x7ff7f01466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:48.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff7f0152660 0x7ff7f0140de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:49302/0 (socket says 10.20.193.10:49302) 2026-02-17T11:57:48.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 1 -- 10.20.193.10:0/2870302264 learned_addr learned my addr 10.20.193.10:0/2870302264 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:48.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 10 monclient(hunting): get_auth_request con 0x7ff7f0152660 auth_method 0 2026-02-17T11:57:48.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:48.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:48.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:48.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f4b6e640 10 monclient(hunting): get_auth_request con 0x7ff7f0152a40 auth_method 0 2026-02-17T11:57:48.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f4b6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:48.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f4b6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:48.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f4b6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:48.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:48.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:48.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:48.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7effff640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff7f00c94e0 0x7ff7f013f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:48.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f4b6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:48.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f4b6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:48.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.244+0000 7ff7f4b6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.245+0000 7ff7effff640 10 monclient(hunting): get_auth_request con 0x7ff7f00c94e0 auth_method 0 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.245+0000 7ff7effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.245+0000 7ff7effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.245+0000 7ff7effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.245+0000 7ff7effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.245+0000 7ff7effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.245+0000 7ff7effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 10 monclient(hunting): handle_auth_done global_id 4731 payload 824 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 1 -- 10.20.193.10:0/2870302264 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff7f00c94e0 msgr2=0x7ff7f013f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:48.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff7f00c94e0 0x7ff7f013f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 1 -- 10.20.193.10:0/2870302264 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff7f0152a40 msgr2=0x7ff7f01466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff7f0152a40 0x7ff7f01466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 1 monclient: found mon.noname-a 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.246+0000 7ff7ef7fe640 1 -- 10.20.193.10:0/2870302264 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f0140090 con 0x7ff7f0152660 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.247+0000 7ff7ef7fe640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff7f0152660 0x7ff7f0140de0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c4d0 tx=0x7ff7e000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.247+0000 7ff7ecff9640 10 client.?.objecter ms_handle_connect 0x7ff7f0152660 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.247+0000 7ff7ecff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 1 -- 10.20.193.10:0/2870302264 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0006ad0 con 0x7ff7f0152660 2026-02-17T11:57:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 10 monclient: dump: 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:48.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 10 monclient: _finish_auth 0 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 10 monclient: _check_auth_tickets 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 1 -- 10.20.193.10:0/2870302264 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e0006c70 con 0x7ff7f0152660 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 1 -- 10.20.193.10:0/2870302264 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0006e60 con 0x7ff7f0152660 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ecff9640 10 monclient: dump: 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:48.266 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7ee7fc640 4 set_mon_vals no callback set 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7f65f8640 5 monclient: authenticate success, global_id 4731 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7f65f8640 10 monclient: _renew_subs 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7f65f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.248+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f0141320 con 0x7ff7f0152660 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.249+0000 7ff7f65f8640 10 client.4731.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:48.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.249+0000 7ff7f65f8640 10 monclient: _renew_subs 2026-02-17T11:57:48.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.249+0000 7ff7f65f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:48.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.249+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f0140300 con 0x7ff7f0152660 2026-02-17T11:57:48.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.249+0000 7ff7f65f8640 1 librados: init done 2026-02-17T11:57:48.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.249+0000 7ff7f65f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:48.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.249+0000 7ff7f65f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:48.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.249+0000 7ff7f65f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:48.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.249+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f0162fc0 con 0x7ff7f0152660 2026-02-17T11:57:48.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.261+0000 7ff7ecff9640 1 -- 10.20.193.10:0/2870302264 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7ff7e0007250 con 0x7ff7f0152660 2026-02-17T11:57:48.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.261+0000 7ff7ecff9640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff7c0078e00 0x7ff7c007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:48.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.261+0000 7ff7effff640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff7c0078e00 0x7ff7c007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:48.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.261+0000 7ff7effff640 10 monclient: get_auth_request con 0x7ff7c0078e00 auth_method 0 2026-02-17T11:57:48.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.262+0000 7ff7effff640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff7c0078e00 0x7ff7c007b2c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff7f01f1470 tx=0x7ff7dc009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:48.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.262+0000 7ff7ecff9640 10 client.4731.objecter ms_handle_connect 0x7ff7c0078e00 2026-02-17T11:57:48.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.363+0000 7ff7ecff9640 1 -- 10.20.193.10:0/2870302264 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff7e0097710 con 0x7ff7f0152660 2026-02-17T11:57:48.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.363+0000 7ff7ecff9640 10 client.4731.objecter ms_dispatch2 0x7ff7f0000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:48.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.363+0000 7ff7ecff9640 3 client.4731.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:48.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.363+0000 7ff7ecff9640 3 client.4731.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:48.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.363+0000 7ff7ecff9640 20 client.4731.objecter dump_active .. 0 homeless 2026-02-17T11:57:48.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.363+0000 7ff7ecff9640 1 -- 10.20.193.10:0/2870302264 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff7f0162fc0 con 0x7ff7f0152660 2026-02-17T11:57:48.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.363+0000 7ff7ecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:48.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.363+0000 7ff7ecff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:48.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.466+0000 7ff7f65f8640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:48.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.466+0000 7ff7f65f8640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:48.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.466+0000 7ff7f65f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:48.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.467+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff7f015a920 con 0x7ff7f0152660 2026-02-17T11:57:48.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.470+0000 7ff7ecff9640 1 -- 10.20.193.10:0/2870302264 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7ff7e0061ee0 con 0x7ff7f0152660 2026-02-17T11:57:48.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.470+0000 7ff7ecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:48.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.470+0000 7ff7ecff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:48.472 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:48.472 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:48.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.471+0000 7ff7f65f8640 10 librados: watch_flush enter 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 10 librados: watch_flush exit 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 20 client.4731.objecter shutdown clearing up homeless session... 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 10 client.4731.objecter successfully canceled tick 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff7c0078e00 msgr2=0x7ff7c007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff7c0078e00 0x7ff7c007b2c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff7f01f1470 tx=0x7ff7dc009290 comp rx=0 tx=0).stop 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 10 monclient: shutdown 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff7f0152660 msgr2=0x7ff7f0140de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff7f0152660 0x7ff7f0140de0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c4d0 tx=0x7ff7e000c9a0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 shutdown_connections 2026-02-17T11:57:48.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff7c0078e00 0x7ff7c007b2c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff7f0152a40 0x7ff7f01466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff7f0152660 0x7ff7f0140de0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 --2- 10.20.193.10:0/2870302264 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff7f00c94e0 0x7ff7f013f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:48.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 >> 10.20.193.10:0/2870302264 conn(0x7ff7f00c9d80 msgr2=0x7ff7f0147920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:48.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 shutdown_connections 2026-02-17T11:57:48.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 -- 10.20.193.10:0/2870302264 wait complete. 2026-02-17T11:57:48.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:48.472+0000 7ff7f65f8640 1 librados: shutdown 2026-02-17T11:57:51.483 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:51.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.549+0000 7f7f89153640 10 monclient: get_monmap_and_config 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.549+0000 7f7f89153640 10 monclient: build_initial_monmap 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.549+0000 7f7f89153640 10 monclient: monmap: 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:51.550806+0000 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:51.550806+0000 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:51.552 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:51.553 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:51.553 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:51.553 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:51.553 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:51.553 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:51.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.549+0000 7f7f89153640 1 Processor -- start 2026-02-17T11:57:51.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 1 -- start start 2026-02-17T11:57:51.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 10 monclient: init 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 10 monclient: _add_conns ranks=[2,0,1,4,5,3] 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7f8415d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7f840c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f7f84153d60 addr v1:10.20.193.71:6789/0 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f840c58a0 con 0x7f7f840c92f0 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f840c55c0 con 0x7f7f84153d60 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f840c7e20 con 0x7f7f8415d220 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.550+0000 7f7f89153640 10 monclient(hunting): authenticate will time out at 1141.272559s 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.551+0000 7f7f82575640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f7f840c92f0 0x7f7f84153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:43510/0 (socket says 10.20.193.10:43510) 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.551+0000 7f7f82575640 1 -- 10.20.193.10:0/3977801595 learned_addr learned my addr 10.20.193.10:0/3977801595 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:51.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266728454 0 0) 0x7f7f840c58a0 con 0x7f7f840c92f0 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): _negotiate 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): my global_id is 4734 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f70003620 con 0x7f7f840c92f0 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3039819422 0 0) 0x7f7f840c7e20 con 0x7f7f8415d220 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): _negotiate 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): my global_id is 4799 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f840c58a0 con 0x7f7f8415d220 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326720107 0 0) 0x7f7f840c55c0 con 0x7f7f84153d60 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): _negotiate 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:51.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 10 monclient(hunting): my global_id is 4750 2026-02-17T11:57:51.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.552+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f840c7e20 con 0x7f7f84153d60 2026-02-17T11:57:51.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3675677498 0 0) 0x7f7f70003620 con 0x7f7f840c92f0 2026-02-17T11:57:51.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 >> v1:10.20.193.153:6789/0 conn(0x7f7f8415d220 legacy=0x7f7f840c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:51.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 >> v1:10.20.193.71:6789/0 conn(0x7f7f84153d60 legacy=0x7f7f840c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:51.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient: _finish_hunting 0 2026-02-17T11:57:51.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:57:51.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:51.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:57:51.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f840c8100 con 0x7f7f840c92f0 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient: _finish_auth 0 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient: _check_auth_tickets 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f7f6c002f00 con 0x7f7f840c92f0 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient: dump: 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:51.561 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 >> v1:10.20.193.10:6789/0 conn(0x7f7f840c92f0 legacy=0x7f7f84153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7f70003fe0 0x7f7f70004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient(hunting): picked mon.b con 0x7f7f70003fe0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f70004e40 0x7f7f700052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient(hunting): picked mon.a con 0x7f7f70004e40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 0x7f7f7000bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient(hunting): picked mon.c con 0x7f7f70009ab0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7000c570 con 0x7f7f70004e40 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:51.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7000c6f0 con 0x7f7f70003fe0 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7000c8f0 con 0x7f7f70009ab0 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.554+0000 7f7f81d74640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f83577640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 0x7f7f7000bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f82575640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f70004e40 0x7f7f700052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f82d76640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7f70003fe0 0x7f7f70004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f82d76640 10 monclient(hunting): get_auth_request con 0x7f7f70003fe0 auth_method 0 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f82d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f83577640 10 monclient(hunting): get_auth_request con 0x7f7f70009ab0 auth_method 0 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f83577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f83577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f83577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f83577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f83577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f83577640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.555+0000 7f7f82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.556+0000 7f7f82d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.556+0000 7f7f82575640 10 monclient(hunting): get_auth_request con 0x7f7f70004e40 auth_method 0 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.556+0000 7f7f82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.556+0000 7f7f82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.556+0000 7f7f82575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.556+0000 7f7f82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.556+0000 7f7f82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.556+0000 7f7f82575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 10 monclient(hunting): handle_auth_done global_id 4734 payload 293 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 1 -- 10.20.193.10:0/3977801595 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7f70003fe0 msgr2=0x7f7f70004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:51.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7f70003fe0 0x7f7f70004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 1 -- 10.20.193.10:0/3977801595 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f70004e40 msgr2=0x7f7f700052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f70004e40 0x7f7f700052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 10 monclient: _finish_hunting 0 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 1 monclient: found mon.c 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 1 -- 10.20.193.10:0/3977801595 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f70003620 con 0x7f7f70009ab0 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 10 monclient: _finish_auth 0 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 10 monclient: _check_auth_tickets 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f89153640 5 monclient: authenticate success, global_id 4734 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f89153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.557+0000 7f7f83577640 1 -- 10.20.193.10:0/3977801595 reap_dead start 2026-02-17T11:57:51.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.558+0000 7f7f83577640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 0x7f7f7000bea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c320 tx=0x7f7f7402f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd617b26e07079b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.559+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74003860 con 0x7f7f70009ab0 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.559+0000 7f7f81d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.559+0000 7f7f81d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.559+0000 7f7f81d74640 10 monclient: dump: 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.559+0000 7f7f89153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f74003c70 con 0x7f7f70009ab0 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f81d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f81d74640 1 -- 10.20.193.10:0/3977801595 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74005310 con 0x7f7f70009ab0 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f81d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f81d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f81d74640 10 monclient: dump: 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.571 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 4 set_mon_vals no callback set 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 10 monclient: shutdown 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 1 -- 10.20.193.10:0/3977801595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 msgr2=0x7f7f7000bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 0x7f7f7000bea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c320 tx=0x7f7f7402f610 comp rx=0 tx=0).stop 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 1 -- 10.20.193.10:0/3977801595 shutdown_connections 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 1 --2- 10.20.193.10:0/3977801595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 0x7f7f7000bea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 1 -- 10.20.193.10:0/3977801595 >> 10.20.193.10:0/3977801595 conn(0x7f7f840c9d80 msgr2=0x7f7f840ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 1 -- 10.20.193.10:0/3977801595 shutdown_connections 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.560+0000 7f7f89153640 1 -- 10.20.193.10:0/3977801595 wait complete. 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient: build_initial_monmap 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient: monmap: 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 librados: starting msgr at 2026-02-17T11:57:51.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 librados: starting objecter 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 Processor -- start 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 -- start start 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 librados: setting wanted keys 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 librados: calling monclient init 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient: init 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 0x7f7f841456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient(hunting): picked mon.noname-c con 0x7f7f70009ab0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7f84073aa0 0x7f7f84073f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient(hunting): picked mon.noname-b con 0x7f7f84073aa0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f841f4de0 0x7f7f841f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient(hunting): picked mon.noname-a con 0x7f7f841f4de0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8415d600 con 0x7f7f841f4de0 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f840c86c0 con 0x7f7f84073aa0 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8415d780 con 0x7f7f70009ab0 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.561+0000 7f7f89153640 10 monclient(hunting): authenticate will time out at 1141.283780s 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f841f4de0 0x7f7f841f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82d76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 0x7f7f841456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7f84073aa0 0x7f7f84073f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f841f4de0 0x7f7f841f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:49318/0 (socket says 10.20.193.10:49318) 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 1 -- 10.20.193.10:0/3807594801 learned_addr learned my addr 10.20.193.10:0/3807594801 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 10 monclient(hunting): get_auth_request con 0x7f7f841f4de0 auth_method 0 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82d76640 10 monclient(hunting): get_auth_request con 0x7f7f70009ab0 auth_method 0 2026-02-17T11:57:51.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82575640 10 monclient(hunting): get_auth_request con 0x7f7f84073aa0 auth_method 0 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f83577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.562+0000 7f7f82575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 10 monclient(hunting): handle_auth_done global_id 4737 payload 824 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 1 -- 10.20.193.10:0/3807594801 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 msgr2=0x7f7f841456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 0x7f7f841456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 1 -- 10.20.193.10:0/3807594801 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7f84073aa0 msgr2=0x7f7f84073f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7f84073aa0 0x7f7f84073f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 10 monclient: _finish_hunting 0 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 1 monclient: found mon.noname-a 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.563+0000 7f7f83577640 1 -- 10.20.193.10:0/3807594801 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f841f57b0 con 0x7f7f841f4de0 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.564+0000 7f7f83577640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f841f4de0 0x7f7f841f5270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7f7402fb20 tx=0x7f7f74002e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.564+0000 7f7f637fe640 10 client.?.objecter ms_handle_connect 0x7f7f841f4de0 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.564+0000 7f7f637fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 1 -- 10.20.193.10:0/3807594801 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74046070 con 0x7f7f841f4de0 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 10 monclient: dump: 2026-02-17T11:57:51.574 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 1 -- 10.20.193.10:0/3807594801 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f74003a70 con 0x7f7f841f4de0 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 1 -- 10.20.193.10:0/3807594801 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74003860 con 0x7f7f841f4de0 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f637fe640 10 monclient: dump: 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f89153640 5 monclient: authenticate success, global_id 4737 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f81573640 4 set_mon_vals no callback set 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f89153640 10 monclient: _renew_subs 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f89153640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:51.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f841f5ce0 con 0x7f7f841f4de0 2026-02-17T11:57:51.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f89153640 10 client.4737.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:51.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f89153640 10 monclient: _renew_subs 2026-02-17T11:57:51.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f89153640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:51.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f84072a00 con 0x7f7f841f4de0 2026-02-17T11:57:51.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.566+0000 7f7f89153640 1 librados: init done 2026-02-17T11:57:51.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.567+0000 7f7f89153640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:51.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.567+0000 7f7f89153640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:51.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.567+0000 7f7f89153640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:51.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.567+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f84074920 con 0x7f7f841f4de0 2026-02-17T11:57:51.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.579+0000 7f7f637fe640 1 -- 10.20.193.10:0/3807594801 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f7f7403f880 con 0x7f7f841f4de0 2026-02-17T11:57:51.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.580+0000 7f7f637fe640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7f50078e00 0x7f7f5007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:51.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.580+0000 7f7f82d76640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7f50078e00 0x7f7f5007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:51.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.580+0000 7f7f82d76640 10 monclient: get_auth_request con 0x7f7f50078e00 auth_method 0 2026-02-17T11:57:51.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.580+0000 7f7f82d76640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7f50078e00 0x7f7f5007b2c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7f78002910 tx=0x7f7f78007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:51.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.580+0000 7f7f637fe640 10 client.4737.objecter ms_handle_connect 0x7f7f50078e00 2026-02-17T11:57:51.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.582+0000 7f7f637fe640 1 -- 10.20.193.10:0/3807594801 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f7f74082a20 con 0x7f7f841f4de0 2026-02-17T11:57:51.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.582+0000 7f7f637fe640 10 client.4737.objecter ms_dispatch2 0x7f7f84000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:51.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.582+0000 7f7f637fe640 3 client.4737.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:51.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.582+0000 7f7f637fe640 3 client.4737.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:51.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.582+0000 7f7f637fe640 20 client.4737.objecter dump_active .. 0 homeless 2026-02-17T11:57:51.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.686+0000 7f7f637fe640 1 -- 10.20.193.10:0/3807594801 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7f841f57b0 con 0x7f7f841f4de0 2026-02-17T11:57:51.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.686+0000 7f7f637fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:51.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.686+0000 7f7f637fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:51.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.787+0000 7f7f89153640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:51.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.787+0000 7f7f89153640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:51.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.787+0000 7f7f89153640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:51.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.787+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7f840c9b60 con 0x7f7f841f4de0 2026-02-17T11:57:51.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.791+0000 7f7f637fe640 1 -- 10.20.193.10:0/3807594801 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f7f74003e20 con 0x7f7f841f4de0 2026-02-17T11:57:51.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.791+0000 7f7f637fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:51.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.791+0000 7f7f637fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:51.793 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:51.793 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:51.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 10 librados: watch_flush enter 2026-02-17T11:57:51.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 10 librados: watch_flush exit 2026-02-17T11:57:51.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 20 client.4737.objecter shutdown clearing up homeless session... 2026-02-17T11:57:51.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 10 client.4737.objecter successfully canceled tick 2026-02-17T11:57:51.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7f50078e00 msgr2=0x7f7f5007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:51.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7f50078e00 0x7f7f5007b2c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7f78002910 tx=0x7f7f78007dc0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 10 monclient: shutdown 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f841f4de0 msgr2=0x7f7f841f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f841f4de0 0x7f7f841f5270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7f7402fb20 tx=0x7f7f74002e40 comp rx=0 tx=0).stop 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 shutdown_connections 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7f50078e00 0x7f7f5007b2c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7f841f4de0 0x7f7f841f5270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7f84073aa0 0x7f7f84073f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 --2- 10.20.193.10:0/3807594801 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7f70009ab0 0x7f7f841456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 >> 10.20.193.10:0/3807594801 conn(0x7f7f840c9d80 msgr2=0x7f7f84153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 shutdown_connections 2026-02-17T11:57:51.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 -- 10.20.193.10:0/3807594801 wait complete. 2026-02-17T11:57:51.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:51.792+0000 7f7f89153640 1 librados: shutdown 2026-02-17T11:57:54.803 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:54.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.869+0000 7faa96ad1640 10 monclient: get_monmap_and_config 2026-02-17T11:57:54.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.869+0000 7faa96ad1640 10 monclient: build_initial_monmap 2026-02-17T11:57:54.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.869+0000 7faa96ad1640 10 monclient: monmap: 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:54.870713+0000 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:54.870713+0000 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:54.872 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:54.873 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:54.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 1 Processor -- start 2026-02-17T11:57:54.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 1 -- start start 2026-02-17T11:57:54.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient: init 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient: _add_conns ranks=[2,5,3,4,0,1] 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7faa90155e80 addr v1:10.20.193.153:6789/0 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7faa90074cd0 0x7faa900ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient(hunting): picked mon.noname-c con 0x7faa90074cd0 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7faa90156260 0x7faa900cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient(hunting): picked mon.noname-a con 0x7faa90156260 addr v2:10.20.193.10:3300/0 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa90073520 con 0x7faa90155e80 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7faa900cd840 con 0x7faa90156260 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7faa90073800 con 0x7faa90074cd0 2026-02-17T11:57:54.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.870+0000 7faa96ad1640 10 monclient(hunting): authenticate will time out at 1144.592717s 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa95047640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7faa90156260 0x7faa900cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa87fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7faa90074cd0 0x7faa900ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa94846640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7faa90155e80 0x7faa900745c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:36532/0 (socket says 10.20.193.10:36532) 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa94846640 1 -- 10.20.193.10:0/2464721280 learned_addr learned my addr 10.20.193.10:0/2464721280 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa95047640 10 monclient(hunting): get_auth_request con 0x7faa90156260 auth_method 0 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa95047640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa95047640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa95047640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa87fff640 10 monclient(hunting): get_auth_request con 0x7faa90074cd0 auth_method 0 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:54.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa95047640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa95047640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.871+0000 7faa95047640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa95047640 10 monclient(hunting): handle_auth_done global_id 4740 payload 274 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa95047640 1 -- 10.20.193.10:0/2464721280 >> v2:10.20.193.153:3300/0 conn(0x7faa90074cd0 msgr2=0x7faa900ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa95047640 1 --2- 10.20.193.10:0/2464721280 >> v2:10.20.193.153:3300/0 conn(0x7faa90074cd0 0x7faa900ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa95047640 1 -- 10.20.193.10:0/2464721280 >> v1:10.20.193.153:6789/0 conn(0x7faa90155e80 legacy=0x7faa900745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa95047640 10 monclient: _finish_hunting 0 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa95047640 1 monclient: found mon.noname-a 2026-02-17T11:57:54.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa95047640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:54.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa95047640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:54.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.872+0000 7faa95047640 1 -- 10.20.193.10:0/2464721280 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa90073ae0 con 0x7faa90156260 2026-02-17T11:57:54.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.873+0000 7faa95047640 1 --2- 10.20.193.10:0/2464721280 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90156260 0x7faa900cd100 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa9008f5e0 tx=0x7faa8c02f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb0f664573f67f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:54.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 1 -- 10.20.193.10:0/2464721280 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c03c070 con 0x7faa90156260 2026-02-17T11:57:54.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:54.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 10 monclient: dump: 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:54.887 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 10 monclient: _finish_auth 0 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 10 monclient: _check_auth_tickets 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 1 -- 10.20.193.10:0/2464721280 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c037440 con 0x7faa90156260 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa96ad1640 5 monclient: authenticate success, global_id 4740 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 1 -- 10.20.193.10:0/2464721280 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c037810 con 0x7faa90156260 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa877fe640 10 monclient: dump: 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:54.888 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa96ad1640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa96ad1640 4 set_mon_vals no callback set 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa96ad1640 10 monclient: shutdown 2026-02-17T11:57:54.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa96ad1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa96ad1640 1 -- 10.20.193.10:0/2464721280 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90156260 msgr2=0x7faa900cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.875+0000 7faa96ad1640 1 --2- 10.20.193.10:0/2464721280 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90156260 0x7faa900cd100 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa9008f5e0 tx=0x7faa8c02f1c0 comp rx=0 tx=0).stop 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 -- 10.20.193.10:0/2464721280 shutdown_connections 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 --2- 10.20.193.10:0/2464721280 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90156260 0x7faa900cd100 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 --2- 10.20.193.10:0/2464721280 >> v2:10.20.193.153:3300/0 conn(0x7faa90074cd0 0x7faa900ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 -- 10.20.193.10:0/2464721280 >> 10.20.193.10:0/2464721280 conn(0x7faa900ce2b0 msgr2=0x7faa900ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 -- 10.20.193.10:0/2464721280 shutdown_connections 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 -- 10.20.193.10:0/2464721280 wait complete. 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 10 monclient: build_initial_monmap 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 10 monclient: monmap: 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:54.890 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 librados: starting msgr at 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 librados: starting objecter 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 Processor -- start 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 -- start start 2026-02-17T11:57:54.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 librados: setting wanted keys 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 1 librados: calling monclient init 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.876+0000 7faa96ad1640 10 monclient: init 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa90074cd0 0x7faa90150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient(hunting): picked mon.noname-c con 0x7faa90074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90155e80 0x7faa9013f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient(hunting): picked mon.noname-a con 0x7faa90155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faa90156260 0x7faa901517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient(hunting): picked mon.noname-b con 0x7faa90156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:54.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7faa900c4870 con 0x7faa90155e80 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa900740a0 con 0x7faa90156260 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa900c49f0 con 0x7faa90074cd0 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa96ad1640 10 monclient(hunting): authenticate will time out at 1144.599238s 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90155e80 0x7faa9013f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa94846640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa90074cd0 0x7faa90150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90155e80 0x7faa9013f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38682/0 (socket says 10.20.193.10:38682) 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 1 -- 10.20.193.10:0/441343670 learned_addr learned my addr 10.20.193.10:0/441343670 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 10 monclient(hunting): get_auth_request con 0x7faa90155e80 auth_method 0 2026-02-17T11:57:54.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa94846640 10 monclient(hunting): get_auth_request con 0x7faa90074cd0 auth_method 0 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa94846640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa94846640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa94846640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa95047640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faa90156260 0x7faa901517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa95047640 10 monclient(hunting): get_auth_request con 0x7faa90156260 auth_method 0 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa95047640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:54.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa95047640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa95047640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa94846640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa94846640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.877+0000 7faa94846640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.878+0000 7faa95047640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.878+0000 7faa95047640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.878+0000 7faa95047640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 10 monclient(hunting): handle_auth_done global_id 4743 payload 824 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 1 -- 10.20.193.10:0/441343670 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa90074cd0 msgr2=0x7faa90150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa90074cd0 0x7faa90150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 1 -- 10.20.193.10:0/441343670 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faa90156260 msgr2=0x7faa901517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faa90156260 0x7faa901517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 1 monclient: found mon.noname-a 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.879+0000 7faa87fff640 1 -- 10.20.193.10:0/441343670 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa901512e0 con 0x7faa90155e80 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.880+0000 7faa87fff640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90155e80 0x7faa9013f6f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa7800ec10 tx=0x7faa7800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.880+0000 7faa857fa640 10 client.?.objecter ms_handle_connect 0x7faa90155e80 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.880+0000 7faa857fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 1 -- 10.20.193.10:0/441343670 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78017070 con 0x7faa90155e80 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 10 monclient: dump: 2026-02-17T11:57:54.896 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 10 monclient: _finish_auth 0 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 10 monclient: _check_auth_tickets 2026-02-17T11:57:54.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 1 -- 10.20.193.10:0/441343670 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7800cc40 con 0x7faa90155e80 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 1 -- 10.20.193.10:0/441343670 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78013470 con 0x7faa90155e80 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa857fa640 10 monclient: dump: 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:54.898 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa86ffd640 4 set_mon_vals no callback set 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa96ad1640 5 monclient: authenticate success, global_id 4743 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa96ad1640 10 monclient: _renew_subs 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa96ad1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa900c9620 con 0x7faa90155e80 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa96ad1640 10 client.4743.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa96ad1640 10 monclient: _renew_subs 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa96ad1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:54.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa901502c0 con 0x7faa90155e80 2026-02-17T11:57:54.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.881+0000 7faa96ad1640 1 librados: init done 2026-02-17T11:57:54.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.882+0000 7faa96ad1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:54.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.882+0000 7faa96ad1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:54.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.882+0000 7faa96ad1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:54.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.882+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa900745c0 con 0x7faa90155e80 2026-02-17T11:57:54.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.893+0000 7faa857fa640 1 -- 10.20.193.10:0/441343670 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7faa78024060 con 0x7faa90155e80 2026-02-17T11:57:54.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.894+0000 7faa857fa640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faa60078e30 0x7faa6007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:54.901 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.894+0000 7faa94846640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faa60078e30 0x7faa6007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:54.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.894+0000 7faa94846640 10 monclient: get_auth_request con 0x7faa60078e30 auth_method 0 2026-02-17T11:57:54.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.894+0000 7faa94846640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faa60078e30 0x7faa6007b2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faa80002770 tx=0x7faa80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:54.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.894+0000 7faa857fa640 10 client.4743.objecter ms_handle_connect 0x7faa60078e30 2026-02-17T11:57:54.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.896+0000 7faa857fa640 1 -- 10.20.193.10:0/441343670 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7faa7805e200 con 0x7faa90155e80 2026-02-17T11:57:54.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.896+0000 7faa857fa640 10 client.4743.objecter ms_dispatch2 0x7faa90000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:54.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.896+0000 7faa857fa640 3 client.4743.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:54.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.896+0000 7faa857fa640 3 client.4743.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:54.902 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.896+0000 7faa857fa640 20 client.4743.objecter dump_active .. 0 homeless 2026-02-17T11:57:54.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.994+0000 7faa857fa640 1 -- 10.20.193.10:0/441343670 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faa780621c0 con 0x7faa90155e80 2026-02-17T11:57:54.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.994+0000 7faa857fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:54.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:54.994+0000 7faa857fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:55.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.094+0000 7faa96ad1640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:55.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.094+0000 7faa96ad1640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:55.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.094+0000 7faa96ad1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:57:55.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.094+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faa901500f0 con 0x7faa90155e80 2026-02-17T11:57:55.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.110+0000 7faa857fa640 1 -- 10.20.193.10:0/441343670 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7faa780664c0 con 0x7faa90155e80 2026-02-17T11:57:55.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.110+0000 7faa857fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:55.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.110+0000 7faa857fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:55.113 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:55.113 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:55.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 10 librados: watch_flush enter 2026-02-17T11:57:55.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 10 librados: watch_flush exit 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 20 client.4743.objecter shutdown clearing up homeless session... 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 10 client.4743.objecter successfully canceled tick 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faa60078e30 msgr2=0x7faa6007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faa60078e30 0x7faa6007b2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faa80002770 tx=0x7faa80009040 comp rx=0 tx=0).stop 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 10 monclient: shutdown 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90155e80 msgr2=0x7faa9013f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90155e80 0x7faa9013f6f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa7800ec10 tx=0x7faa7800c520 comp rx=0 tx=0).stop 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 shutdown_connections 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faa60078e30 0x7faa6007b2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faa90156260 0x7faa901517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faa90155e80 0x7faa9013f6f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 --2- 10.20.193.10:0/441343670 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa90074cd0 0x7faa90150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 >> 10.20.193.10:0/441343670 conn(0x7faa900ce2b0 msgr2=0x7faa900ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 shutdown_connections 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 -- 10.20.193.10:0/441343670 wait complete. 2026-02-17T11:57:55.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:55.112+0000 7faa96ad1640 1 librados: shutdown 2026-02-17T11:57:58.123 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:57:58.194 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.191+0000 7fb23e087640 10 monclient: get_monmap_and_config 2026-02-17T11:57:58.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.191+0000 7fb23e087640 10 monclient: build_initial_monmap 2026-02-17T11:57:58.195 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.191+0000 7fb23e087640 10 monclient: monmap: 2026-02-17T11:57:58.195 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:58.195 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:58.195 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:57:58.192659+0000 2026-02-17T11:57:58.195 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:57:58.192659+0000 2026-02-17T11:57:58.195 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:58.195 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.191+0000 7fb23e087640 1 Processor -- start 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.191+0000 7fb23e087640 1 -- start start 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.191+0000 7fb23e087640 10 monclient: init 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:58.196 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 10 monclient: _add_conns ranks=[1,4,5,3,0,2] 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb238152660 addr v1:10.20.193.71:6789/0 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fb23815b030 0x7fb2380c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 10 monclient(hunting): picked mon.noname-b con 0x7fb23815b030 addr v2:10.20.193.71:3300/0 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fb238152a40 0x7fb2380c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 10 monclient(hunting): picked mon.noname-c con 0x7fb238152a40 addr v2:10.20.193.153:3300/0 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2380c71e0 con 0x7fb238152660 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb2380c77a0 con 0x7fb23815b030 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb2380c74c0 con 0x7fb238152a40 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:58.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.192+0000 7fb23e087640 10 monclient(hunting): authenticate will time out at 1147.914457s 2026-02-17T11:57:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb236ffd640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fb23815b030 0x7fb2380c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fb238152a40 0x7fb2380c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fb238152a40 0x7fb2380c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36136/0 (socket says 10.20.193.10:36136) 2026-02-17T11:57:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 1 -- 10.20.193.10:0/3184818240 learned_addr learned my addr 10.20.193.10:0/3184818240 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 10 monclient(hunting): get_auth_request con 0x7fb238152a40 auth_method 0 2026-02-17T11:57:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb236ffd640 10 monclient(hunting): get_auth_request con 0x7fb23815b030 auth_method 0 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb236ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb236ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb236ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb237fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb236ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb236ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:58.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.219+0000 7fb236ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:58.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.220+0000 7fb237fff640 10 monclient(hunting): handle_auth_done global_id 4814 payload 274 2026-02-17T11:57:58.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.220+0000 7fb237fff640 1 -- 10.20.193.10:0/3184818240 >> v2:10.20.193.71:3300/0 conn(0x7fb23815b030 msgr2=0x7fb2380c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:57:58.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.220+0000 7fb237fff640 1 --2- 10.20.193.10:0/3184818240 >> v2:10.20.193.71:3300/0 conn(0x7fb23815b030 0x7fb2380c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.220+0000 7fb237fff640 1 -- 10.20.193.10:0/3184818240 >> v1:10.20.193.71:6789/0 conn(0x7fb238152660 legacy=0x7fb23815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.220+0000 7fb237fff640 10 monclient: _finish_hunting 0 2026-02-17T11:57:58.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.220+0000 7fb237fff640 1 monclient: found mon.noname-c 2026-02-17T11:57:58.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.220+0000 7fb237fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:58.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.220+0000 7fb237fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:57:58.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.220+0000 7fb237fff640 1 -- 10.20.193.10:0/3184818240 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb238159e40 con 0x7fb238152a40 2026-02-17T11:57:58.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.221+0000 7fb237fff640 1 --2- 10.20.193.10:0/3184818240 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb238152a40 0x7fb2380c9310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb238072150 tx=0x7fb22c02f270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fca936c9a00293e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:58.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 1 -- 10.20.193.10:0/3184818240 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c02fd70 con 0x7fb238152a40 2026-02-17T11:57:58.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:58.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:57:58.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 10 monclient: dump: 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:58.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 10 monclient: _finish_auth 0 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 10 monclient: _check_auth_tickets 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 1 -- 10.20.193.10:0/3184818240 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c0373f0 con 0x7fb238152a40 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb23e087640 5 monclient: authenticate success, global_id 4814 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb23e087640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 1 -- 10.20.193.10:0/3184818240 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0377c0 con 0x7fb238152a40 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb2367fc640 10 monclient: dump: 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:58.232 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb23e087640 10 monclient: get_monmap_and_config success 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.223+0000 7fb23e087640 4 set_mon_vals no callback set 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 10 monclient: shutdown 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:58.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 -- 10.20.193.10:0/3184818240 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb238152a40 msgr2=0x7fb2380c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 --2- 10.20.193.10:0/3184818240 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb238152a40 0x7fb2380c9310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb238072150 tx=0x7fb22c02f270 comp rx=0 tx=0).stop 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 -- 10.20.193.10:0/3184818240 shutdown_connections 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 --2- 10.20.193.10:0/3184818240 >> v2:10.20.193.71:3300/0 conn(0x7fb23815b030 0x7fb2380c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 --2- 10.20.193.10:0/3184818240 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb238152a40 0x7fb2380c9310 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 -- 10.20.193.10:0/3184818240 >> 10.20.193.10:0/3184818240 conn(0x7fb2380c9d80 msgr2=0x7fb2380ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 -- 10.20.193.10:0/3184818240 shutdown_connections 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 -- 10.20.193.10:0/3184818240 wait complete. 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 10 monclient: build_initial_monmap 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 10 monclient: monmap: 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:57:58.234 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 librados: starting msgr at 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 librados: starting objecter 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 Processor -- start 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 -- start start 2026-02-17T11:57:58.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 librados: setting wanted keys 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 1 librados: calling monclient init 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.224+0000 7fb23e087640 10 monclient: init 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient: _reopen_session rank -1 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb238152660 0x7fb23814b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient(hunting): picked mon.noname-a con 0x7fb238152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb238152a40 0x7fb2381f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient(hunting): picked mon.noname-b con 0x7fb238152a40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb23815b030 0x7fb2381f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient(hunting): picked mon.noname-c con 0x7fb23815b030 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fb2380c5cd0 con 0x7fb238152660 2026-02-17T11:57:58.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb23815a400 con 0x7fb238152a40 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient(hunting): start opening mon connection 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2380c5e50 con 0x7fb23815b030 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient(hunting): _renew_subs 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb23e087640 10 monclient(hunting): authenticate will time out at 1147.947426s 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb238152a40 0x7fb2381f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb2377fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb238152660 0x7fb23814b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb237fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb23815b030 0x7fb2381f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb238152a40 0x7fb2381f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:60772/0 (socket says 10.20.193.10:60772) 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 1 -- 10.20.193.10:0/2841069503 learned_addr learned my addr 10.20.193.10:0/2841069503 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 10 monclient(hunting): get_auth_request con 0x7fb238152a40 auth_method 0 2026-02-17T11:57:58.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb237fff640 10 monclient(hunting): get_auth_request con 0x7fb23815b030 auth_method 0 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb237fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb237fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb237fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb2377fe640 10 monclient(hunting): get_auth_request con 0x7fb238152660 auth_method 0 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb2377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb2377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:57:58.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb2377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb236ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb237fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb237fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb237fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb2377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb2377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.226+0000 7fb2377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 10 monclient(hunting): handle_auth_done global_id 4765 payload 824 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 1 -- 10.20.193.10:0/2841069503 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb23815b030 msgr2=0x7fb2381f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb23815b030 0x7fb2381f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 1 -- 10.20.193.10:0/2841069503 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb238152660 msgr2=0x7fb23814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb238152660 0x7fb23814b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 1 monclient: found mon.noname-b 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.227+0000 7fb236ffd640 1 -- 10.20.193.10:0/2841069503 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb238158040 con 0x7fb238152a40 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.228+0000 7fb236ffd640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb238152a40 0x7fb2381f59f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e8c0 tx=0x7fb22800ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.228+0000 7fb213fff640 10 client.?.objecter ms_handle_connect 0x7fb238152a40 2026-02-17T11:57:58.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.228+0000 7fb213fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:57:58.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb213fff640 1 -- 10.20.193.10:0/2841069503 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228017070 con 0x7fb238152a40 2026-02-17T11:57:58.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb213fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:58.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb213fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:57:58.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb213fff640 10 monclient: dump: 2026-02-17T11:57:58.242 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:58.242 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:58.242 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:58.242 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:58.242 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb213fff640 10 monclient: _finish_auth 0 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb213fff640 10 monclient: _check_auth_tickets 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb213fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb23e087640 5 monclient: authenticate success, global_id 4765 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb23e087640 10 monclient: _renew_subs 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb23e087640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb238158320 con 0x7fb238152a40 2026-02-17T11:57:58.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb23e087640 10 client.4765.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb23e087640 10 monclient: _renew_subs 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb23e087640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2381f51f0 con 0x7fb238152a40 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.229+0000 7fb23e087640 1 librados: init done 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb213fff640 1 -- 10.20.193.10:0/2841069503 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22800c940 con 0x7fb238152a40 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb213fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb213fff640 1 -- 10.20.193.10:0/2841069503 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228021060 con 0x7fb238152a40 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb213fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb213fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb213fff640 10 monclient: dump: 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:58.244 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb235ffb640 4 set_mon_vals no callback set 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb23e087640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb23e087640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb23e087640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:58.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.230+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23815cf60 con 0x7fb238152a40 2026-02-17T11:57:58.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.241+0000 7fb213fff640 1 -- 10.20.193.10:0/2841069503 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fb22800ccf0 con 0x7fb238152a40 2026-02-17T11:57:58.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.241+0000 7fb213fff640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb208078e00 0x7fb20807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:57:58.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.243+0000 7fb2377fe640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb208078e00 0x7fb20807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:57:58.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.243+0000 7fb2377fe640 10 monclient: get_auth_request con 0x7fb208078e00 auth_method 0 2026-02-17T11:57:58.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.243+0000 7fb2377fe640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb208078e00 0x7fb20807b2c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb23815bd70 tx=0x7fb224007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:57:58.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.243+0000 7fb213fff640 10 client.4765.objecter ms_handle_connect 0x7fb208078e00 2026-02-17T11:57:58.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.243+0000 7fb213fff640 1 -- 10.20.193.10:0/2841069503 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb228097dc0 con 0x7fb238152a40 2026-02-17T11:57:58.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.243+0000 7fb213fff640 10 client.4765.objecter ms_dispatch2 0x7fb238000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:57:58.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.243+0000 7fb213fff640 3 client.4765.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:57:58.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.243+0000 7fb213fff640 3 client.4765.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:57:58.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.244+0000 7fb213fff640 20 client.4765.objecter dump_active .. 0 homeless 2026-02-17T11:57:58.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.345+0000 7fb213fff640 1 -- 10.20.193.10:0/2841069503 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb23815cf60 con 0x7fb238152a40 2026-02-17T11:57:58.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.345+0000 7fb213fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:57:58.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.345+0000 7fb213fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:57:58.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.444+0000 7fb23e087640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:57:58.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.444+0000 7fb23e087640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:58.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.444+0000 7fb23e087640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:57:58.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.444+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb23815a920 con 0x7fb238152a40 2026-02-17T11:57:58.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.446+0000 7fb213fff640 1 -- 10.20.193.10:0/2841069503 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fb228062480 con 0x7fb238152a40 2026-02-17T11:57:58.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.446+0000 7fb213fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:57:58.448 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.446+0000 7fb213fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:57:58.448 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:57:58.448 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:57:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 10 librados: watch_flush enter 2026-02-17T11:57:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 10 librados: watch_flush exit 2026-02-17T11:57:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 20 client.4765.objecter shutdown clearing up homeless session... 2026-02-17T11:57:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 10 client.4765.objecter successfully canceled tick 2026-02-17T11:57:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb208078e00 msgr2=0x7fb20807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb208078e00 0x7fb20807b2c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb23815bd70 tx=0x7fb224007f50 comp rx=0 tx=0).stop 2026-02-17T11:57:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 10 monclient: shutdown 2026-02-17T11:57:58.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb238152a40 msgr2=0x7fb2381f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb238152a40 0x7fb2381f59f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e8c0 tx=0x7fb22800ed90 comp rx=0 tx=0).stop 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 shutdown_connections 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb208078e00 0x7fb20807b2c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb23815b030 0x7fb2381f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb238152a40 0x7fb2381f59f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 --2- 10.20.193.10:0/2841069503 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb238152660 0x7fb23814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 >> 10.20.193.10:0/2841069503 conn(0x7fb2380c9d80 msgr2=0x7fb238158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 shutdown_connections 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 -- 10.20.193.10:0/2841069503 wait complete. 2026-02-17T11:57:58.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:57:58.448+0000 7fb23e087640 1 librados: shutdown 2026-02-17T11:58:01.458 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:01.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.527+0000 7f1fc49b6640 10 monclient: get_monmap_and_config 2026-02-17T11:58:01.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.527+0000 7f1fc49b6640 10 monclient: build_initial_monmap 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.527+0000 7f1fc49b6640 10 monclient: monmap: 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:01.527790+0000 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:01.527790+0000 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:01.529 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:01.530 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:01.530 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:01.530 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 1 Processor -- start 2026-02-17T11:58:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 1 -- start start 2026-02-17T11:58:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient: init 2026-02-17T11:58:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient: _add_conns ranks=[4,5,3,2,0,1] 2026-02-17T11:58:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1fbc152660 0x7f1fbc15a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient(hunting): picked mon.noname-b con 0x7f1fbc152660 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:01.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1fbc152a40 0x7f1fbc15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient(hunting): picked mon.noname-c con 0x7f1fbc152a40 addr v2:10.20.193.153:3300/0 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f1fbc0c8dd0 0x7f1fbc0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient(hunting): picked mon.noname-a con 0x7f1fbc0c8dd0 addr v2:10.20.193.10:3300/0 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f1fbc0c77a0 con 0x7f1fbc0c8dd0 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1fbc0c71e0 con 0x7f1fbc152660 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1fbc0c74c0 con 0x7f1fbc152a40 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.528+0000 7f1fc49b6640 10 monclient(hunting): authenticate will time out at 1151.249589s 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f1fbc0c8dd0 0x7f1fbc0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:01.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc1f2a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1fbc152a40 0x7f1fbc15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc272b640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1fbc152660 0x7f1fbc15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f1fbc0c8dd0 0x7f1fbc0c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38698/0 (socket says 10.20.193.10:38698) 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 1 -- 10.20.193.10:0/3025880786 learned_addr learned my addr 10.20.193.10:0/3025880786 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 10 monclient(hunting): get_auth_request con 0x7f1fbc0c8dd0 auth_method 0 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc1f2a640 10 monclient(hunting): get_auth_request con 0x7f1fbc152a40 auth_method 0 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc1f2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc1f2a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc1f2a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:01.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc272b640 10 monclient(hunting): get_auth_request con 0x7f1fbc152660 auth_method 0 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc272b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc272b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc272b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc2f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc272b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc272b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc272b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc1f2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc1f2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.529+0000 7f1fc1f2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 10 monclient(hunting): handle_auth_done global_id 4749 payload 274 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 1 -- 10.20.193.10:0/3025880786 >> v2:10.20.193.153:3300/0 conn(0x7f1fbc152a40 msgr2=0x7f1fbc15ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 1 --2- 10.20.193.10:0/3025880786 >> v2:10.20.193.153:3300/0 conn(0x7f1fbc152a40 0x7f1fbc15ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 1 -- 10.20.193.10:0/3025880786 >> v2:10.20.193.71:3300/0 conn(0x7f1fbc152660 msgr2=0x7f1fbc15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 1 --2- 10.20.193.10:0/3025880786 >> v2:10.20.193.71:3300/0 conn(0x7f1fbc152660 0x7f1fbc15a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 10 monclient: _finish_hunting 0 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 1 monclient: found mon.noname-a 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.530+0000 7f1fc2f2c640 1 -- 10.20.193.10:0/3025880786 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc159e40 con 0x7f1fbc0c8dd0 2026-02-17T11:58:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.531+0000 7f1fc2f2c640 1 --2- 10.20.193.10:0/3025880786 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc0c8dd0 0x7f1fbc0c91b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc076d70 tx=0x7f1fb002f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1c451aeb8a9468 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:01.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 1 -- 10.20.193.10:0/3025880786 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb002fd10 con 0x7f1fbc0c8dd0 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 10 monclient: dump: 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:01.544 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 10 monclient: _finish_auth 0 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 10 monclient: _check_auth_tickets 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 5 monclient: authenticate success, global_id 4749 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 1 -- 10.20.193.10:0/3025880786 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb00373f0 con 0x7f1fbc0c8dd0 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 1 -- 10.20.193.10:0/3025880786 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00377c0 con 0x7f1fbc0c8dd0 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:01.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc1729640 10 monclient: dump: 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:01.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 4 set_mon_vals no callback set 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 10 monclient: shutdown 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 1 -- 10.20.193.10:0/3025880786 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc0c8dd0 msgr2=0x7f1fbc0c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/3025880786 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc0c8dd0 0x7f1fbc0c91b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc076d70 tx=0x7f1fb002f260 comp rx=0 tx=0).stop 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 1 -- 10.20.193.10:0/3025880786 shutdown_connections 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/3025880786 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc0c8dd0 0x7f1fbc0c91b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/3025880786 >> v2:10.20.193.153:3300/0 conn(0x7f1fbc152a40 0x7f1fbc15ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/3025880786 >> v2:10.20.193.71:3300/0 conn(0x7f1fbc152660 0x7f1fbc15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 1 -- 10.20.193.10:0/3025880786 >> 10.20.193.10:0/3025880786 conn(0x7f1fbc0c9d80 msgr2=0x7f1fbc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 1 -- 10.20.193.10:0/3025880786 shutdown_connections 2026-02-17T11:58:01.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.533+0000 7f1fc49b6640 1 -- 10.20.193.10:0/3025880786 wait complete. 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient: build_initial_monmap 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient: monmap: 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:01.548 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 librados: starting msgr at 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 librados: starting objecter 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 Processor -- start 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 -- start start 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 librados: setting wanted keys 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 librados: calling monclient init 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient: init 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1fbc0c8dd0 0x7f1fbc1f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient(hunting): picked mon.noname-c con 0x7f1fbc0c8dd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc152660 0x7f1fbc148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:01.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient(hunting): picked mon.noname-a con 0x7f1fbc152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1fbc152a40 0x7f1fbc154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient(hunting): picked mon.noname-b con 0x7f1fbc152a40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0c96f0 con 0x7f1fbc152660 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc15a400 con 0x7f1fbc152a40 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc15be10 con 0x7f1fbc0c8dd0 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.534+0000 7f1fc49b6640 10 monclient(hunting): authenticate will time out at 1151.255899s 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc152660 0x7f1fbc148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:01.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc272b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1fbc0c8dd0 0x7f1fbc1f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc152660 0x7f1fbc148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38710/0 (socket says 10.20.193.10:38710) 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 1 -- 10.20.193.10:0/4118083029 learned_addr learned my addr 10.20.193.10:0/4118083029 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 10 monclient(hunting): get_auth_request con 0x7f1fbc152660 auth_method 0 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc272b640 10 monclient(hunting): get_auth_request con 0x7f1fbc0c8dd0 auth_method 0 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc272b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc272b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc272b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc2f2c640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1fbc152a40 0x7f1fbc154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:01.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc1f2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc2f2c640 10 monclient(hunting): get_auth_request con 0x7f1fbc152a40 auth_method 0 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc2f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc2f2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc2f2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc272b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc272b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.535+0000 7f1fc272b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc2f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc2f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc2f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 10 monclient(hunting): handle_auth_done global_id 4752 payload 824 2026-02-17T11:58:01.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 1 -- 10.20.193.10:0/4118083029 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1fbc0c8dd0 msgr2=0x7f1fbc1f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1fbc0c8dd0 0x7f1fbc1f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 1 -- 10.20.193.10:0/4118083029 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1fbc152a40 msgr2=0x7f1fbc154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1fbc152a40 0x7f1fbc154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 10 monclient: _finish_hunting 0 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 1 monclient: found mon.noname-a 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.536+0000 7f1fc1f2a640 1 -- 10.20.193.10:0/4118083029 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc1f4060 con 0x7f1fbc152660 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.537+0000 7f1fc1f2a640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc152660 0x7f1fbc148970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800e860 tx=0x7f1fa800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.537+0000 7f1fa6ffd640 10 client.?.objecter ms_handle_connect 0x7f1fbc152660 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.537+0000 7f1fa6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:01.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 1 -- 10.20.193.10:0/4118083029 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8017070 con 0x7f1fbc152660 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 10 monclient: dump: 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:01.554 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 1 -- 10.20.193.10:0/4118083029 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa800c940 con 0x7f1fbc152660 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 1 -- 10.20.193.10:0/4118083029 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800cd10 con 0x7f1fbc152660 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc49b6640 5 monclient: authenticate success, global_id 4752 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc49b6640 10 monclient: _renew_subs 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc0f28640 4 set_mon_vals no callback set 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc49b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc1f4340 con 0x7f1fbc152660 2026-02-17T11:58:01.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fa6ffd640 10 monclient: dump: 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:01.556 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc49b6640 10 client.4752.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc49b6640 10 monclient: _renew_subs 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc49b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc1540c0 con 0x7f1fbc152660 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.539+0000 7f1fc49b6640 1 librados: init done 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.540+0000 7f1fc49b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.540+0000 7f1fc49b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.540+0000 7f1fc49b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:01.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.540+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fbc0c91b0 con 0x7f1fbc152660 2026-02-17T11:58:01.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.551+0000 7f1fa6ffd640 1 -- 10.20.193.10:0/4118083029 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f1fa8013470 con 0x7f1fbc152660 2026-02-17T11:58:01.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.552+0000 7f1fa6ffd640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1f8c078e00 0x7f1f8c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:01.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.552+0000 7f1fc272b640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1f8c078e00 0x7f1f8c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:01.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.552+0000 7f1fc272b640 10 monclient: get_auth_request con 0x7f1f8c078e00 auth_method 0 2026-02-17T11:58:01.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.552+0000 7f1fa6ffd640 10 client.4752.objecter ms_handle_connect 0x7f1f8c078e00 2026-02-17T11:58:01.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.552+0000 7f1fc272b640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1f8c078e00 0x7f1f8c07b2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009c40 tx=0x7f1fb4009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:01.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.553+0000 7f1fa6ffd640 1 -- 10.20.193.10:0/4118083029 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f1fa805e330 con 0x7f1fbc152660 2026-02-17T11:58:01.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.553+0000 7f1fa6ffd640 10 client.4752.objecter ms_dispatch2 0x7f1fbc000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:01.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.553+0000 7f1fa6ffd640 3 client.4752.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:01.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.553+0000 7f1fa6ffd640 3 client.4752.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:01.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.553+0000 7f1fa6ffd640 20 client.4752.objecter dump_active .. 0 homeless 2026-02-17T11:58:01.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.653+0000 7f1fa6ffd640 1 -- 10.20.193.10:0/4118083029 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1fa80622f0 con 0x7f1fbc152660 2026-02-17T11:58:01.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.653+0000 7f1fa6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:01.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.653+0000 7f1fa6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:01.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.753+0000 7f1fc49b6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:01.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.753+0000 7f1fc49b6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:01.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.753+0000 7f1fc49b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:01.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.753+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1fbc15cd40 con 0x7f1fbc152660 2026-02-17T11:58:01.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.755+0000 7f1fa6ffd640 1 -- 10.20.193.10:0/4118083029 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f1fa80665f0 con 0x7f1fbc152660 2026-02-17T11:58:01.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.755+0000 7f1fa6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:01.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.755+0000 7f1fa6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:01.757 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:01.757 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:01.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 10 librados: watch_flush enter 2026-02-17T11:58:01.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 10 librados: watch_flush exit 2026-02-17T11:58:01.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 20 client.4752.objecter shutdown clearing up homeless session... 2026-02-17T11:58:01.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 10 client.4752.objecter successfully canceled tick 2026-02-17T11:58:01.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1f8c078e00 msgr2=0x7f1f8c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:01.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1f8c078e00 0x7f1f8c07b2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009c40 tx=0x7f1fb4009290 comp rx=0 tx=0).stop 2026-02-17T11:58:01.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 10 monclient: shutdown 2026-02-17T11:58:01.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:01.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc152660 msgr2=0x7f1fbc148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc152660 0x7f1fbc148970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800e860 tx=0x7f1fa800ed30 comp rx=0 tx=0).stop 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 shutdown_connections 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1f8c078e00 0x7f1f8c07b2c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1fbc152a40 0x7f1fbc154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1fbc152660 0x7f1fbc148970 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 --2- 10.20.193.10:0/4118083029 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1fbc0c8dd0 0x7f1fbc1f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 >> 10.20.193.10:0/4118083029 conn(0x7f1fbc0c9d80 msgr2=0x7f1fbc1508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 shutdown_connections 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 -- 10.20.193.10:0/4118083029 wait complete. 2026-02-17T11:58:01.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:01.757+0000 7f1fc49b6640 1 librados: shutdown 2026-02-17T11:58:04.767 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:04.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.835+0000 7f3f6e785640 10 monclient: get_monmap_and_config 2026-02-17T11:58:04.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.835+0000 7f3f6e785640 10 monclient: build_initial_monmap 2026-02-17T11:58:04.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.835+0000 7f3f6e785640 10 monclient: monmap: 2026-02-17T11:58:04.836 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:04.835766+0000 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:04.835766+0000 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:04.837 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:04.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.835+0000 7f3f6e785640 1 Processor -- start 2026-02-17T11:58:04.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 1 -- start start 2026-02-17T11:58:04.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 10 monclient: init 2026-02-17T11:58:04.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:04.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 10 monclient: _add_conns ranks=[4,2,1,5,0,3] 2026-02-17T11:58:04.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 0x7f3f6815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:04.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 10 monclient(hunting): picked mon.noname-b con 0x7f3f6815d220 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:04.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3f68074920 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3f680c92f0 addr v1:10.20.193.71:6789/0 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f680c58a0 con 0x7f3f680c92f0 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f680c55c0 con 0x7f3f68074920 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3f680c7e20 con 0x7f3f6815d220 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.836+0000 7f3f6e785640 10 monclient(hunting): authenticate will time out at 1154.557598s 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.837+0000 7f3f6ccfb640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f3f680c92f0 0x7f3f68153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:36390/0 (socket says 10.20.193.10:36390) 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.837+0000 7f3f6ccfb640 1 -- 10.20.193.10:0/846941054 learned_addr learned my addr 10.20.193.10:0/846941054 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.837+0000 7f3f677fe640 1 --1- 10.20.193.10:0/846941054 >> v1:10.20.193.153:6789/0 conn(0x7f3f68074920 0x7f3f680c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:54194/0 (socket says 10.20.193.10:54194) 2026-02-17T11:58:04.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.837+0000 7f3f67fff640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 0x7f3f6815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.837+0000 7f3f67fff640 10 monclient(hunting): get_auth_request con 0x7f3f6815d220 auth_method 0 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.837+0000 7f3f67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.837+0000 7f3f67fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.837+0000 7f3f67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.838+0000 7f3f67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.838+0000 7f3f67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.838+0000 7f3f67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.838+0000 7f3f66ffd640 1 -- 10.20.193.10:0/846941054 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115086383 0 0) 0x7f3f680c55c0 con 0x7f3f68074920 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.838+0000 7f3f66ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.838+0000 7f3f66ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.838+0000 7f3f66ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.838+0000 7f3f66ffd640 10 monclient(hunting): my global_id is 4826 2026-02-17T11:58:04.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.838+0000 7f3f66ffd640 1 -- 10.20.193.10:0/846941054 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f4c003620 con 0x7f3f68074920 2026-02-17T11:58:04.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.840+0000 7f3f67fff640 10 monclient(hunting): handle_auth_done global_id 4774 payload 274 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.840+0000 7f3f67fff640 1 -- 10.20.193.10:0/846941054 >> v1:10.20.193.153:6789/0 conn(0x7f3f68074920 legacy=0x7f3f680c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.840+0000 7f3f67fff640 1 -- 10.20.193.10:0/846941054 >> v1:10.20.193.71:6789/0 conn(0x7f3f680c92f0 legacy=0x7f3f68153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.840+0000 7f3f67fff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.840+0000 7f3f67fff640 1 monclient: found mon.noname-b 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.840+0000 7f3f67fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.840+0000 7f3f67fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.840+0000 7f3f67fff640 1 -- 10.20.193.10:0/846941054 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f680c8100 con 0x7f3f6815d220 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.841+0000 7f3f67fff640 1 -- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 msgr2=0x7f3f6815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.841+0000 7f3f67fff640 1 -- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 msgr2=0x7f3f6815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.841+0000 7f3f67fff640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 0x7f3f6815d600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0x7f3f540098d0 tx=0x7f3f5402eed0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:58:04.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:04.841+0000 7f3f67fff640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 0x7f3f6815d600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:58:05.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f67fff640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 0x7f3f6815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:05.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f67fff640 10 monclient: get_auth_request con 0x7f3f6815d220 auth_method 0 2026-02-17T11:58:05.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f67fff640 0 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 0x7f3f6815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-17T11:58:05.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f67fff640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 0x7f3f6815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f66ffd640 10 monclient: ms_handle_reset current mon v2:10.20.193.71:3300/0 2026-02-17T11:58:05.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f66ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:05.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f66ffd640 1 -- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 msgr2=0x7f3f6815d600 unknown :-1 s=STATE_CLOSED l=0).mark_down 2026-02-17T11:58:05.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f66ffd640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.71:3300/0 conn(0x7f3f6815d220 0x7f3f6815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f66ffd640 10 monclient: _add_conns ranks=[3,5,0] 2026-02-17T11:58:05.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f66ffd640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.10:3300/0 conn(0x7f3f4c003930 0x7f3f4c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:05.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f66ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f3f4c003930 addr v2:10.20.193.10:3300/0 2026-02-17T11:58:05.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f66ffd640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.153:3300/0 conn(0x7f3f4c004900 0x7f3f4c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:05.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.042+0000 7f3f66ffd640 10 monclient(hunting): picked mon.noname-c con 0x7f3f4c004900 addr v2:10.20.193.153:3300/0 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f66ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3f4c005350 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f66ffd640 1 -- 10.20.193.10:0/846941054 --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f680c55c0 con 0x7f3f4c005350 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f66ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f66ffd640 1 -- 10.20.193.10:0/846941054 --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c00e490 con 0x7f3f4c003930 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f66ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f66ffd640 1 -- 10.20.193.10:0/846941054 --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c00e640 con 0x7f3f4c004900 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f66ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f66ffd640 10 monclient(hunting): ms_handle_reset stray mon v2:10.20.193.71:3300/0 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f67fff640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.10:3300/0 conn(0x7f3f4c003930 0x7f3f4c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f677fe640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.153:3300/0 conn(0x7f3f4c004900 0x7f3f4c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f677fe640 10 monclient(hunting): get_auth_request con 0x7f3f4c004900 auth_method 0 2026-02-17T11:58:05.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f677fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f67fff640 10 monclient(hunting): get_auth_request con 0x7f3f4c003930 auth_method 0 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f67fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.043+0000 7f3f67fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.044+0000 7f3f677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.044+0000 7f3f677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.044+0000 7f3f677fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.044+0000 7f3f67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.044+0000 7f3f67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.044+0000 7f3f67fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:05.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 10 monclient(hunting): handle_auth_done global_id 4774 payload 293 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 1 -- 10.20.193.10:0/846941054 >> v2:10.20.193.10:3300/0 conn(0x7f3f4c003930 msgr2=0x7f3f4c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 1 --2- 10.20.193.10:0/846941054 >> v2:10.20.193.10:3300/0 conn(0x7f3f4c003930 0x7f3f4c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 1 -- 10.20.193.10:0/846941054 >> v1:10.20.193.10:6789/0 conn(0x7f3f4c005350 legacy=0x7f3f4c00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 1 monclient: found mon.noname-c 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f6ccfb640 1 -- 10.20.193.10:0/846941054 reap_dead start 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 1 -- 10.20.193.10:0/846941054 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c00e900 con 0x7f3f4c004900 2026-02-17T11:58:05.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.045+0000 7f3f677fe640 1 --2- 10.20.193.10:0/846941054 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f4c004900 0x7f3f4c004db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c004580 tx=0x7f3f54009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9a726dc53372eed server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:05.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 1 -- 10.20.193.10:0/846941054 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58002ed0 con 0x7f3f4c004900 2026-02-17T11:58:05.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:05.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:05.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 10 monclient: dump: 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:05.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 1 -- 10.20.193.10:0/846941054 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f5800cb60 con 0x7f3f4c004900 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 1 -- 10.20.193.10:0/846941054 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f580048e0 con 0x7f3f4c004900 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f6e785640 5 monclient: authenticate success, global_id 4774 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f6e785640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f6e785640 4 set_mon_vals no callback set 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:05.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.047+0000 7f3f66ffd640 10 monclient: dump: 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 10 monclient: shutdown 2026-02-17T11:58:05.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 1 -- 10.20.193.10:0/846941054 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f4c004900 msgr2=0x7f3f4c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 1 --2- 10.20.193.10:0/846941054 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f4c004900 0x7f3f4c004db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c004580 tx=0x7f3f54009290 comp rx=0 tx=0).stop 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 1 -- 10.20.193.10:0/846941054 shutdown_connections 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 1 --2- 10.20.193.10:0/846941054 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f4c004900 0x7f3f4c004db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 1 -- 10.20.193.10:0/846941054 >> 10.20.193.10:0/846941054 conn(0x7f3f680c9d80 msgr2=0x7f3f680ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 1 -- 10.20.193.10:0/846941054 shutdown_connections 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 1 -- 10.20.193.10:0/846941054 wait complete. 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 10 monclient: build_initial_monmap 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.048+0000 7f3f6e785640 10 monclient: monmap: 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:05.063 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 librados: starting msgr at 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 librados: starting objecter 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 Processor -- start 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 -- start start 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 librados: setting wanted keys 2026-02-17T11:58:05.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 librados: calling monclient init 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient: init 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3f4c004900 0x7f3f680ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient(hunting): picked mon.noname-a con 0x7f3f4c004900 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3f6806d1b0 0x7f3f681524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient(hunting): picked mon.noname-b con 0x7f3f6806d1b0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f681529f0 0x7f3f6815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient(hunting): picked mon.noname-c con 0x7f3f681529f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68074d70 con 0x7f3f4c004900 2026-02-17T11:58:05.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f680c86c0 con 0x7f3f6806d1b0 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6815d600 con 0x7f3f681529f0 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6e785640 10 monclient(hunting): authenticate will time out at 1154.770511s 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f67fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3f4c004900 0x7f3f680ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6ccfb640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f681529f0 0x7f3f6815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f67fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3f4c004900 0x7f3f680ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:55750/0 (socket says 10.20.193.10:55750) 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f67fff640 1 -- 10.20.193.10:0/2501822429 learned_addr learned my addr 10.20.193.10:0/2501822429 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f67fff640 10 monclient(hunting): get_auth_request con 0x7f3f4c004900 auth_method 0 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:05.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f67fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f677fe640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3f6806d1b0 0x7f3f681524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6ccfb640 10 monclient(hunting): get_auth_request con 0x7f3f681529f0 auth_method 0 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6ccfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6ccfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.049+0000 7f3f6ccfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f677fe640 10 monclient(hunting): get_auth_request con 0x7f3f6806d1b0 auth_method 0 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:05.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f6ccfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f6ccfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f6ccfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.050+0000 7f3f677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 10 monclient(hunting): handle_auth_done global_id 4755 payload 824 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 1 -- 10.20.193.10:0/2501822429 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f681529f0 msgr2=0x7f3f6815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f681529f0 0x7f3f6815c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 1 -- 10.20.193.10:0/2501822429 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3f6806d1b0 msgr2=0x7f3f681524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3f6806d1b0 0x7f3f681524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 1 monclient: found mon.noname-a 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.051+0000 7f3f67fff640 1 -- 10.20.193.10:0/2501822429 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f681f4610 con 0x7f3f4c004900 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.052+0000 7f3f67fff640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3f4c004900 0x7f3f680ccae0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f540099d0 tx=0x7f3f540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.052+0000 7f3f64ff9640 10 client.?.objecter ms_handle_connect 0x7f3f4c004900 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.052+0000 7f3f64ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 1 -- 10.20.193.10:0/2501822429 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54048070 con 0x7f3f4c004900 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 10 monclient: dump: 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:05.069 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 10 monclient: _finish_auth 0 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:58:05.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 1 -- 10.20.193.10:0/2501822429 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f54004590 con 0x7f3f4c004900 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f6e785640 5 monclient: authenticate success, global_id 4755 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f6e785640 10 monclient: _renew_subs 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f6e785640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f681f48f0 con 0x7f3f4c004900 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 1 -- 10.20.193.10:0/2501822429 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54043660 con 0x7f3f4c004900 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f667fc640 4 set_mon_vals no callback set 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f64ff9640 10 monclient: dump: 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:05.071 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f6e785640 10 client.4755.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f6e785640 10 monclient: _renew_subs 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f6e785640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f681f4eb0 con 0x7f3f4c004900 2026-02-17T11:58:05.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.054+0000 7f3f6e785640 1 librados: init done 2026-02-17T11:58:05.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.055+0000 7f3f6e785640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:05.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.055+0000 7f3f6e785640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:05.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.055+0000 7f3f6e785640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:05.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.055+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f68076640 con 0x7f3f4c004900 2026-02-17T11:58:05.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.067+0000 7f3f64ff9640 1 -- 10.20.193.10:0/2501822429 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f3f54043800 con 0x7f3f4c004900 2026-02-17T11:58:05.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.067+0000 7f3f64ff9640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3f38078e50 0x7f3f3807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:05.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.067+0000 7f3f677fe640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3f38078e50 0x7f3f3807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:05.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.067+0000 7f3f677fe640 10 monclient: get_auth_request con 0x7f3f38078e50 auth_method 0 2026-02-17T11:58:05.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.067+0000 7f3f64ff9640 10 client.4755.objecter ms_handle_connect 0x7f3f38078e50 2026-02-17T11:58:05.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.067+0000 7f3f677fe640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3f38078e50 0x7f3f3807b310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3f58002410 tx=0x7f3f5800a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.176+0000 7f3f64ff9640 1 -- 10.20.193.10:0/2501822429 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f3f54082f60 con 0x7f3f4c004900 2026-02-17T11:58:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.176+0000 7f3f64ff9640 10 client.4755.objecter ms_dispatch2 0x7f3f68000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.176+0000 7f3f64ff9640 3 client.4755.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.176+0000 7f3f64ff9640 3 client.4755.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.176+0000 7f3f64ff9640 20 client.4755.objecter dump_active .. 0 homeless 2026-02-17T11:58:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.176+0000 7f3f64ff9640 1 -- 10.20.193.10:0/2501822429 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3f68076640 con 0x7f3f4c004900 2026-02-17T11:58:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.176+0000 7f3f64ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:05.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.176+0000 7f3f64ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:05.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.281+0000 7f3f6e785640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:05.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.281+0000 7f3f6e785640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:05.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.281+0000 7f3f6e785640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:05.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.281+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3f680c8be0 con 0x7f3f4c004900 2026-02-17T11:58:05.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.300+0000 7f3f64ff9640 1 -- 10.20.193.10:0/2501822429 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f3f54053020 con 0x7f3f4c004900 2026-02-17T11:58:05.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.300+0000 7f3f64ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:05.301 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.300+0000 7f3f64ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:05.301 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:05.301 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 10 librados: watch_flush enter 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 10 librados: watch_flush exit 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 20 client.4755.objecter shutdown clearing up homeless session... 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 10 client.4755.objecter successfully canceled tick 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3f38078e50 msgr2=0x7f3f3807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3f38078e50 0x7f3f3807b310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3f58002410 tx=0x7f3f5800a000 comp rx=0 tx=0).stop 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 10 monclient: shutdown 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3f4c004900 msgr2=0x7f3f680ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3f4c004900 0x7f3f680ccae0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f540099d0 tx=0x7f3f540047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 shutdown_connections 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3f38078e50 0x7f3f3807b310 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f681529f0 0x7f3f6815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3f6806d1b0 0x7f3f681524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 --2- 10.20.193.10:0/2501822429 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3f4c004900 0x7f3f680ccae0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 >> 10.20.193.10:0/2501822429 conn(0x7f3f680c9d80 msgr2=0x7f3f680ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 shutdown_connections 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 -- 10.20.193.10:0/2501822429 wait complete. 2026-02-17T11:58:05.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:05.302+0000 7f3f6e785640 1 librados: shutdown 2026-02-17T11:58:08.312 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:08.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.378+0000 7f467de3b640 10 monclient: get_monmap_and_config 2026-02-17T11:58:08.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.378+0000 7f467de3b640 10 monclient: build_initial_monmap 2026-02-17T11:58:08.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.378+0000 7f467de3b640 10 monclient: monmap: 2026-02-17T11:58:08.380 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:08.380183+0000 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:08.380183+0000 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 1 Processor -- start 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 1 -- start start 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient: init 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient: _add_conns ranks=[3,4,0,5,2,1] 2026-02-17T11:58:08.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f467815d220 0x7f467815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient(hunting): picked mon.noname-a con 0x7f467815d220 addr v2:10.20.193.10:3300/0 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f4678074920 0x7f46780c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient(hunting): picked mon.noname-b con 0x7f4678074920 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f46780c9120 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46780c95b0 con 0x7f46780c9120 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f46780c58a0 con 0x7f467815d220 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f46780c55c0 con 0x7f4678074920 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.379+0000 7f467de3b640 10 monclient(hunting): authenticate will time out at 1158.101909s 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f46777fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f467815d220 0x7f467815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f4676ffd640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f4678074920 0x7f46780c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f4677fff640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f46780c9120 0x7f4678153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:37738/0 (socket says 10.20.193.10:37738) 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f4677fff640 1 -- 10.20.193.10:0/1289235044 learned_addr learned my addr 10.20.193.10:0/1289235044 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f46777fe640 10 monclient(hunting): get_auth_request con 0x7f467815d220 auth_method 0 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f46777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f46777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f46777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f4676ffd640 10 monclient(hunting): get_auth_request con 0x7f4678074920 auth_method 0 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f4676ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f4676ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:08.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.380+0000 7f4676ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.381+0000 7f4676ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.381+0000 7f4676ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.381+0000 7f4676ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.381+0000 7f46777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.381+0000 7f46777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.381+0000 7f46777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 10 monclient(hunting): handle_auth_done global_id 4783 payload 274 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 1 -- 10.20.193.10:0/1289235044 >> v2:10.20.193.10:3300/0 conn(0x7f467815d220 msgr2=0x7f467815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 1 --2- 10.20.193.10:0/1289235044 >> v2:10.20.193.10:3300/0 conn(0x7f467815d220 0x7f467815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 1 -- 10.20.193.10:0/1289235044 >> v1:10.20.193.10:6789/0 conn(0x7f46780c9120 legacy=0x7f4678153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 1 monclient: found mon.noname-b 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:08.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:08.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 1 -- 10.20.193.10:0/1289235044 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46780c7e20 con 0x7f4678074920 2026-02-17T11:58:08.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.382+0000 7f4676ffd640 1 --2- 10.20.193.10:0/1289235044 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4678074920 0x7f46780c8be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f46680098a0 tx=0x7f466802ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c204865e672cd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 1 -- 10.20.193.10:0/1289235044 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466803c070 con 0x7f4678074920 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 10 monclient: dump: 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 5 monclient: authenticate success, global_id 4783 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 1 -- 10.20.193.10:0/1289235044 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466802fae0 con 0x7f4678074920 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 1 -- 10.20.193.10:0/1289235044 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668037440 con 0x7f4678074920 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f46767fc640 10 monclient: dump: 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:08.386 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:08.387 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:08.387 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:08.387 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:08.387 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:08.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:08.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 4 set_mon_vals no callback set 2026-02-17T11:58:08.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 10 monclient: shutdown 2026-02-17T11:58:08.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:08.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 1 -- 10.20.193.10:0/1289235044 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4678074920 msgr2=0x7f46780c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 1 --2- 10.20.193.10:0/1289235044 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4678074920 0x7f46780c8be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f46680098a0 tx=0x7f466802ee10 comp rx=0 tx=0).stop 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 1 -- 10.20.193.10:0/1289235044 shutdown_connections 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 1 --2- 10.20.193.10:0/1289235044 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4678074920 0x7f46780c8be0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 1 --2- 10.20.193.10:0/1289235044 >> v2:10.20.193.10:3300/0 conn(0x7f467815d220 0x7f467815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 1 -- 10.20.193.10:0/1289235044 >> 10.20.193.10:0/1289235044 conn(0x7f46780c9d80 msgr2=0x7f46780ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 1 -- 10.20.193.10:0/1289235044 shutdown_connections 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.384+0000 7f467de3b640 1 -- 10.20.193.10:0/1289235044 wait complete. 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 10 monclient: build_initial_monmap 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 10 monclient: monmap: 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 1 librados: starting msgr at 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 1 librados: starting objecter 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 1 Processor -- start 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 1 -- start start 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 1 librados: setting wanted keys 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 1 librados: calling monclient init 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 10 monclient: init 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.385+0000 7f467de3b640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4678074920 0x7f46781518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 10 monclient(hunting): picked mon.noname-c con 0x7f4678074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46780c9120 0x7f46781f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 10 monclient(hunting): picked mon.noname-b con 0x7f46780c9120 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f467815d220 0x7f46781e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 10 monclient(hunting): picked mon.noname-a con 0x7f467815d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f46780c86c0 con 0x7f467815d220 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46780c83e0 con 0x7f46780c9120 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:08.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4678074d70 con 0x7f4678074920 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f467de3b640 10 monclient(hunting): authenticate will time out at 1158.108049s 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f467815d220 0x7f46781e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4676ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46780c9120 0x7f46781f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f467815d220 0x7f46781e7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:55774/0 (socket says 10.20.193.10:55774) 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 1 -- 10.20.193.10:0/2257311380 learned_addr learned my addr 10.20.193.10:0/2257311380 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 10 monclient(hunting): get_auth_request con 0x7f467815d220 auth_method 0 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4676ffd640 10 monclient(hunting): get_auth_request con 0x7f46780c9120 auth_method 0 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4676ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4676ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4676ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4677fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:08.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4676ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4676ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.386+0000 7f4676ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.387+0000 7f4677fff640 10 monclient(hunting): handle_auth_done global_id 4764 payload 824 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.387+0000 7f4677fff640 1 -- 10.20.193.10:0/2257311380 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4678074920 msgr2=0x7f46781518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.387+0000 7f4677fff640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4678074920 0x7f46781518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.387+0000 7f4677fff640 1 -- 10.20.193.10:0/2257311380 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46780c9120 msgr2=0x7f46781f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.388+0000 7f4677fff640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46780c9120 0x7f46781f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.388+0000 7f4677fff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.388+0000 7f4677fff640 1 monclient: found mon.noname-a 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.388+0000 7f4677fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.388+0000 7f4677fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.388+0000 7f4677fff640 1 -- 10.20.193.10:0/2257311380 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46781f3bb0 con 0x7f467815d220 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.389+0000 7f4677fff640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f467815d220 0x7f46781e7810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f466c00cb50 tx=0x7f466c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.389+0000 7f4653fff640 10 client.?.objecter ms_handle_connect 0x7f467815d220 2026-02-17T11:58:08.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.389+0000 7f4653fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 1 -- 10.20.193.10:0/2257311380 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c017070 con 0x7f467815d220 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 10 monclient: dump: 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:08.392 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 10 monclient: _finish_auth 0 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 1 -- 10.20.193.10:0/2257311380 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466c00ad50 con 0x7f467815d220 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 1 -- 10.20.193.10:0/2257311380 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c012600 con 0x7f467815d220 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4653fff640 10 monclient: dump: 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f467de3b640 5 monclient: authenticate success, global_id 4764 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f4675ffb640 4 set_mon_vals no callback set 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f467de3b640 10 monclient: _renew_subs 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f467de3b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46781f3e50 con 0x7f467815d220 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f467de3b640 10 client.4764.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f467de3b640 10 monclient: _renew_subs 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f467de3b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.390+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46781f4410 con 0x7f467815d220 2026-02-17T11:58:08.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.391+0000 7f467de3b640 1 librados: init done 2026-02-17T11:58:08.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.391+0000 7f467de3b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:08.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.391+0000 7f467de3b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:08.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.391+0000 7f467de3b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:08.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.391+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46780c8be0 con 0x7f467815d220 2026-02-17T11:58:08.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.402+0000 7f4653fff640 1 -- 10.20.193.10:0/2257311380 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f466c024080 con 0x7f467815d220 2026-02-17T11:58:08.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.403+0000 7f4653fff640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4648078e00 0x7f464807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:08.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.403+0000 7f46777fe640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4648078e00 0x7f464807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:08.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.403+0000 7f46777fe640 10 monclient: get_auth_request con 0x7f4648078e00 auth_method 0 2026-02-17T11:58:08.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.403+0000 7f46777fe640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4648078e00 0x7f464807b2c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4664006b90 tx=0x7f4664006b20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:08.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.403+0000 7f4653fff640 10 client.4764.objecter ms_handle_connect 0x7f4648078e00 2026-02-17T11:58:08.508 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.505+0000 7f4653fff640 1 -- 10.20.193.10:0/2257311380 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f466c05dd90 con 0x7f467815d220 2026-02-17T11:58:08.508 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.505+0000 7f4653fff640 10 client.4764.objecter ms_dispatch2 0x7f4678000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:08.508 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.505+0000 7f4653fff640 3 client.4764.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:08.508 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.505+0000 7f4653fff640 3 client.4764.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:08.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.505+0000 7f4653fff640 20 client.4764.objecter dump_active .. 0 homeless 2026-02-17T11:58:08.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.505+0000 7f4653fff640 1 -- 10.20.193.10:0/2257311380 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f466c061d50 con 0x7f467815d220 2026-02-17T11:58:08.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.506+0000 7f4653fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:08.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.506+0000 7f4653fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:08.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.604+0000 7f467de3b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:08.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.604+0000 7f467de3b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:08.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.604+0000 7f467de3b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:08.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.604+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f46781573e0 con 0x7f467815d220 2026-02-17T11:58:08.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.607+0000 7f4653fff640 1 -- 10.20.193.10:0/2257311380 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f466c066050 con 0x7f467815d220 2026-02-17T11:58:08.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.607+0000 7f4653fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:08.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.607+0000 7f4653fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:08.609 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:08.610 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:08.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 10 librados: watch_flush enter 2026-02-17T11:58:08.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 10 librados: watch_flush exit 2026-02-17T11:58:08.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 20 client.4764.objecter shutdown clearing up homeless session... 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 10 client.4764.objecter successfully canceled tick 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4648078e00 msgr2=0x7f464807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4648078e00 0x7f464807b2c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4664006b90 tx=0x7f4664006b20 comp rx=0 tx=0).stop 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 10 monclient: shutdown 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f467815d220 msgr2=0x7f46781e7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f467815d220 0x7f46781e7810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f466c00cb50 tx=0x7f466c00a430 comp rx=0 tx=0).stop 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 shutdown_connections 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4648078e00 0x7f464807b2c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f467815d220 0x7f46781e7810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f46780c9120 0x7f46781f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:08.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 --2- 10.20.193.10:0/2257311380 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4678074920 0x7f46781518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:08.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 >> 10.20.193.10:0/2257311380 conn(0x7f46780c9d80 msgr2=0x7f46781523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:08.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 shutdown_connections 2026-02-17T11:58:08.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 -- 10.20.193.10:0/2257311380 wait complete. 2026-02-17T11:58:08.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:08.608+0000 7f467de3b640 1 librados: shutdown 2026-02-17T11:58:11.619 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:11.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.688+0000 7f3607629640 10 monclient: get_monmap_and_config 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.688+0000 7f3607629640 10 monclient: build_initial_monmap 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.688+0000 7f3607629640 10 monclient: monmap: 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:11.689882+0000 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:11.689882+0000 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:11.691 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:11.692 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:11.692 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:11.692 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:11.692 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:11.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 1 Processor -- start 2026-02-17T11:58:11.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 1 -- start start 2026-02-17T11:58:11.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 10 monclient: init 2026-02-17T11:58:11.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:11.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 10 monclient: _add_conns ranks=[0,2,1,4,3,5] 2026-02-17T11:58:11.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3600152660 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:11.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f360015b030 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:11.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f36000c6ce0 addr v1:10.20.193.71:6789/0 2026-02-17T11:58:11.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36000c71e0 con 0x7f3600152660 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36000c74c0 con 0x7f36000c6ce0 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3600159e40 con 0x7f360015b030 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.689+0000 7f3607629640 10 monclient(hunting): authenticate will time out at 1161.411715s 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.690+0000 7f360539e640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f3600152660 0x7f360015a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:37746/0 (socket says 10.20.193.10:37746) 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.690+0000 7f360539e640 1 -- 10.20.193.10:0/2002549583 learned_addr learned my addr 10.20.193.10:0/2002549583 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690366040 0 0) 0x7f36000c71e0 con 0x7f3600152660 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): _negotiate 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:11.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): my global_id is 4767 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e8003620 con 0x7f3600152660 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1019409482 0 0) 0x7f3600159e40 con 0x7f360015b030 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): _negotiate 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): my global_id is 4832 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36000c71e0 con 0x7f360015b030 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92325263 0 0) 0x7f36000c74c0 con 0x7f36000c6ce0 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): _negotiate 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:11.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 10 monclient(hunting): my global_id is 4789 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.691+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3600159e40 con 0x7f36000c6ce0 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3563142478 0 0) 0x7f35e8003620 con 0x7f3600152660 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 >> v1:10.20.193.153:6789/0 conn(0x7f360015b030 legacy=0x7f36000c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 >> v1:10.20.193.71:6789/0 conn(0x7f36000c6ce0 legacy=0x7f36001631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360015a120 con 0x7f3600152660 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient: _finish_auth 0 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:11.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f35f0002f20 con 0x7f3600152660 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f3607629640 5 monclient: authenticate success, global_id 4767 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f3607629640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient: dump: 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:11.702 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 >> v1:10.20.193.10:6789/0 conn(0x7f3600152660 legacy=0x7f360015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f35e8004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient(hunting): picked mon.c con 0x7f35e8003fe0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f35e8004e40 0x7f35e80052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:11.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient(hunting): picked mon.b con 0x7f35e8004e40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f35e8009ab0 0x7f35e800bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient(hunting): picked mon.a con 0x7f35e8009ab0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f35e800c570 con 0x7f35e8009ab0 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35e800c6f0 con 0x7f35e8004e40 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f35e800eb80 con 0x7f35e8003fe0 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f35effff640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.693+0000 7f3607629640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:11.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f3604b9d640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f35e8004e40 0x7f35e80052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f360539e640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f35e8004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f360539e640 10 monclient(hunting): get_auth_request con 0x7f35e8003fe0 auth_method 0 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f3605b9f640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f35e8009ab0 0x7f35e800bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f360539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f360539e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f360539e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f3604b9d640 10 monclient(hunting): get_auth_request con 0x7f35e8004e40 auth_method 0 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f3604b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f3604b9d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f3604b9d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f360539e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f360539e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:11.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.694+0000 7f360539e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3605b9f640 10 monclient(hunting): get_auth_request con 0x7f35e8009ab0 auth_method 0 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3605b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3605b9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3605b9f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3604b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3604b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3604b9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3605b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3605b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.695+0000 7f3605b9f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 10 monclient(hunting): handle_auth_done global_id 4767 payload 293 2026-02-17T11:58:11.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 1 -- 10.20.193.10:0/2002549583 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f35e8004e40 msgr2=0x7f35e80052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f35e8004e40 0x7f35e80052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 1 -- 10.20.193.10:0/2002549583 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f35e8009ab0 msgr2=0x7f35e800bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f35e8009ab0 0x7f35e800bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 10 monclient: _finish_hunting 0 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 1 monclient: found mon.c 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 1 -- 10.20.193.10:0/2002549583 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8003620 con 0x7f35e8003fe0 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f3605b9f640 1 -- 10.20.193.10:0/2002549583 reap_dead start 2026-02-17T11:58:11.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 10 monclient: _finish_auth 0 2026-02-17T11:58:11.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 10 monclient: _check_auth_tickets 2026-02-17T11:58:11.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.696+0000 7f360539e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:11.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.697+0000 7f360539e640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f35e8004900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35f000c210 tx=0x7f35f002f570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30e087cc86659c0c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:11.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0007d40 con 0x7f35e8003fe0 2026-02-17T11:58:11.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:11.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:11.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 10 monclient: dump: 2026-02-17T11:58:11.714 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f0005bf0 con 0x7f35e8003fe0 2026-02-17T11:58:11.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 1 -- 10.20.193.10:0/2002549583 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0007070 con 0x7f35e8003fe0 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f35effff640 10 monclient: dump: 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:11.716 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 4 set_mon_vals no callback set 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 10 monclient: shutdown 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 1 -- 10.20.193.10:0/2002549583 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 msgr2=0x7f35e8004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f35e8004900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35f000c210 tx=0x7f35f002f570 comp rx=0 tx=0).stop 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 1 -- 10.20.193.10:0/2002549583 shutdown_connections 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 1 --2- 10.20.193.10:0/2002549583 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f35e8004900 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 1 -- 10.20.193.10:0/2002549583 >> 10.20.193.10:0/2002549583 conn(0x7f36000c9d80 msgr2=0x7f36000ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:11.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 1 -- 10.20.193.10:0/2002549583 shutdown_connections 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.698+0000 7f3607629640 1 -- 10.20.193.10:0/2002549583 wait complete. 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.699+0000 7f3607629640 10 monclient: build_initial_monmap 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.699+0000 7f3607629640 10 monclient: monmap: 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:11.718 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.699+0000 7f3607629640 1 librados: starting msgr at 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.699+0000 7f3607629640 1 librados: starting objecter 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.699+0000 7f3607629640 1 Processor -- start 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.699+0000 7f3607629640 1 -- start start 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.699+0000 7f3607629640 1 librados: setting wanted keys 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.699+0000 7f3607629640 1 librados: calling monclient init 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.699+0000 7f3607629640 10 monclient: init 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f360014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:11.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient(hunting): picked mon.noname-c con 0x7f35e8003fe0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3600158890 0x7f360014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient(hunting): picked mon.noname-a con 0x7f3600158890 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f360013f300 0x7f3600073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient(hunting): picked mon.noname-b con 0x7f360013f300 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f3600152a40 con 0x7f3600158890 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36000c77a0 con 0x7f360013f300 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3600152bc0 con 0x7f35e8003fe0 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3607629640 10 monclient(hunting): authenticate will time out at 1161.422092s 2026-02-17T11:58:11.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f360014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3605b9f640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f360013f300 0x7f3600073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f360014b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:58386/0 (socket says 10.20.193.10:58386) 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 1 -- 10.20.193.10:0/3403777008 learned_addr learned my addr 10.20.193.10:0/3403777008 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 10 monclient(hunting): get_auth_request con 0x7f35e8003fe0 auth_method 0 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3605b9f640 10 monclient(hunting): get_auth_request con 0x7f360013f300 auth_method 0 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3605b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3605b9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3605b9f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:11.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f360539e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3605b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3605b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.700+0000 7f3605b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 10 monclient(hunting): handle_auth_done global_id 4835 payload 824 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 1 -- 10.20.193.10:0/3403777008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f360013f300 msgr2=0x7f3600073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f360013f300 0x7f3600073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 1 -- 10.20.193.10:0/3403777008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3600158890 msgr2=0x7f360014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3600158890 0x7f360014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 10 monclient: _finish_hunting 0 2026-02-17T11:58:11.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 1 monclient: found mon.noname-c 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.702+0000 7f360539e640 1 -- 10.20.193.10:0/3403777008 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36001f33d0 con 0x7f35e8003fe0 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.703+0000 7f360539e640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f360014b920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35f000c340 tx=0x7f36000707c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.703+0000 7f35edffb640 10 client.?.objecter ms_handle_connect 0x7f35e8003fe0 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.703+0000 7f35edffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 1 -- 10.20.193.10:0/3403777008 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0007d40 con 0x7f35e8003fe0 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 10 monclient: dump: 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:11.723 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 1 -- 10.20.193.10:0/3403777008 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f0004cf0 con 0x7f35e8003fe0 2026-02-17T11:58:11.724 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f3607629640 5 monclient: authenticate success, global_id 4835 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f3607629640 10 monclient: _renew_subs 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f3607629640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3600157ad0 con 0x7f35e8003fe0 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 1 -- 10.20.193.10:0/3403777008 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f00072b0 con 0x7f35e8003fe0 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f35edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.704+0000 7f35ef7fe640 4 set_mon_vals no callback set 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f35edffb640 10 monclient: dump: 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.725 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f3607629640 10 client.4835.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f3607629640 10 monclient: _renew_subs 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f3607629640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3600158090 con 0x7f35e8003fe0 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f3607629640 1 librados: init done 2026-02-17T11:58:11.726 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f3607629640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:11.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f3607629640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:11.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f3607629640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:11.727 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.705+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f360015a920 con 0x7f35e8003fe0 2026-02-17T11:58:11.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.716+0000 7f35edffb640 1 -- 10.20.193.10:0/3403777008 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f35f0007450 con 0x7f35e8003fe0 2026-02-17T11:58:11.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.716+0000 7f35edffb640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f35d0078e80 0x7f35d007b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:11.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.716+0000 7f3604b9d640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f35d0078e80 0x7f35d007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:11.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.716+0000 7f3604b9d640 10 monclient: get_auth_request con 0x7f35d0078e80 auth_method 0 2026-02-17T11:58:11.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.717+0000 7f35edffb640 10 client.4835.objecter ms_handle_connect 0x7f35d0078e80 2026-02-17T11:58:11.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.717+0000 7f3604b9d640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f35d0078e80 0x7f35d007b340 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f35f4002910 tx=0x7f35f40050b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:11.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.718+0000 7f35edffb640 1 -- 10.20.193.10:0/3403777008 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f35f0007770 con 0x7f35e8003fe0 2026-02-17T11:58:11.728 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.718+0000 7f35edffb640 10 client.4835.objecter ms_dispatch2 0x7f3600000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:11.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.718+0000 7f35edffb640 3 client.4835.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:11.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.718+0000 7f35edffb640 3 client.4835.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:11.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.718+0000 7f35edffb640 20 client.4835.objecter dump_active .. 0 homeless 2026-02-17T11:58:11.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.823+0000 7f35edffb640 1 -- 10.20.193.10:0/3403777008 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f35f0087100 con 0x7f35e8003fe0 2026-02-17T11:58:11.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.823+0000 7f35edffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:11.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.823+0000 7f35edffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:11.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.921+0000 7f3607629640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:11.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.921+0000 7f3607629640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:11.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.921+0000 7f3607629640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:11.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.921+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f36001503c0 con 0x7f35e8003fe0 2026-02-17T11:58:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.925+0000 7f35edffb640 1 -- 10.20.193.10:0/3403777008 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f35f0086a00 con 0x7f35e8003fe0 2026-02-17T11:58:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.925+0000 7f35edffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.925+0000 7f35edffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:11.927 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:11.927 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:11.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 10 librados: watch_flush enter 2026-02-17T11:58:11.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 10 librados: watch_flush exit 2026-02-17T11:58:11.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 20 client.4835.objecter shutdown clearing up homeless session... 2026-02-17T11:58:11.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 10 client.4835.objecter successfully canceled tick 2026-02-17T11:58:11.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f35d0078e80 msgr2=0x7f35d007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f35d0078e80 0x7f35d007b340 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f35f4002910 tx=0x7f35f40050b0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 10 monclient: shutdown 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 msgr2=0x7f360014b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f360014b920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35f000c340 tx=0x7f36000707c0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 shutdown_connections 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f35d0078e80 0x7f35d007b340 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f360013f300 0x7f3600073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3600158890 0x7f360014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 --2- 10.20.193.10:0/3403777008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f35e8003fe0 0x7f360014b920 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:11.930 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 >> 10.20.193.10:0/3403777008 conn(0x7f36000c9d80 msgr2=0x7f360014cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:11.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 shutdown_connections 2026-02-17T11:58:11.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 -- 10.20.193.10:0/3403777008 wait complete. 2026-02-17T11:58:11.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:11.926+0000 7f3607629640 1 librados: shutdown 2026-02-17T11:58:14.937 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:15.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.004+0000 7f5c67e87640 10 monclient: get_monmap_and_config 2026-02-17T11:58:15.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.004+0000 7f5c67e87640 10 monclient: build_initial_monmap 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.004+0000 7f5c67e87640 10 monclient: monmap: 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:15.005937+0000 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:15.005937+0000 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:15.009 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 1 Processor -- start 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 1 -- start start 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 10 monclient: init 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 10 monclient: _add_conns ranks=[5,2,1,4,0,3] 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5c6015f5c0 0x7f5c6015f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 10 monclient(hunting): picked mon.noname-c con 0x7f5c6015f5c0 addr v2:10.20.193.153:3300/0 2026-02-17T11:58:15.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5c600c97f0 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5c6015e2f0 addr v1:10.20.193.71:6789/0 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c600c9d20 con 0x7f5c6015e2f0 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c600ca000 con 0x7f5c600c97f0 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5c600ca2e0 con 0x7f5c6015f5c0 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.005+0000 7f5c67e87640 10 monclient(hunting): authenticate will time out at 1164.727826s 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.006+0000 7f5c663fd640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f5c6015e2f0 0x7f5c601557a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:35372/0 (socket says 10.20.193.10:35372) 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.006+0000 7f5c663fd640 1 -- 10.20.193.10:0/2599347932 learned_addr learned my addr 10.20.193.10:0/2599347932 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.006+0000 7f5c65bfc640 1 --2- 10.20.193.10:0/2599347932 >> v2:10.20.193.153:3300/0 conn(0x7f5c6015f5c0 0x7f5c6015f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.006+0000 7f5c65bfc640 10 monclient(hunting): get_auth_request con 0x7f5c6015f5c0 auth_method 0 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.006+0000 7f5c65bfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:15.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.006+0000 7f5c65bfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:15.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.006+0000 7f5c65bfc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:15.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.007+0000 7f5c65bfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:15.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.007+0000 7f5c65bfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:15.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.007+0000 7f5c65bfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:15.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.007+0000 7f5c64bfa640 1 -- 10.20.193.10:0/2599347932 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029601523 0 0) 0x7f5c600c9d20 con 0x7f5c6015e2f0 2026-02-17T11:58:15.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.007+0000 7f5c64bfa640 10 monclient(hunting): _negotiate 2026-02-17T11:58:15.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.007+0000 7f5c64bfa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.007+0000 7f5c64bfa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.007+0000 7f5c64bfa640 10 monclient(hunting): my global_id is 4795 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.007+0000 7f5c64bfa640 1 -- 10.20.193.10:0/2599347932 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c48003620 con 0x7f5c6015e2f0 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.009+0000 7f5c65bfc640 10 monclient(hunting): handle_auth_done global_id 4838 payload 274 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.009+0000 7f5c65bfc640 1 -- 10.20.193.10:0/2599347932 >> v1:10.20.193.153:6789/0 conn(0x7f5c600c97f0 legacy=0x7f5c6015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.009+0000 7f5c65bfc640 1 -- 10.20.193.10:0/2599347932 >> v1:10.20.193.71:6789/0 conn(0x7f5c6015e2f0 legacy=0x7f5c601557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.009+0000 7f5c65bfc640 10 monclient: _finish_hunting 0 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.009+0000 7f5c65bfc640 1 monclient: found mon.noname-c 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.009+0000 7f5c65bfc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.009+0000 7f5c65bfc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.009+0000 7f5c65bfc640 1 -- 10.20.193.10:0/2599347932 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6015d400 con 0x7f5c6015f5c0 2026-02-17T11:58:15.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.010+0000 7f5c65bfc640 1 --2- 10.20.193.10:0/2599347932 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c6015f5c0 0x7f5c6015f9a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5c500098a0 tx=0x7f5c5002ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fc844a7ab0632d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:15.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 1 -- 10.20.193.10:0/2599347932 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5003c070 con 0x7f5c6015f5c0 2026-02-17T11:58:15.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:15.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:15.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 10 monclient: dump: 2026-02-17T11:58:15.019 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:15.019 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:15.019 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:15.019 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:15.019 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 10 monclient: _finish_auth 0 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 10 monclient: _check_auth_tickets 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 5 monclient: authenticate success, global_id 4838 2026-02-17T11:58:15.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 1 -- 10.20.193.10:0/2599347932 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c5002fc10 con 0x7f5c6015f5c0 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 1 -- 10.20.193.10:0/2599347932 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c50037440 con 0x7f5c6015f5c0 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 4 set_mon_vals no callback set 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c64bfa640 10 monclient: dump: 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:15.021 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 10 monclient: shutdown 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 1 -- 10.20.193.10:0/2599347932 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c6015f5c0 msgr2=0x7f5c6015f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 1 --2- 10.20.193.10:0/2599347932 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c6015f5c0 0x7f5c6015f9a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5c500098a0 tx=0x7f5c5002ef00 comp rx=0 tx=0).stop 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 1 -- 10.20.193.10:0/2599347932 shutdown_connections 2026-02-17T11:58:15.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 1 --2- 10.20.193.10:0/2599347932 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c6015f5c0 0x7f5c6015f9a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 1 -- 10.20.193.10:0/2599347932 >> 10.20.193.10:0/2599347932 conn(0x7f5c60073070 msgr2=0x7f5c60073480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 1 -- 10.20.193.10:0/2599347932 shutdown_connections 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 1 -- 10.20.193.10:0/2599347932 wait complete. 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 10 monclient: build_initial_monmap 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.013+0000 7f5c67e87640 10 monclient: monmap: 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:15.023 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 librados: starting msgr at 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 librados: starting objecter 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 Processor -- start 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 -- start start 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 librados: setting wanted keys 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 librados: calling monclient init 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient: init 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:15.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c600c97f0 0x7f5c60159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient(hunting): picked mon.noname-c con 0x7f5c600c97f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c6015e2f0 0x7f5c601f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient(hunting): picked mon.noname-a con 0x7f5c6015e2f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c6015f5c0 0x7f5c6014d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient(hunting): picked mon.noname-b con 0x7f5c6015f5c0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5c600cba80 con 0x7f5c6015e2f0 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6008f870 con 0x7f5c6015f5c0 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5c600cbc00 con 0x7f5c600c97f0 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c67e87640 10 monclient(hunting): authenticate will time out at 1164.736575s 2026-02-17T11:58:15.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c65bfc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c600c97f0 0x7f5c60159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.014+0000 7f5c653fb640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c6015e2f0 0x7f5c601f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c663fd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c6015f5c0 0x7f5c6014d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c65bfc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c600c97f0 0x7f5c60159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:52048/0 (socket says 10.20.193.10:52048) 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c65bfc640 1 -- 10.20.193.10:0/166169733 learned_addr learned my addr 10.20.193.10:0/166169733 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c653fb640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c6015e2f0 0x7f5c601f7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57314/0 (socket says 10.20.193.10:57314) 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c65bfc640 10 monclient(hunting): get_auth_request con 0x7f5c600c97f0 auth_method 0 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c65bfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c65bfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c65bfc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c653fb640 10 monclient(hunting): get_auth_request con 0x7f5c6015e2f0 auth_method 0 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c653fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:15.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c653fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c653fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c663fd640 10 monclient(hunting): get_auth_request con 0x7f5c6015f5c0 auth_method 0 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c663fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c663fd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c663fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c65bfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c65bfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c65bfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c653fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c653fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c653fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c663fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c663fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:15.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.015+0000 7f5c663fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 10 monclient(hunting): handle_auth_done global_id 4844 payload 824 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 1 -- 10.20.193.10:0/166169733 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c6015f5c0 msgr2=0x7f5c6014d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c6015f5c0 0x7f5c6014d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 1 -- 10.20.193.10:0/166169733 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c6015e2f0 msgr2=0x7f5c601f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c6015e2f0 0x7f5c601f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 10 monclient: _finish_hunting 0 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 1 monclient: found mon.noname-c 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:58:15.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.016+0000 7f5c65bfc640 1 -- 10.20.193.10:0/166169733 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c601f3fb0 con 0x7f5c600c97f0 2026-02-17T11:58:15.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.017+0000 7f5c65bfc640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c600c97f0 0x7f5c60159030 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009130 tx=0x7f5c500047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:15.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.017+0000 7f5c4e7fc640 10 client.?.objecter ms_handle_connect 0x7f5c600c97f0 2026-02-17T11:58:15.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.017+0000 7f5c4e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 1 -- 10.20.193.10:0/166169733 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5003c040 con 0x7f5c600c97f0 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 10 monclient: dump: 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:15.031 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 1 -- 10.20.193.10:0/166169733 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c50042630 con 0x7f5c600c97f0 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 1 -- 10.20.193.10:0/166169733 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c50042a20 con 0x7f5c600c97f0 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 5 monclient: authenticate success, global_id 4844 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 10 monclient: _renew_subs 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4ffff640 4 set_mon_vals no callback set 2026-02-17T11:58:15.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c601f4290 con 0x7f5c600c97f0 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c4e7fc640 10 monclient: dump: 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:15.033 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 10 client.4844.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 10 monclient: _renew_subs 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c601f4850 con 0x7f5c600c97f0 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 1 librados: init done 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:15.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.019+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c60159750 con 0x7f5c600c97f0 2026-02-17T11:58:15.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.031+0000 7f5c4e7fc640 1 -- 10.20.193.10:0/166169733 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5c5004b450 con 0x7f5c600c97f0 2026-02-17T11:58:15.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.032+0000 7f5c4e7fc640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c30078e80 0x7f5c3007b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:15.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.032+0000 7f5c653fb640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c30078e80 0x7f5c3007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:15.035 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.032+0000 7f5c653fb640 10 monclient: get_auth_request con 0x7f5c30078e80 auth_method 0 2026-02-17T11:58:15.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.032+0000 7f5c653fb640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c30078e80 0x7f5c3007b340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c601e99d0 tx=0x7f5c54007f40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:15.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.032+0000 7f5c4e7fc640 10 client.4844.objecter ms_handle_connect 0x7f5c30078e80 2026-02-17T11:58:15.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.134+0000 7f5c4e7fc640 1 -- 10.20.193.10:0/166169733 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5c5002fb50 con 0x7f5c600c97f0 2026-02-17T11:58:15.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.134+0000 7f5c4e7fc640 10 client.4844.objecter ms_dispatch2 0x7f5c60000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:15.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.134+0000 7f5c4e7fc640 3 client.4844.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:15.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.134+0000 7f5c4e7fc640 3 client.4844.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:15.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.134+0000 7f5c4e7fc640 20 client.4844.objecter dump_active .. 0 homeless 2026-02-17T11:58:15.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.142+0000 7f5c4e7fc640 1 -- 10.20.193.10:0/166169733 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5c500867b0 con 0x7f5c600c97f0 2026-02-17T11:58:15.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.142+0000 7f5c4e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:15.143 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.142+0000 7f5c4e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:15.226 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:04:32.394 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:15.228 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:04:32.396 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:15.239 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:04:32.407 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:15.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.244+0000 7f5c67e87640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:15.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.244+0000 7f5c67e87640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:15.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.244+0000 7f5c67e87640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:15.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.244+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5c60074f10 con 0x7f5c600c97f0 2026-02-17T11:58:15.256 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:04:32.385 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:15.257 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:04:32.420 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:15.259 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:04:32.422 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:15.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.258+0000 7f5c4e7fc640 1 -- 10.20.193.10:0/166169733 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f5c5008aab0 con 0x7f5c600c97f0 2026-02-17T11:58:15.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.258+0000 7f5c4e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:15.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.258+0000 7f5c4e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:15.260 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:15.261 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:15.261 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:04:32.389 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:15.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 10 librados: watch_flush enter 2026-02-17T11:58:15.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 10 librados: watch_flush exit 2026-02-17T11:58:15.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 20 client.4844.objecter shutdown clearing up homeless session... 2026-02-17T11:58:15.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 10 client.4844.objecter successfully canceled tick 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c30078e80 msgr2=0x7f5c3007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c30078e80 0x7f5c3007b340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c601e99d0 tx=0x7f5c54007f40 comp rx=0 tx=0).stop 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 10 monclient: shutdown 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c600c97f0 msgr2=0x7f5c60159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c600c97f0 0x7f5c60159030 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009130 tx=0x7f5c500047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 shutdown_connections 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c30078e80 0x7f5c3007b340 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5c6015f5c0 0x7f5c6014d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5c6015e2f0 0x7f5c601f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:15.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 --2- 10.20.193.10:0/166169733 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5c600c97f0 0x7f5c60159030 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:15.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 >> 10.20.193.10:0/166169733 conn(0x7f5c60073070 msgr2=0x7f5c60154710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:15.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 shutdown_connections 2026-02-17T11:58:15.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 -- 10.20.193.10:0/166169733 wait complete. 2026-02-17T11:58:15.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:15.260+0000 7f5c67e87640 1 librados: shutdown 2026-02-17T11:58:15.269 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:04:32.432 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:15.272 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:04:32.400 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:18.272 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:18.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.339+0000 7f4dfac7c640 10 monclient: get_monmap_and_config 2026-02-17T11:58:18.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.339+0000 7f4dfac7c640 10 monclient: build_initial_monmap 2026-02-17T11:58:18.342 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.339+0000 7f4dfac7c640 10 monclient: monmap: 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:18.341148+0000 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:18.341148+0000 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:18.343 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:18.344 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:18.344 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:18.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 1 Processor -- start 2026-02-17T11:58:18.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 1 -- start start 2026-02-17T11:58:18.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient: init 2026-02-17T11:58:18.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:18.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient: _add_conns ranks=[1,4,3,2,5,0] 2026-02-17T11:58:18.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f4df4155e80 addr v1:10.20.193.71:6789/0 2026-02-17T11:58:18.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f4df4074cd0 0x7f4df40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient(hunting): picked mon.noname-b con 0x7f4df4074cd0 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:18.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f4df4156260 0x7f4df40cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient(hunting): picked mon.noname-a con 0x7f4df4156260 addr v2:10.20.193.10:3300/0 2026-02-17T11:58:18.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df4073520 con 0x7f4df4155e80 2026-02-17T11:58:18.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f4df40cd840 con 0x7f4df4156260 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4df4073800 con 0x7f4df4074cd0 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.340+0000 7f4dfac7c640 10 monclient(hunting): authenticate will time out at 1168.062978s 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f4df4156260 0x7f4df40cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4debfff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f4df4074cd0 0x7f4df40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f4df4156260 0x7f4df40cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57324/0 (socket says 10.20.193.10:57324) 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 1 -- 10.20.193.10:0/3141644946 learned_addr learned my addr 10.20.193.10:0/3141644946 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:18.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 10 monclient(hunting): get_auth_request con 0x7f4df4156260 auth_method 0 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4df91f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4debfff640 10 monclient(hunting): get_auth_request con 0x7f4df4074cd0 auth_method 0 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4debfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4debfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.341+0000 7f4debfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:18.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4debfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4debfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4debfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4df91f2640 10 monclient(hunting): handle_auth_done global_id 4773 payload 274 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4df91f2640 1 -- 10.20.193.10:0/3141644946 >> v2:10.20.193.71:3300/0 conn(0x7f4df4074cd0 msgr2=0x7f4df40ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4df91f2640 1 --2- 10.20.193.10:0/3141644946 >> v2:10.20.193.71:3300/0 conn(0x7f4df4074cd0 0x7f4df40ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4df91f2640 1 -- 10.20.193.10:0/3141644946 >> v1:10.20.193.71:6789/0 conn(0x7f4df4155e80 legacy=0x7f4df40745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4df91f2640 10 monclient: _finish_hunting 0 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4df91f2640 1 monclient: found mon.noname-a 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4df91f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:18.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4df91f2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:18.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.342+0000 7f4df91f2640 1 -- 10.20.193.10:0/3141644946 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df4073ae0 con 0x7f4df4156260 2026-02-17T11:58:18.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.343+0000 7f4df91f2640 1 --2- 10.20.193.10:0/3141644946 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4156260 0x7f4df40cd100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4df408f5e0 tx=0x7f4df002f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f8df860853f20a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:18.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 1 -- 10.20.193.10:0/3141644946 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df002fd70 con 0x7f4df4156260 2026-02-17T11:58:18.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 10 monclient: dump: 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:18.359 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:18.360 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:18.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:18.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:18.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:18.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 1 -- 10.20.193.10:0/3141644946 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df00373f0 con 0x7f4df4156260 2026-02-17T11:58:18.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4dfac7c640 5 monclient: authenticate success, global_id 4773 2026-02-17T11:58:18.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4dfac7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:18.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:18.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 1 -- 10.20.193.10:0/3141644946 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df00377c0 con 0x7f4df4156260 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4dfac7c640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4dfac7c640 4 set_mon_vals no callback set 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.345+0000 7f4deb7fe640 10 monclient: dump: 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:18.361 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 10 monclient: shutdown 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 1 -- 10.20.193.10:0/3141644946 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4156260 msgr2=0x7f4df40cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 1 --2- 10.20.193.10:0/3141644946 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4156260 0x7f4df40cd100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4df408f5e0 tx=0x7f4df002f270 comp rx=0 tx=0).stop 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 1 -- 10.20.193.10:0/3141644946 shutdown_connections 2026-02-17T11:58:18.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 1 --2- 10.20.193.10:0/3141644946 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4156260 0x7f4df40cd100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 1 --2- 10.20.193.10:0/3141644946 >> v2:10.20.193.71:3300/0 conn(0x7f4df4074cd0 0x7f4df40ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 1 -- 10.20.193.10:0/3141644946 >> 10.20.193.10:0/3141644946 conn(0x7f4df40ce2b0 msgr2=0x7f4df40ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 1 -- 10.20.193.10:0/3141644946 shutdown_connections 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 1 -- 10.20.193.10:0/3141644946 wait complete. 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 10 monclient: build_initial_monmap 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.346+0000 7f4dfac7c640 10 monclient: monmap: 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:18.363 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 librados: starting msgr at 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 librados: starting objecter 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 Processor -- start 2026-02-17T11:58:18.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 -- start start 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 librados: setting wanted keys 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 librados: calling monclient init 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient: init 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4074cd0 0x7f4df414a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient(hunting): picked mon.noname-a con 0x7f4df4074cd0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4df4155e80 0x7f4df4157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient(hunting): picked mon.noname-b con 0x7f4df4155e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:18.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4df4156260 0x7f4df41582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient(hunting): picked mon.noname-c con 0x7f4df4156260 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f4df40c4870 con 0x7f4df4074cd0 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4df40740a0 con 0x7f4df4155e80 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4df40c49f0 con 0x7f4df4156260 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4dfac7c640 10 monclient(hunting): authenticate will time out at 1168.069518s 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4df89f1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4074cd0 0x7f4df414a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4df89f1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4074cd0 0x7f4df414a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57340/0 (socket says 10.20.193.10:57340) 2026-02-17T11:58:18.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4df89f1640 1 -- 10.20.193.10:0/1191944941 learned_addr learned my addr 10.20.193.10:0/1191944941 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:18.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4df89f1640 10 monclient(hunting): get_auth_request con 0x7f4df4074cd0 auth_method 0 2026-02-17T11:58:18.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4df89f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:18.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4df89f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.347+0000 7f4df89f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:18.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4debfff640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4df4155e80 0x7f4df4157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df91f2640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4df4156260 0x7f4df41582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df89f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:18.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df89f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df89f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4debfff640 10 monclient(hunting): get_auth_request con 0x7f4df4155e80 auth_method 0 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4debfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4debfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4debfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4debfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4debfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4debfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df91f2640 10 monclient(hunting): get_auth_request con 0x7f4df4156260 auth_method 0 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df91f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df91f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:18.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df91f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df91f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df91f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.348+0000 7f4df91f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 10 monclient(hunting): handle_auth_done global_id 4776 payload 824 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 1 -- 10.20.193.10:0/1191944941 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4df4156260 msgr2=0x7f4df41582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4df4156260 0x7f4df41582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 1 -- 10.20.193.10:0/1191944941 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4df4155e80 msgr2=0x7f4df4157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4df4155e80 0x7f4df4157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 10 monclient: _finish_hunting 0 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 1 monclient: found mon.noname-a 2026-02-17T11:58:18.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.349+0000 7f4df89f1640 1 -- 10.20.193.10:0/1191944941 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df41f3c80 con 0x7f4df4074cd0 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.350+0000 7f4df89f1640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4074cd0 0x7f4df414a680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c5b0 tx=0x7f4de400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.350+0000 7f4de97fa640 10 client.?.objecter ms_handle_connect 0x7f4df4074cd0 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.350+0000 7f4de97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 1 -- 10.20.193.10:0/1191944941 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40052d0 con 0x7f4df4074cd0 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 10 monclient: dump: 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:18.370 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 10 monclient: _finish_auth 0 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:58:18.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 1 -- 10.20.193.10:0/1191944941 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de4005470 con 0x7f4df4074cd0 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 5 monclient: authenticate success, global_id 4776 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 10 monclient: _renew_subs 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df41f3f60 con 0x7f4df4074cd0 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 1 -- 10.20.193.10:0/1191944941 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40038f0 con 0x7f4df4074cd0 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4de97fa640 10 monclient: dump: 2026-02-17T11:58:18.372 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4deaffd640 4 set_mon_vals no callback set 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 10 client.4776.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:18.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 10 monclient: _renew_subs 2026-02-17T11:58:18.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:18.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df41f4520 con 0x7f4df4074cd0 2026-02-17T11:58:18.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 1 librados: init done 2026-02-17T11:58:18.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:18.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:18.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:18.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.352+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df40745c0 con 0x7f4df4074cd0 2026-02-17T11:58:18.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.363+0000 7f4de97fa640 1 -- 10.20.193.10:0/1191944941 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f4de4003a90 con 0x7f4df4074cd0 2026-02-17T11:58:18.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.364+0000 7f4de97fa640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4dc4078e30 0x7f4dc407b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:18.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.364+0000 7f4debfff640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4dc4078e30 0x7f4dc407b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:18.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.364+0000 7f4debfff640 10 monclient: get_auth_request con 0x7f4dc4078e30 auth_method 0 2026-02-17T11:58:18.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.364+0000 7f4debfff640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4dc4078e30 0x7f4dc407b2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4df4159780 tx=0x7f4ddc009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:18.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.364+0000 7f4de97fa640 10 client.4776.objecter ms_handle_connect 0x7f4dc4078e30 2026-02-17T11:58:18.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.366+0000 7f4de97fa640 1 -- 10.20.193.10:0/1191944941 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f4de405e000 con 0x7f4df4074cd0 2026-02-17T11:58:18.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.366+0000 7f4de97fa640 10 client.4776.objecter ms_dispatch2 0x7f4df4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:18.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.366+0000 7f4de97fa640 3 client.4776.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:18.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.366+0000 7f4de97fa640 3 client.4776.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:18.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.366+0000 7f4de97fa640 20 client.4776.objecter dump_active .. 0 homeless 2026-02-17T11:58:18.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.465+0000 7f4de97fa640 1 -- 10.20.193.10:0/1191944941 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4de4061fc0 con 0x7f4df4074cd0 2026-02-17T11:58:18.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.465+0000 7f4de97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:18.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.465+0000 7f4de97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:18.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.563+0000 7f4dfac7c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:18.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.563+0000 7f4dfac7c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:18.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.563+0000 7f4dfac7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:18.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.563+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4df40caaa0 con 0x7f4df4074cd0 2026-02-17T11:58:18.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.565+0000 7f4de97fa640 1 -- 10.20.193.10:0/1191944941 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f4de40662c0 con 0x7f4df4074cd0 2026-02-17T11:58:18.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.565+0000 7f4de97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:18.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.565+0000 7f4de97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:18.568 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:18.568 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:18.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 10 librados: watch_flush enter 2026-02-17T11:58:18.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 10 librados: watch_flush exit 2026-02-17T11:58:18.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 20 client.4776.objecter shutdown clearing up homeless session... 2026-02-17T11:58:18.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 10 client.4776.objecter successfully canceled tick 2026-02-17T11:58:18.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4dc4078e30 msgr2=0x7f4dc407b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4dc4078e30 0x7f4dc407b2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4df4159780 tx=0x7f4ddc009290 comp rx=0 tx=0).stop 2026-02-17T11:58:18.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 10 monclient: shutdown 2026-02-17T11:58:18.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4074cd0 msgr2=0x7f4df414a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4074cd0 0x7f4df414a680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c5b0 tx=0x7f4de400ca80 comp rx=0 tx=0).stop 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 shutdown_connections 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4dc4078e30 0x7f4dc407b2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4df4156260 0x7f4df41582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4df4155e80 0x7f4df4157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 --2- 10.20.193.10:0/1191944941 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4df4074cd0 0x7f4df414a680 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 >> 10.20.193.10:0/1191944941 conn(0x7f4df40ce2b0 msgr2=0x7f4df40ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 shutdown_connections 2026-02-17T11:58:18.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 -- 10.20.193.10:0/1191944941 wait complete. 2026-02-17T11:58:18.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:18.566+0000 7f4dfac7c640 1 librados: shutdown 2026-02-17T11:58:21.578 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:21.646 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.644+0000 7f16154ca640 10 monclient: get_monmap_and_config 2026-02-17T11:58:21.646 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.644+0000 7f16154ca640 10 monclient: build_initial_monmap 2026-02-17T11:58:21.646 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.644+0000 7f16154ca640 10 monclient: monmap: 2026-02-17T11:58:21.646 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:21.646 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:21.646 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:21.645444+0000 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:21.645444+0000 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:21.647 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:21.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.644+0000 7f16154ca640 1 Processor -- start 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.644+0000 7f16154ca640 1 -- start start 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.644+0000 7f16154ca640 10 monclient: init 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 10 monclient: _add_conns ranks=[0,2,1,4,3,5] 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1610152660 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f161015b030 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f16100c6ce0 addr v1:10.20.193.71:6789/0 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16100c71e0 con 0x7f1610152660 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16100c74c0 con 0x7f16100c6ce0 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1610159e40 con 0x7f161015b030 2026-02-17T11:58:21.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:21.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f16154ca640 10 monclient(hunting): authenticate will time out at 1171.367252s 2026-02-17T11:58:21.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f160effd640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f1610152660 0x7f161015a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:39734/0 (socket says 10.20.193.10:39734) 2026-02-17T11:58:21.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.645+0000 7f160effd640 1 -- 10.20.193.10:0/3529910262 learned_addr learned my addr 10.20.193.10:0/3529910262 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:21.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.646+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 794849852 0 0) 0x7f16100c74c0 con 0x7f16100c6ce0 2026-02-17T11:58:21.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.646+0000 7f160dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:58:21.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.646+0000 7f160dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:21.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.646+0000 7f160dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:21.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.646+0000 7f160dffb640 10 monclient(hunting): my global_id is 4810 2026-02-17T11:58:21.656 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.646+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15fc0058b0 con 0x7f16100c6ce0 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415933318 0 0) 0x7f16100c71e0 con 0x7f1610152660 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 10 monclient(hunting): my global_id is 4779 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16100c74c0 con 0x7f1610152660 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472093457 0 0) 0x7f1610159e40 con 0x7f161015b030 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 10 monclient(hunting): my global_id is 4850 2026-02-17T11:58:21.657 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.647+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16100c71e0 con 0x7f161015b030 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1545317285 0 0) 0x7f15fc0058b0 con 0x7f16100c6ce0 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 >> v1:10.20.193.153:6789/0 conn(0x7f161015b030 legacy=0x7f16100c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 >> v1:10.20.193.10:6789/0 conn(0x7f1610152660 legacy=0x7f161015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient: _finish_hunting 0 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161015a120 con 0x7f16100c6ce0 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f1600003280 con 0x7f16100c6ce0 2026-02-17T11:58:21.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient: dump: 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:21.659 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 >> v1:10.20.193.71:6789/0 conn(0x7f16100c6ce0 legacy=0x7f16101631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15fc006270 0x7f15fc006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient(hunting): picked mon.c con 0x7f15fc006270 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f15fc0070d0 0x7f15fc007550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient(hunting): picked mon.b con 0x7f15fc0070d0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f15fc00e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient(hunting): picked mon.a con 0x7f15fc00bd40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:21.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc00e800 con 0x7f15fc00bd40 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc00e980 con 0x7f15fc0070d0 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc00eb80 con 0x7f15fc006270 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.648+0000 7f160dffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.649+0000 7f160effd640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15fc006270 0x7f15fc006b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.649+0000 7f160f7fe640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f15fc00e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.649+0000 7f160effd640 10 monclient(hunting): get_auth_request con 0x7f15fc006270 auth_method 0 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.649+0000 7f160effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.649+0000 7f160effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:21.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.649+0000 7f160effd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.649+0000 7f160e7fc640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f15fc0070d0 0x7f15fc007550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160f7fe640 10 monclient(hunting): get_auth_request con 0x7f15fc00bd40 auth_method 0 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160e7fc640 10 monclient(hunting): get_auth_request con 0x7f15fc0070d0 auth_method 0 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:21.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.650+0000 7f160e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 10 monclient(hunting): handle_auth_done global_id 4810 payload 293 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 1 -- 10.20.193.10:0/3529910262 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15fc006270 msgr2=0x7f15fc006b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15fc006270 0x7f15fc006b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 1 -- 10.20.193.10:0/3529910262 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f15fc0070d0 msgr2=0x7f15fc007550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f15fc0070d0 0x7f15fc007550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 1 monclient: found mon.a 2026-02-17T11:58:21.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:21.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:21.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 1 -- 10.20.193.10:0/3529910262 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc0058b0 con 0x7f15fc00bd40 2026-02-17T11:58:21.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:21.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:21.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:21.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f16154ca640 5 monclient: authenticate success, global_id 4810 2026-02-17T11:58:21.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f16154ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:21.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.651+0000 7f160f7fe640 1 -- 10.20.193.10:0/3529910262 reap_dead start 2026-02-17T11:58:21.664 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.652+0000 7f160f7fe640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f15fc00e130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f160000a7b0 tx=0x7f160002fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47857535f7c1102 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:21.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160000a3d0 con 0x7f15fc00bd40 2026-02-17T11:58:21.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:21.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:21.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 10 monclient: dump: 2026-02-17T11:58:21.671 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:21.671 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f16154ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1600033650 con 0x7f15fc00bd40 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:21.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 1 -- 10.20.193.10:0/3529910262 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600033a40 con 0x7f15fc00bd40 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f160dffb640 10 monclient: dump: 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:21.673 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f16154ca640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.653+0000 7f16154ca640 4 set_mon_vals no callback set 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 10 monclient: shutdown 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 1 -- 10.20.193.10:0/3529910262 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 msgr2=0x7f15fc00e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f15fc00e130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f160000a7b0 tx=0x7f160002fb60 comp rx=0 tx=0).stop 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 1 -- 10.20.193.10:0/3529910262 shutdown_connections 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 1 --2- 10.20.193.10:0/3529910262 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f15fc00e130 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 1 -- 10.20.193.10:0/3529910262 >> 10.20.193.10:0/3529910262 conn(0x7f16100c9d80 msgr2=0x7f16100ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 1 -- 10.20.193.10:0/3529910262 shutdown_connections 2026-02-17T11:58:21.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 1 -- 10.20.193.10:0/3529910262 wait complete. 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 10 monclient: build_initial_monmap 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.654+0000 7f16154ca640 10 monclient: monmap: 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 librados: starting msgr at 2026-02-17T11:58:21.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 librados: starting objecter 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 Processor -- start 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 -- start start 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 librados: setting wanted keys 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 librados: calling monclient init 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient: init 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f1610074470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient(hunting): picked mon.noname-a con 0x7f15fc00bd40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f16100c8e70 0x7f16101530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient(hunting): picked mon.noname-b con 0x7f16100c8e70 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16100c92f0 0x7f16101f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient(hunting): picked mon.noname-c con 0x7f16100c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:21.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f1610152a40 con 0x7f15fc00bd40 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f16100c77a0 con 0x7f16100c8e70 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1610152bc0 con 0x7f16100c92f0 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f16154ca640 10 monclient(hunting): authenticate will time out at 1171.377536s 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f160effd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f1610074470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f160f7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16100c92f0 0x7f16101f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.655+0000 7f160e7fc640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f16100c8e70 0x7f16101530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160effd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f1610074470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57366/0 (socket says 10.20.193.10:57366) 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160effd640 1 -- 10.20.193.10:0/3229781738 learned_addr learned my addr 10.20.193.10:0/3229781738 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160effd640 10 monclient(hunting): get_auth_request con 0x7f15fc00bd40 auth_method 0 2026-02-17T11:58:21.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160e7fc640 10 monclient(hunting): get_auth_request con 0x7f16100c8e70 auth_method 0 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160f7fe640 10 monclient(hunting): get_auth_request con 0x7f16100c92f0 auth_method 0 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:21.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.656+0000 7f160e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 10 monclient(hunting): handle_auth_done global_id 4782 payload 824 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 1 -- 10.20.193.10:0/3229781738 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16100c92f0 msgr2=0x7f16101f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16100c92f0 0x7f16101f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 1 -- 10.20.193.10:0/3229781738 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f16100c8e70 msgr2=0x7f16101530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f16100c8e70 0x7f16101530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 10 monclient: _finish_hunting 0 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 1 monclient: found mon.noname-a 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:21.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.657+0000 7f160effd640 1 -- 10.20.193.10:0/3229781738 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161014bf70 con 0x7f15fc00bd40 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.658+0000 7f160effd640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f1610074470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1604007090 tx=0x7f1604007560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.658+0000 7f15ef7fe640 10 client.?.objecter ms_handle_connect 0x7f15fc00bd40 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.658+0000 7f15ef7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 1 -- 10.20.193.10:0/3229781738 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160401a070 con 0x7f15fc00bd40 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 10 monclient: dump: 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:21.680 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 5 monclient: authenticate success, global_id 4782 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 1 -- 10.20.193.10:0/3229781738 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160400f7b0 con 0x7f15fc00bd40 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 1 -- 10.20.193.10:0/3229781738 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160400fb80 con 0x7f15fc00bd40 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 10 monclient: _renew_subs 2026-02-17T11:58:21.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16100749b0 con 0x7f15fc00bd40 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f160d7fa640 4 set_mon_vals no callback set 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f15ef7fe640 10 monclient: dump: 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:21.682 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:21.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 10 client.4782.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:21.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 10 monclient: _renew_subs 2026-02-17T11:58:21.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:21.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101f36a0 con 0x7f15fc00bd40 2026-02-17T11:58:21.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 1 librados: init done 2026-02-17T11:58:21.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:21.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:21.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:21.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.660+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f161015a920 con 0x7f15fc00bd40 2026-02-17T11:58:21.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.671+0000 7f15ef7fe640 1 -- 10.20.193.10:0/3229781738 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f160400fd20 con 0x7f15fc00bd40 2026-02-17T11:58:21.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.672+0000 7f15ef7fe640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f15dc078e80 0x7f15dc07b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:21.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.672+0000 7f160e7fc640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f15dc078e80 0x7f15dc07b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:21.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.672+0000 7f160e7fc640 10 monclient: get_auth_request con 0x7f15dc078e80 auth_method 0 2026-02-17T11:58:21.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.672+0000 7f160e7fc640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f15dc078e80 0x7f15dc07b340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1610073550 tx=0x7f15f8005050 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:21.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.672+0000 7f15ef7fe640 10 client.4782.objecter ms_handle_connect 0x7f15dc078e80 2026-02-17T11:58:21.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.673+0000 7f15ef7fe640 1 -- 10.20.193.10:0/3229781738 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f160405d740 con 0x7f15fc00bd40 2026-02-17T11:58:21.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.673+0000 7f15ef7fe640 10 client.4782.objecter ms_dispatch2 0x7f1610000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:21.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.673+0000 7f15ef7fe640 3 client.4782.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:21.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.673+0000 7f15ef7fe640 3 client.4782.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:21.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.673+0000 7f15ef7fe640 20 client.4782.objecter dump_active .. 0 homeless 2026-02-17T11:58:21.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.772+0000 7f15ef7fe640 1 -- 10.20.193.10:0/3229781738 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1604096e20 con 0x7f15fc00bd40 2026-02-17T11:58:21.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.772+0000 7f15ef7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:21.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.772+0000 7f15ef7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:21.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.871+0000 7f16154ca640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:21.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.871+0000 7f16154ca640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:21.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.871+0000 7f16154ca640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:21.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.871+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1610150dd0 con 0x7f15fc00bd40 2026-02-17T11:58:21.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.874+0000 7f15ef7fe640 1 -- 10.20.193.10:0/3229781738 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f1604025080 con 0x7f15fc00bd40 2026-02-17T11:58:21.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.874+0000 7f15ef7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:21.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.874+0000 7f15ef7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:21.875 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:21.876 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 10 librados: watch_flush enter 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 10 librados: watch_flush exit 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 20 client.4782.objecter shutdown clearing up homeless session... 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 10 client.4782.objecter successfully canceled tick 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f15dc078e80 msgr2=0x7f15dc07b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f15dc078e80 0x7f15dc07b340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1610073550 tx=0x7f15f8005050 comp rx=0 tx=0).stop 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 10 monclient: shutdown 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 msgr2=0x7f1610074470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f1610074470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1604007090 tx=0x7f1604007560 comp rx=0 tx=0).stop 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 shutdown_connections 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f15dc078e80 0x7f15dc07b340 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f16100c92f0 0x7f16101f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f16100c8e70 0x7f16101530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 --2- 10.20.193.10:0/3229781738 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f15fc00bd40 0x7f1610074470 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 >> 10.20.193.10:0/3229781738 conn(0x7f16100c9d80 msgr2=0x7f161015bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 shutdown_connections 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 -- 10.20.193.10:0/3229781738 wait complete. 2026-02-17T11:58:21.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:21.875+0000 7f16154ca640 1 librados: shutdown 2026-02-17T11:58:24.886 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.951+0000 7f5f6b2fa640 10 monclient: get_monmap_and_config 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.951+0000 7f5f6b2fa640 10 monclient: build_initial_monmap 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.951+0000 7f5f6b2fa640 10 monclient: monmap: 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:24.952485+0000 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:24.952485+0000 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:24.953 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.951+0000 7f5f6b2fa640 1 Processor -- start 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.951+0000 7f5f6b2fa640 1 -- start start 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.951+0000 7f5f6b2fa640 10 monclient: init 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 10 monclient: _add_conns ranks=[2,5,0,4,3,1] 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5f6415d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5f640c92f0 0x7f5f6415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 10 monclient(hunting): picked mon.noname-c con 0x7f5f640c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5f64074920 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f640c58a0 con 0x7f5f64074920 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f640c55c0 con 0x7f5f6415d220 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5f640c7e20 con 0x7f5f640c92f0 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6b2fa640 10 monclient(hunting): authenticate will time out at 1174.674175s 2026-02-17T11:58:24.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f69870640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f5f64074920 0x7f5f64153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:35792/0 (socket says 10.20.193.10:35792) 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f69870640 1 -- 10.20.193.10:0/821686327 learned_addr learned my addr 10.20.193.10:0/821686327 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.952+0000 7f5f6886e640 1 --2- 10.20.193.10:0/821686327 >> v2:10.20.193.153:3300/0 conn(0x7f5f640c92f0 0x7f5f6415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.953+0000 7f5f6886e640 10 monclient(hunting): get_auth_request con 0x7f5f640c92f0 auth_method 0 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.953+0000 7f5f6886e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.953+0000 7f5f6886e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.953+0000 7f5f6886e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.953+0000 7f5f6886e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.953+0000 7f5f6886e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.953+0000 7f5f6886e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.953+0000 7f5f53fff640 1 -- 10.20.193.10:0/821686327 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427714609 0 0) 0x7f5f640c58a0 con 0x7f5f64074920 2026-02-17T11:58:24.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f53fff640 10 monclient(hunting): _negotiate 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f53fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f53fff640 10 monclient(hunting): my global_id is 4785 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f53fff640 1 -- 10.20.193.10:0/821686327 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f4c003620 con 0x7f5f64074920 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f6886e640 10 monclient(hunting): handle_auth_done global_id 4856 payload 274 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f6886e640 1 -- 10.20.193.10:0/821686327 >> v1:10.20.193.153:6789/0 conn(0x7f5f6415d220 legacy=0x7f5f640c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f6886e640 1 -- 10.20.193.10:0/821686327 >> v1:10.20.193.10:6789/0 conn(0x7f5f64074920 legacy=0x7f5f64153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f6886e640 10 monclient: _finish_hunting 0 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f6886e640 1 monclient: found mon.noname-c 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f6886e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f6886e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:58:24.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.954+0000 7f5f6886e640 1 -- 10.20.193.10:0/821686327 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f640c8100 con 0x7f5f640c92f0 2026-02-17T11:58:24.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.956+0000 7f5f6886e640 1 --2- 10.20.193.10:0/821686327 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f640c92f0 0x7f5f6415d600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f580098d0 tx=0x7f5f5802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5322de685fe51f95 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 1 -- 10.20.193.10:0/821686327 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5803c070 con 0x7f5f640c92f0 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 10 monclient: dump: 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 10 monclient: _finish_auth 0 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:24.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 1 -- 10.20.193.10:0/821686327 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5802fba0 con 0x7f5f640c92f0 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 1 -- 10.20.193.10:0/821686327 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58037440 con 0x7f5f640c92f0 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f53fff640 10 monclient: dump: 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 5 monclient: authenticate success, global_id 4856 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 4 set_mon_vals no callback set 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 10 monclient: shutdown 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/821686327 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f640c92f0 msgr2=0x7f5f6415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:24.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 1 --2- 10.20.193.10:0/821686327 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f640c92f0 0x7f5f6415d600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f580098d0 tx=0x7f5f5802eed0 comp rx=0 tx=0).stop 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/821686327 shutdown_connections 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 1 --2- 10.20.193.10:0/821686327 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f640c92f0 0x7f5f6415d600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/821686327 >> 10.20.193.10:0/821686327 conn(0x7f5f640c9d80 msgr2=0x7f5f640ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/821686327 shutdown_connections 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.958+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/821686327 wait complete. 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.959+0000 7f5f6b2fa640 10 monclient: build_initial_monmap 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.959+0000 7f5f6b2fa640 10 monclient: monmap: 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.959+0000 7f5f6b2fa640 1 librados: starting msgr at 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.959+0000 7f5f6b2fa640 1 librados: starting objecter 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.959+0000 7f5f6b2fa640 1 Processor -- start 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.959+0000 7f5f6b2fa640 1 -- start start 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.959+0000 7f5f6b2fa640 1 librados: setting wanted keys 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.959+0000 7f5f6b2fa640 1 librados: calling monclient init 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.959+0000 7f5f6b2fa640 10 monclient: init 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:24.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5f64074920 0x7f5f6415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient(hunting): picked mon.noname-b con 0x7f5f64074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5f640c92f0 0x7f5f641f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient(hunting): picked mon.noname-a con 0x7f5f640c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f6415d220 0x7f5f640724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient(hunting): picked mon.noname-c con 0x7f5f6415d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5f64074d70 con 0x7f5f640c92f0 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f640c86c0 con 0x7f5f64074920 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5f64153d60 con 0x7f5f6415d220 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6b2fa640 10 monclient(hunting): authenticate will time out at 1174.682062s 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5f640c92f0 0x7f5f641f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f69870640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f6415d220 0x7f5f640724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5f640c92f0 0x7f5f641f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:40258/0 (socket says 10.20.193.10:40258) 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 1 -- 10.20.193.10:0/215785837 learned_addr learned my addr 10.20.193.10:0/215785837 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 10 monclient(hunting): get_auth_request con 0x7f5f640c92f0 auth_method 0 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f69870640 10 monclient(hunting): get_auth_request con 0x7f5f6415d220 auth_method 0 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f69870640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f69870640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f69870640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6906f640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5f64074920 0x7f5f6415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6886e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:24.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f69870640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f69870640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f69870640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6906f640 10 monclient(hunting): get_auth_request con 0x7f5f64074920 auth_method 0 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6906f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6906f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.960+0000 7f5f6906f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.961+0000 7f5f6906f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.961+0000 7f5f6906f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.961+0000 7f5f6906f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 10 monclient(hunting): handle_auth_done global_id 4862 payload 824 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 1 -- 10.20.193.10:0/215785837 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5f64074920 msgr2=0x7f5f6415c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5f64074920 0x7f5f6415c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 1 -- 10.20.193.10:0/215785837 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5f640c92f0 msgr2=0x7f5f641f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5f640c92f0 0x7f5f641f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 10 monclient: _finish_hunting 0 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 1 monclient: found mon.noname-c 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:24.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:58:24.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.962+0000 7f5f69870640 1 -- 10.20.193.10:0/215785837 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f64145e90 con 0x7f5f6415d220 2026-02-17T11:58:24.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.963+0000 7f5f69870640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f6415d220 0x7f5f640724d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000cab0 tx=0x7f5f6000cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:24.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.963+0000 7f5f51ffb640 10 client.?.objecter ms_handle_connect 0x7f5f6415d220 2026-02-17T11:58:24.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.963+0000 7f5f51ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:24.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 1 -- 10.20.193.10:0/215785837 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000ac40 con 0x7f5f6415d220 2026-02-17T11:58:24.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:24.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:24.966 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 10 monclient: dump: 2026-02-17T11:58:24.966 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 5 monclient: authenticate success, global_id 4862 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 10 monclient: _renew_subs 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f64074190 con 0x7f5f6415d220 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 10 client.4862.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 10 monclient: _renew_subs 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f641f1ab0 con 0x7f5f6415d220 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 1 librados: init done 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 1 -- 10.20.193.10:0/215785837 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6000ade0 con 0x7f5f6415d220 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 1 -- 10.20.193.10:0/215785837 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6001b600 con 0x7f5f6415d220 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f51ffb640 10 monclient: dump: 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:24.967 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f537fe640 4 set_mon_vals no callback set 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.964+0000 7f5f6b2fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.965+0000 7f5f6b2fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.965+0000 7f5f6b2fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:24.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.965+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6415d600 con 0x7f5f6415d220 2026-02-17T11:58:24.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.976+0000 7f5f51ffb640 1 -- 10.20.193.10:0/215785837 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5f6001b7a0 con 0x7f5f6415d220 2026-02-17T11:58:24.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f51ffb640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f34078e00 0x7f5f3407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:24.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f6906f640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f34078e00 0x7f5f3407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:24.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f6906f640 10 monclient: get_auth_request con 0x7f5f34078e00 auth_method 0 2026-02-17T11:58:24.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f6906f640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f34078e00 0x7f5f3407b2c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f54002410 tx=0x7f5f54007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:24.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f51ffb640 10 client.4862.objecter ms_handle_connect 0x7f5f34078e00 2026-02-17T11:58:24.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f51ffb640 1 -- 10.20.193.10:0/215785837 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5f6005e810 con 0x7f5f6415d220 2026-02-17T11:58:24.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f51ffb640 10 client.4862.objecter ms_dispatch2 0x7f5f64000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:24.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f51ffb640 3 client.4862.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:24.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f51ffb640 3 client.4862.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:24.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:24.977+0000 7f5f51ffb640 20 client.4862.objecter dump_active .. 0 homeless 2026-02-17T11:58:25.083 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.082+0000 7f5f51ffb640 1 -- 10.20.193.10:0/215785837 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5f600627d0 con 0x7f5f6415d220 2026-02-17T11:58:25.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.082+0000 7f5f51ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:25.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.082+0000 7f5f51ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:25.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.180+0000 7f5f6b2fa640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:25.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.180+0000 7f5f6b2fa640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:25.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.180+0000 7f5f6b2fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:25.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.180+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5f641573e0 con 0x7f5f6415d220 2026-02-17T11:58:25.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.183+0000 7f5f51ffb640 1 -- 10.20.193.10:0/215785837 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f5f60066ad0 con 0x7f5f6415d220 2026-02-17T11:58:25.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.183+0000 7f5f51ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:25.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.183+0000 7f5f51ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:25.186 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:25.186 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:25.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 10 librados: watch_flush enter 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 10 librados: watch_flush exit 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 20 client.4862.objecter shutdown clearing up homeless session... 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 10 client.4862.objecter successfully canceled tick 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f34078e00 msgr2=0x7f5f3407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f34078e00 0x7f5f3407b2c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f54002410 tx=0x7f5f54007ef0 comp rx=0 tx=0).stop 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 10 monclient: shutdown 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f6415d220 msgr2=0x7f5f640724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f6415d220 0x7f5f640724d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000cab0 tx=0x7f5f6000cf80 comp rx=0 tx=0).stop 2026-02-17T11:58:25.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 shutdown_connections 2026-02-17T11:58:25.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5f34078e00 0x7f5f3407b2c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:25.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5f6415d220 0x7f5f640724d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:25.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5f640c92f0 0x7f5f641f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:25.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 --2- 10.20.193.10:0/215785837 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5f64074920 0x7f5f6415c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:25.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 >> 10.20.193.10:0/215785837 conn(0x7f5f640c9d80 msgr2=0x7f5f64152470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:25.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 shutdown_connections 2026-02-17T11:58:25.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 -- 10.20.193.10:0/215785837 wait complete. 2026-02-17T11:58:25.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:25.185+0000 7f5f6b2fa640 1 librados: shutdown 2026-02-17T11:58:28.196 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:28.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.262+0000 7fd8a9b61640 10 monclient: get_monmap_and_config 2026-02-17T11:58:28.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.262+0000 7fd8a9b61640 10 monclient: build_initial_monmap 2026-02-17T11:58:28.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.262+0000 7fd8a9b61640 10 monclient: monmap: 2026-02-17T11:58:28.263 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:28.263 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:28.262580+0000 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:28.262580+0000 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:28.264 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:28.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.262+0000 7fd8a9b61640 1 Processor -- start 2026-02-17T11:58:28.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.262+0000 7fd8a9b61640 1 -- start start 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.262+0000 7fd8a9b61640 10 monclient: init 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 10 monclient: _add_conns ranks=[5,4,0,3,1,2] 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fd8a415d220 0x7fd8a415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 10 monclient(hunting): picked mon.noname-c con 0x7fd8a415d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fd8a4074920 0x7fd8a40c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 10 monclient(hunting): picked mon.noname-b con 0x7fd8a4074920 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd8a40c9120 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a40c95b0 con 0x7fd8a40c9120 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:28.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a40c58a0 con 0x7fd8a4074920 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a40c55c0 con 0x7fd8a415d220 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a9b61640 10 monclient(hunting): authenticate will time out at 1177.984388s 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a3fff640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fd8a40c9120 0x7fd8a4153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:35802/0 (socket says 10.20.193.10:35802) 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a3fff640 1 -- 10.20.193.10:0/1395917039 learned_addr learned my addr 10.20.193.10:0/1395917039 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a2ffd640 1 --2- 10.20.193.10:0/1395917039 >> v2:10.20.193.71:3300/0 conn(0x7fd8a4074920 0x7fd8a40c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.263+0000 7fd8a37fe640 1 --2- 10.20.193.10:0/1395917039 >> v2:10.20.193.153:3300/0 conn(0x7fd8a415d220 0x7fd8a415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a37fe640 10 monclient(hunting): get_auth_request con 0x7fd8a415d220 auth_method 0 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:28.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a2ffd640 10 monclient(hunting): get_auth_request con 0x7fd8a4074920 auth_method 0 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.264+0000 7fd8a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a27fc640 1 -- 10.20.193.10:0/1395917039 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994467781 0 0) 0x7fd8a40c95b0 con 0x7fd8a40c9120 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a27fc640 10 monclient(hunting): _negotiate 2026-02-17T11:58:28.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a27fc640 10 monclient(hunting): my global_id is 4791 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a27fc640 1 -- 10.20.193.10:0/1395917039 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd888003620 con 0x7fd8a40c9120 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a2ffd640 10 monclient(hunting): handle_auth_done global_id 4819 payload 274 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a2ffd640 1 -- 10.20.193.10:0/1395917039 >> v2:10.20.193.153:3300/0 conn(0x7fd8a415d220 msgr2=0x7fd8a415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a2ffd640 1 --2- 10.20.193.10:0/1395917039 >> v2:10.20.193.153:3300/0 conn(0x7fd8a415d220 0x7fd8a415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a2ffd640 1 -- 10.20.193.10:0/1395917039 >> v1:10.20.193.10:6789/0 conn(0x7fd8a40c9120 legacy=0x7fd8a4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a2ffd640 1 monclient: found mon.noname-b 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:28.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.265+0000 7fd8a2ffd640 1 -- 10.20.193.10:0/1395917039 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a40c7e20 con 0x7fd8a4074920 2026-02-17T11:58:28.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.266+0000 7fd8a2ffd640 1 --2- 10.20.193.10:0/1395917039 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd8a4074920 0x7fd8a40c8be0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd8940098a0 tx=0x7fd89402ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39378b7df6708a69 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:28.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 1 -- 10.20.193.10:0/1395917039 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89403c070 con 0x7fd8a4074920 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 10 monclient: dump: 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:28.278 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 1 -- 10.20.193.10:0/1395917039 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89402fae0 con 0x7fd8a4074920 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 1 -- 10.20.193.10:0/1395917039 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894037440 con 0x7fd8a4074920 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:28.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a27fc640 10 monclient: dump: 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 5 monclient: authenticate success, global_id 4819 2026-02-17T11:58:28.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 4 set_mon_vals no callback set 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 10 monclient: shutdown 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 1 -- 10.20.193.10:0/1395917039 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd8a4074920 msgr2=0x7fd8a40c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 1 --2- 10.20.193.10:0/1395917039 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd8a4074920 0x7fd8a40c8be0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd8940098a0 tx=0x7fd89402ee10 comp rx=0 tx=0).stop 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 1 -- 10.20.193.10:0/1395917039 shutdown_connections 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 1 --2- 10.20.193.10:0/1395917039 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd8a4074920 0x7fd8a40c8be0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 1 --2- 10.20.193.10:0/1395917039 >> v2:10.20.193.153:3300/0 conn(0x7fd8a415d220 0x7fd8a415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 1 -- 10.20.193.10:0/1395917039 >> 10.20.193.10:0/1395917039 conn(0x7fd8a40c9d80 msgr2=0x7fd8a40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 1 -- 10.20.193.10:0/1395917039 shutdown_connections 2026-02-17T11:58:28.281 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.268+0000 7fd8a9b61640 1 -- 10.20.193.10:0/1395917039 wait complete. 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient: build_initial_monmap 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient: monmap: 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:28.282 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 librados: starting msgr at 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 librados: starting objecter 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 Processor -- start 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 -- start start 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 librados: setting wanted keys 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 librados: calling monclient init 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient: init 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:28.283 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd8a4074920 0x7fd8a406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient(hunting): picked mon.noname-b con 0x7fd8a4074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd8a40c9120 0x7fd8a41f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient(hunting): picked mon.noname-c con 0x7fd8a40c9120 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd8a415d220 0x7fd8a41f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient(hunting): picked mon.noname-a con 0x7fd8a415d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a40c86c0 con 0x7fd8a415d220 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a40c83e0 con 0x7fd8a4074920 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a4074d70 con 0x7fd8a40c9120 2026-02-17T11:58:28.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.269+0000 7fd8a9b61640 10 monclient(hunting): authenticate will time out at 1177.990731s 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd8a415d220 0x7fd8a41f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a37fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd8a4074920 0x7fd8a406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a2ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd8a40c9120 0x7fd8a41f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd8a415d220 0x7fd8a41f5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:40272/0 (socket says 10.20.193.10:40272) 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 1 -- 10.20.193.10:0/3076608035 learned_addr learned my addr 10.20.193.10:0/3076608035 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 10 monclient(hunting): get_auth_request con 0x7fd8a415d220 auth_method 0 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:28.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a37fe640 10 monclient(hunting): get_auth_request con 0x7fd8a4074920 auth_method 0 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a2ffd640 10 monclient(hunting): get_auth_request con 0x7fd8a40c9120 auth_method 0 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:28.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.270+0000 7fd8a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 10 monclient(hunting): handle_auth_done global_id 4794 payload 824 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 1 -- 10.20.193.10:0/3076608035 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd8a40c9120 msgr2=0x7fd8a41f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd8a40c9120 0x7fd8a41f7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 1 -- 10.20.193.10:0/3076608035 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd8a4074920 msgr2=0x7fd8a406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd8a4074920 0x7fd8a406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 1 monclient: found mon.noname-a 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:28.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.271+0000 7fd8a3fff640 1 -- 10.20.193.10:0/3076608035 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a406e0f0 con 0x7fd8a415d220 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.272+0000 7fd8a3fff640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd8a415d220 0x7fd8a41f5570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd89800cb70 tx=0x7fd89800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.272+0000 7fd87ffff640 10 client.?.objecter ms_handle_connect 0x7fd8a415d220 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.272+0000 7fd87ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 1 -- 10.20.193.10:0/3076608035 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89800ad50 con 0x7fd8a415d220 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 10 monclient: dump: 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:28.288 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 10 monclient: _finish_auth 0 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a9b61640 5 monclient: authenticate success, global_id 4794 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 1 -- 10.20.193.10:0/3076608035 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd898012400 con 0x7fd8a415d220 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:28.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 1 -- 10.20.193.10:0/3076608035 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8980127b0 con 0x7fd8a415d220 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd87ffff640 10 monclient: dump: 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:28.290 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a1ffb640 4 set_mon_vals no callback set 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a9b61640 10 monclient: _renew_subs 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a9b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a406e3d0 con 0x7fd8a415d220 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a9b61640 10 client.4794.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a9b61640 10 monclient: _renew_subs 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a9b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a406e990 con 0x7fd8a415d220 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.274+0000 7fd8a9b61640 1 librados: init done 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.275+0000 7fd8a9b61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.275+0000 7fd8a9b61640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:28.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.275+0000 7fd8a9b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:28.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.275+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a414e3c0 con 0x7fd8a415d220 2026-02-17T11:58:28.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.287+0000 7fd87ffff640 1 -- 10.20.193.10:0/3076608035 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fd898012950 con 0x7fd8a415d220 2026-02-17T11:58:28.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.287+0000 7fd87ffff640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd874078e50 0x7fd87407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:28.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.287+0000 7fd8a37fe640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd874078e50 0x7fd87407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:28.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.287+0000 7fd8a37fe640 10 monclient: get_auth_request con 0x7fd874078e50 auth_method 0 2026-02-17T11:58:28.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.288+0000 7fd8a37fe640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd874078e50 0x7fd87407b310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40c4590 tx=0x7fd890009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:28.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.288+0000 7fd87ffff640 10 client.4794.objecter ms_handle_connect 0x7fd874078e50 2026-02-17T11:58:28.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.289+0000 7fd87ffff640 1 -- 10.20.193.10:0/3076608035 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fd89805e900 con 0x7fd8a415d220 2026-02-17T11:58:28.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.289+0000 7fd87ffff640 10 client.4794.objecter ms_dispatch2 0x7fd8a4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:28.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.289+0000 7fd87ffff640 3 client.4794.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:28.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.289+0000 7fd87ffff640 3 client.4794.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:28.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.289+0000 7fd87ffff640 20 client.4794.objecter dump_active .. 0 homeless 2026-02-17T11:58:28.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.391+0000 7fd87ffff640 1 -- 10.20.193.10:0/3076608035 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd8a414e3c0 con 0x7fd8a415d220 2026-02-17T11:58:28.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.391+0000 7fd87ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:28.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.391+0000 7fd87ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:28.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.490+0000 7fd8a9b61640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:28.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.490+0000 7fd8a9b61640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:28.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.490+0000 7fd8a9b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:28.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.490+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd8a40c8be0 con 0x7fd8a415d220 2026-02-17T11:58:28.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.492+0000 7fd87ffff640 1 -- 10.20.193.10:0/3076608035 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fd898012c70 con 0x7fd8a415d220 2026-02-17T11:58:28.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.492+0000 7fd87ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:28.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.492+0000 7fd87ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:28.494 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:28.494 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:28.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 10 librados: watch_flush enter 2026-02-17T11:58:28.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 10 librados: watch_flush exit 2026-02-17T11:58:28.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 20 client.4794.objecter shutdown clearing up homeless session... 2026-02-17T11:58:28.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 10 client.4794.objecter successfully canceled tick 2026-02-17T11:58:28.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd874078e50 msgr2=0x7fd87407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:28.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd874078e50 0x7fd87407b310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40c4590 tx=0x7fd890009290 comp rx=0 tx=0).stop 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 10 monclient: shutdown 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd8a415d220 msgr2=0x7fd8a41f5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd8a415d220 0x7fd8a41f5570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd89800cb70 tx=0x7fd89800a430 comp rx=0 tx=0).stop 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 shutdown_connections 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd874078e50 0x7fd87407b310 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd8a415d220 0x7fd8a41f5570 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd8a40c9120 0x7fd8a41f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 --2- 10.20.193.10:0/3076608035 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd8a4074920 0x7fd8a406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 >> 10.20.193.10:0/3076608035 conn(0x7fd8a40c9d80 msgr2=0x7fd8a414db60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 shutdown_connections 2026-02-17T11:58:28.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 -- 10.20.193.10:0/3076608035 wait complete. 2026-02-17T11:58:28.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:28.493+0000 7fd8a9b61640 1 librados: shutdown 2026-02-17T11:58:31.504 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:31.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.569+0000 7f1b63691640 10 monclient: get_monmap_and_config 2026-02-17T11:58:31.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.569+0000 7f1b63691640 10 monclient: build_initial_monmap 2026-02-17T11:58:31.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.569+0000 7f1b63691640 10 monclient: monmap: 2026-02-17T11:58:31.570 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:31.570 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:31.570 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:31.569376+0000 2026-02-17T11:58:31.570 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:31.569376+0000 2026-02-17T11:58:31.571 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:31.571 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:31.571 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:31.571 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:31.571 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:31.571 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:31.571 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:31.571 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:31.571 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:31.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.569+0000 7f1b63691640 1 Processor -- start 2026-02-17T11:58:31.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.569+0000 7f1b63691640 1 -- start start 2026-02-17T11:58:31.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.569+0000 7f1b63691640 10 monclient: init 2026-02-17T11:58:31.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:31.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 10 monclient: _add_conns ranks=[4,5,2,0,1,3] 2026-02-17T11:58:31.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1b5c15d220 0x7f1b5c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:31.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 10 monclient(hunting): picked mon.noname-b con 0x7f1b5c15d220 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1b5c074920 0x7f1b5c0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 10 monclient(hunting): picked mon.noname-c con 0x7f1b5c074920 addr v2:10.20.193.153:3300/0 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1b5c0c9120 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c0c95b0 con 0x7f1b5c0c9120 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1b5c0c58a0 con 0x7f1b5c15d220 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1b5c0c55c0 con 0x7f1b5c074920 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b63691640 10 monclient(hunting): authenticate will time out at 1181.291214s 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b61406640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1b5c15d220 0x7f1b5c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:31.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b60c05640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1b5c074920 0x7f1b5c0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.570+0000 7f1b61c07640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f1b5c0c9120 0x7f1b5c153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:59416/0 (socket says 10.20.193.10:59416) 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b61c07640 1 -- 10.20.193.10:0/956646996 learned_addr learned my addr 10.20.193.10:0/956646996 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b61406640 10 monclient(hunting): get_auth_request con 0x7f1b5c15d220 auth_method 0 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b61406640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b61406640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b61406640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b60c05640 10 monclient(hunting): get_auth_request con 0x7f1b5c074920 auth_method 0 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b60c05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b60c05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b60c05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b61406640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:31.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b61406640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.571+0000 7f1b61406640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b60c05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b60c05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b60c05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b61406640 10 monclient(hunting): handle_auth_done global_id 4825 payload 274 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b61406640 1 -- 10.20.193.10:0/956646996 >> v2:10.20.193.153:3300/0 conn(0x7f1b5c074920 msgr2=0x7f1b5c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b61406640 1 --2- 10.20.193.10:0/956646996 >> v2:10.20.193.153:3300/0 conn(0x7f1b5c074920 0x7f1b5c0c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b61406640 1 -- 10.20.193.10:0/956646996 >> v1:10.20.193.153:6789/0 conn(0x7f1b5c0c9120 legacy=0x7f1b5c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b61406640 10 monclient: _finish_hunting 0 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b61406640 1 monclient: found mon.noname-b 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b61406640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b61406640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:31.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.572+0000 7f1b61406640 1 -- 10.20.193.10:0/956646996 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c0c7e20 con 0x7f1b5c15d220 2026-02-17T11:58:31.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.573+0000 7f1b61406640 1 --2- 10.20.193.10:0/956646996 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c15d220 0x7f1b5c15d600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0098a0 tx=0x7f1b4c02ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2125c301e7e9dd8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:31.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 1 -- 10.20.193.10:0/956646996 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c03c070 con 0x7f1b5c15d220 2026-02-17T11:58:31.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:31.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:31.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 10 monclient: dump: 2026-02-17T11:58:31.584 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:31.584 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:31.584 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:31.584 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 10 monclient: _finish_auth 0 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b63691640 5 monclient: authenticate success, global_id 4825 2026-02-17T11:58:31.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b63691640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 1 -- 10.20.193.10:0/956646996 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c02fae0 con 0x7f1b5c15d220 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 1 -- 10.20.193.10:0/956646996 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c037440 con 0x7f1b5c15d220 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b4bfff640 10 monclient: dump: 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:31.586 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:31.587 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:31.587 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:31.587 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:31.587 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:31.587 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:31.587 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:31.587 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b63691640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:31.587 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.575+0000 7f1b63691640 4 set_mon_vals no callback set 2026-02-17T11:58:31.587 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 10 monclient: shutdown 2026-02-17T11:58:31.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:31.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 -- 10.20.193.10:0/956646996 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c15d220 msgr2=0x7f1b5c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:31.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 --2- 10.20.193.10:0/956646996 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c15d220 0x7f1b5c15d600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0098a0 tx=0x7f1b4c02ee10 comp rx=0 tx=0).stop 2026-02-17T11:58:31.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 -- 10.20.193.10:0/956646996 shutdown_connections 2026-02-17T11:58:31.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 --2- 10.20.193.10:0/956646996 >> v2:10.20.193.153:3300/0 conn(0x7f1b5c074920 0x7f1b5c0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 --2- 10.20.193.10:0/956646996 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c15d220 0x7f1b5c15d600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 -- 10.20.193.10:0/956646996 >> 10.20.193.10:0/956646996 conn(0x7f1b5c0c9d80 msgr2=0x7f1b5c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:31.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 -- 10.20.193.10:0/956646996 shutdown_connections 2026-02-17T11:58:31.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 -- 10.20.193.10:0/956646996 wait complete. 2026-02-17T11:58:31.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 10 monclient: build_initial_monmap 2026-02-17T11:58:31.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 10 monclient: monmap: 2026-02-17T11:58:31.589 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:31.589 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:31.589 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:31.589 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 librados: starting msgr at 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 librados: starting objecter 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 Processor -- start 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 -- start start 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 librados: setting wanted keys 2026-02-17T11:58:31.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 1 librados: calling monclient init 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.576+0000 7f1b63691640 10 monclient: init 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c074920 0x7f1b5c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient(hunting): picked mon.noname-b con 0x7f1b5c074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b5c0c9120 0x7f1b5c1456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient(hunting): picked mon.noname-a con 0x7f1b5c0c9120 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b5c15d220 0x7f1b5c1f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient(hunting): picked mon.noname-c con 0x7f1b5c15d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c0c86c0 con 0x7f1b5c0c9120 2026-02-17T11:58:31.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c0c83e0 con 0x7f1b5c074920 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c074d70 con 0x7f1b5c15d220 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b63691640 10 monclient(hunting): authenticate will time out at 1181.298249s 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c074920 0x7f1b5c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61c07640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b5c15d220 0x7f1b5c1f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b60c05640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b5c0c9120 0x7f1b5c1456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c074920 0x7f1b5c0cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:60486/0 (socket says 10.20.193.10:60486) 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 1 -- 10.20.193.10:0/2803348424 learned_addr learned my addr 10.20.193.10:0/2803348424 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 10 monclient(hunting): get_auth_request con 0x7f1b5c074920 auth_method 0 2026-02-17T11:58:31.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b60c05640 10 monclient(hunting): get_auth_request con 0x7f1b5c0c9120 auth_method 0 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b60c05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b60c05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b60c05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61c07640 10 monclient(hunting): get_auth_request con 0x7f1b5c15d220 auth_method 0 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61c07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61c07640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61c07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:31.593 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.577+0000 7f1b61406640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.578+0000 7f1b61c07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.578+0000 7f1b61c07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.578+0000 7f1b61c07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.578+0000 7f1b60c05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.578+0000 7f1b60c05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.578+0000 7f1b60c05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 10 monclient(hunting): handle_auth_done global_id 4828 payload 824 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 1 -- 10.20.193.10:0/2803348424 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b5c15d220 msgr2=0x7f1b5c1f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b5c15d220 0x7f1b5c1f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 1 -- 10.20.193.10:0/2803348424 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b5c0c9120 msgr2=0x7f1b5c1456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:31.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b5c0c9120 0x7f1b5c1456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 10 monclient: _finish_hunting 0 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 1 monclient: found mon.noname-b 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.579+0000 7f1b61406640 1 -- 10.20.193.10:0/2803348424 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c073d40 con 0x7f1b5c074920 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.580+0000 7f1b61406640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c074920 0x7f1b5c0cbac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c02f340 tx=0x7f1b4c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.580+0000 7f1b49ffb640 10 client.?.objecter ms_handle_connect 0x7f1b5c074920 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.580+0000 7f1b49ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b49ffb640 1 -- 10.20.193.10:0/2803348424 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c03c040 con 0x7f1b5c074920 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b49ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b49ffb640 10 monclient: dump: 2026-02-17T11:58:31.595 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b49ffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b49ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:31.596 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b63691640 5 monclient: authenticate success, global_id 4828 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b63691640 10 monclient: _renew_subs 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b63691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5c0731c0 con 0x7f1b5c074920 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b63691640 10 client.4828.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b63691640 10 monclient: _renew_subs 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b63691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b5c073780 con 0x7f1b5c074920 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.581+0000 7f1b63691640 1 librados: init done 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b49ffb640 1 -- 10.20.193.10:0/2803348424 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c02f9a0 con 0x7f1b5c074920 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b49ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b49ffb640 1 -- 10.20.193.10:0/2803348424 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c042650 con 0x7f1b5c074920 2026-02-17T11:58:31.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b49ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b4b7fe640 4 set_mon_vals no callback set 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b49ffb640 10 monclient: dump: 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:31.598 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:31.599 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:31.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b63691640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:31.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b63691640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:31.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b63691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:31.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.582+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c0c8be0 con 0x7f1b5c074920 2026-02-17T11:58:31.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.593+0000 7f1b49ffb640 1 -- 10.20.193.10:0/2803348424 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f1b4c0427f0 con 0x7f1b5c074920 2026-02-17T11:58:31.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.594+0000 7f1b49ffb640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b2c078e00 0x7f1b2c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:31.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.594+0000 7f1b60c05640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b2c078e00 0x7f1b2c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:31.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.594+0000 7f1b60c05640 10 monclient: get_auth_request con 0x7f1b2c078e00 auth_method 0 2026-02-17T11:58:31.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.594+0000 7f1b49ffb640 10 client.4828.objecter ms_handle_connect 0x7f1b2c078e00 2026-02-17T11:58:31.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.594+0000 7f1b60c05640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b2c078e00 0x7f1b2c07b2c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c1f4b60 tx=0x7f1b50009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:31.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.596+0000 7f1b49ffb640 1 -- 10.20.193.10:0/2803348424 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f1b4c0bcc00 con 0x7f1b5c074920 2026-02-17T11:58:31.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.596+0000 7f1b49ffb640 10 client.4828.objecter ms_dispatch2 0x7f1b5c000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:31.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.596+0000 7f1b49ffb640 3 client.4828.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:31.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.596+0000 7f1b49ffb640 3 client.4828.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:31.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.596+0000 7f1b49ffb640 20 client.4828.objecter dump_active .. 0 homeless 2026-02-17T11:58:31.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.698+0000 7f1b49ffb640 1 -- 10.20.193.10:0/2803348424 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1b4c087460 con 0x7f1b5c074920 2026-02-17T11:58:31.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.698+0000 7f1b49ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:31.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.698+0000 7f1b49ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:31.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.801+0000 7f1b63691640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:31.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.801+0000 7f1b63691640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:31.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.801+0000 7f1b63691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:31.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.801+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1b5c1f4ea0 con 0x7f1b5c074920 2026-02-17T11:58:31.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b49ffb640 1 -- 10.20.193.10:0/2803348424 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f1b4c08b760 con 0x7f1b5c074920 2026-02-17T11:58:31.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b49ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:31.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b49ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:31.806 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:31.806 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:31.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 10 librados: watch_flush enter 2026-02-17T11:58:31.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 10 librados: watch_flush exit 2026-02-17T11:58:31.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 20 client.4828.objecter shutdown clearing up homeless session... 2026-02-17T11:58:31.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 10 client.4828.objecter successfully canceled tick 2026-02-17T11:58:31.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b2c078e00 msgr2=0x7f1b2c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b2c078e00 0x7f1b2c07b2c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c1f4b60 tx=0x7f1b50009290 comp rx=0 tx=0).stop 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 10 monclient: shutdown 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c074920 msgr2=0x7f1b5c0cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.805+0000 7f1b63691640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c074920 0x7f1b5c0cbac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c02f340 tx=0x7f1b4c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.806+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 shutdown_connections 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.806+0000 7f1b63691640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1b2c078e00 0x7f1b2c07b2c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.806+0000 7f1b63691640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1b5c15d220 0x7f1b5c1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.806+0000 7f1b63691640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1b5c0c9120 0x7f1b5c1456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.806+0000 7f1b63691640 1 --2- 10.20.193.10:0/2803348424 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1b5c074920 0x7f1b5c0cbac0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.806+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 >> 10.20.193.10:0/2803348424 conn(0x7f1b5c0c9d80 msgr2=0x7f1b5c1491a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:31.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.806+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 shutdown_connections 2026-02-17T11:58:31.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.806+0000 7f1b63691640 1 -- 10.20.193.10:0/2803348424 wait complete. 2026-02-17T11:58:31.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:31.806+0000 7f1b63691640 1 librados: shutdown 2026-02-17T11:58:34.817 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:34.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.886+0000 7fe4fc01a640 10 monclient: get_monmap_and_config 2026-02-17T11:58:34.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.886+0000 7fe4fc01a640 10 monclient: build_initial_monmap 2026-02-17T11:58:34.889 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.886+0000 7fe4fc01a640 10 monclient: monmap: 2026-02-17T11:58:34.889 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:34.889 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:34.889 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:34.887783+0000 2026-02-17T11:58:34.889 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:34.887783+0000 2026-02-17T11:58:34.889 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:34.889 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:34.889 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:34.890 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:34.890 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:34.890 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:34.890 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:34.890 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:34.890 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:34.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.886+0000 7fe4fc01a640 1 Processor -- start 2026-02-17T11:58:34.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.886+0000 7fe4fc01a640 1 -- start start 2026-02-17T11:58:34.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.886+0000 7fe4fc01a640 10 monclient: init 2026-02-17T11:58:34.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:34.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 10 monclient: _add_conns ranks=[2,1,0,3,5,4] 2026-02-17T11:58:34.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe4f415d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe4f40c92f0 addr v1:10.20.193.71:6789/0 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe4f4153d60 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f40c58a0 con 0x7fe4f4153d60 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f40c55c0 con 0x7fe4f40c92f0 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f40c7e20 con 0x7fe4f415d220 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.887+0000 7fe4fc01a640 10 monclient(hunting): authenticate will time out at 1184.609504s 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.888+0000 7fe4fa590640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fe4f4153d60 0x7fe4f40c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:34852/0 (socket says 10.20.193.10:34852) 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.888+0000 7fe4fa590640 1 -- 10.20.193.10:0/2278043059 learned_addr learned my addr 10.20.193.10:0/2278043059 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871556435 0 0) 0x7fe4f40c58a0 con 0x7fe4f4153d60 2026-02-17T11:58:34.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): _negotiate 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): my global_id is 4800 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4dc003620 con 0x7fe4f4153d60 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618494992 0 0) 0x7fe4f40c7e20 con 0x7fe4f415d220 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): _negotiate 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): my global_id is 4880 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4f40c58a0 con 0x7fe4f415d220 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047387319 0 0) 0x7fe4f40c55c0 con 0x7fe4f40c92f0 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): _negotiate 2026-02-17T11:58:34.894 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:34.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:34.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 10 monclient(hunting): my global_id is 4831 2026-02-17T11:58:34.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.889+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4f40c7e20 con 0x7fe4f40c92f0 2026-02-17T11:58:34.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2646859173 0 0) 0x7fe4dc003620 con 0x7fe4f4153d60 2026-02-17T11:58:34.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 >> v1:10.20.193.153:6789/0 conn(0x7fe4f415d220 legacy=0x7fe4f40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:34.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 >> v1:10.20.193.71:6789/0 conn(0x7fe4f40c92f0 legacy=0x7fe4f4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient: _finish_hunting 0 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f40c8100 con 0x7fe4f4153d60 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient: _finish_auth 0 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient: _check_auth_tickets 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fe4f0003280 con 0x7fe4f4153d60 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4fc01a640 5 monclient: authenticate success, global_id 4800 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4fc01a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:34.905 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient: dump: 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:34.906 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 >> v1:10.20.193.10:6789/0 conn(0x7fe4f4153d60 legacy=0x7fe4f40c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4dc003fe0 0x7fe4dc004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient(hunting): picked mon.b con 0x7fe4dc003fe0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4dc0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient(hunting): picked mon.a con 0x7fe4dc004e40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4dc009ab0 0x7fe4dc00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient(hunting): picked mon.c con 0x7fe4dc009ab0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:34.907 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc00c570 con 0x7fe4dc004e40 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc00c6f0 con 0x7fe4dc003fe0 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc00c8f0 con 0x7fe4dc009ab0 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4f8d8d640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.891+0000 7fe4fc01a640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4fa590640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4dc009ab0 0x7fe4dc00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4fa590640 10 monclient(hunting): get_auth_request con 0x7fe4dc009ab0 auth_method 0 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4fa590640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:34.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4fa590640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4fa590640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f958e640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4dc0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f9d8f640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4dc003fe0 0x7fe4dc004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f958e640 10 monclient(hunting): get_auth_request con 0x7fe4dc004e40 auth_method 0 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f958e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f958e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f958e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f9d8f640 10 monclient(hunting): get_auth_request con 0x7fe4dc003fe0 auth_method 0 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f9d8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f9d8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.892+0000 7fe4f9d8f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4fa590640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:34.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4fa590640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4fa590640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f9d8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f9d8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f9d8f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 10 monclient(hunting): handle_auth_done global_id 4800 payload 293 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 1 -- 10.20.193.10:0/2278043059 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4dc009ab0 msgr2=0x7fe4dc00bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4dc009ab0 0x7fe4dc00bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 1 -- 10.20.193.10:0/2278043059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4dc003fe0 msgr2=0x7fe4dc004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:34.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4dc003fe0 0x7fe4dc004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 10 monclient: _finish_hunting 0 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 1 monclient: found mon.a 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4fa590640 1 -- 10.20.193.10:0/2278043059 reap_dead start 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 1 -- 10.20.193.10:0/2278043059 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc003620 con 0x7fe4dc004e40 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 10 monclient: _finish_auth 0 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 10 monclient: _check_auth_tickets 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.893+0000 7fe4f958e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.894+0000 7fe4f958e640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4dc0052c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80031a0 tx=0x7fe4e802ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8653f66ecb621cc5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8002dc0 con 0x7fe4dc004e40 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:34.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 10 monclient: dump: 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:34.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e80052d0 con 0x7fe4dc004e40 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4fc01a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 1 -- 10.20.193.10:0/2278043059 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e802f720 con 0x7fe4dc004e40 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4f8d8d640 10 monclient: dump: 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:34.913 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4fc01a640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.896+0000 7fe4fc01a640 4 set_mon_vals no callback set 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 10 monclient: shutdown 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2278043059 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 msgr2=0x7fe4dc0052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4dc0052c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80031a0 tx=0x7fe4e802ef00 comp rx=0 tx=0).stop 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2278043059 shutdown_connections 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 --2- 10.20.193.10:0/2278043059 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4dc0052c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:34.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2278043059 >> 10.20.193.10:0/2278043059 conn(0x7fe4f40c9d80 msgr2=0x7fe4f40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2278043059 shutdown_connections 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2278043059 wait complete. 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 10 monclient: build_initial_monmap 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 10 monclient: monmap: 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:34.915 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 librados: starting msgr at 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 librados: starting objecter 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 Processor -- start 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 -- start start 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 librados: setting wanted keys 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 1 librados: calling monclient init 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.897+0000 7fe4fc01a640 10 monclient: init 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4f415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:34.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient(hunting): picked mon.noname-a con 0x7fe4dc004e40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4f41f24d0 0x7fe4f40cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient(hunting): picked mon.noname-b con 0x7fe4f41f24d0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4f40cca10 0x7fe4f41e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient(hunting): picked mon.noname-c con 0x7fe4f40cca10 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f415d600 con 0x7fe4dc004e40 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f40c86c0 con 0x7fe4f41f24d0 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f415d780 con 0x7fe4f40cca10 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:34.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fc01a640 10 monclient(hunting): authenticate will time out at 1184.620283s 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f9d8f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4f415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fa590640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4f40cca10 0x7fe4f41e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f958e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4f41f24d0 0x7fe4f40cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f9d8f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4f415b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:46874/0 (socket says 10.20.193.10:46874) 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f9d8f640 1 -- 10.20.193.10:0/2750103716 learned_addr learned my addr 10.20.193.10:0/2750103716 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f9d8f640 10 monclient(hunting): get_auth_request con 0x7fe4dc004e40 auth_method 0 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f9d8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f9d8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f9d8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f958e640 10 monclient(hunting): get_auth_request con 0x7fe4f41f24d0 auth_method 0 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f958e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f958e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:34.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4f958e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fa590640 10 monclient(hunting): get_auth_request con 0x7fe4f40cca10 auth_method 0 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fa590640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fa590640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.898+0000 7fe4fa590640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.899+0000 7fe4f9d8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.899+0000 7fe4f9d8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.899+0000 7fe4f9d8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.899+0000 7fe4f958e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.899+0000 7fe4f958e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.899+0000 7fe4f958e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.899+0000 7fe4fa590640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.899+0000 7fe4fa590640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:34.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.899+0000 7fe4fa590640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 10 monclient(hunting): handle_auth_done global_id 4803 payload 824 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 1 -- 10.20.193.10:0/2750103716 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4f40cca10 msgr2=0x7fe4f41e4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4f40cca10 0x7fe4f41e4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 1 -- 10.20.193.10:0/2750103716 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4f41f24d0 msgr2=0x7fe4f40cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4f41f24d0 0x7fe4f40cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 10 monclient: _finish_hunting 0 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 1 monclient: found mon.noname-a 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.900+0000 7fe4f9d8f640 1 -- 10.20.193.10:0/2750103716 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f415c070 con 0x7fe4dc004e40 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.901+0000 7fe4f9d8f640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4f415b980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400ead0 tx=0x7fe4e40056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:34.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.901+0000 7fe4e27fc640 10 client.?.objecter ms_handle_connect 0x7fe4dc004e40 2026-02-17T11:58:34.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.901+0000 7fe4e27fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:34.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 1 -- 10.20.193.10:0/2750103716 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4019070 con 0x7fe4dc004e40 2026-02-17T11:58:34.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 10 monclient: dump: 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 10 monclient: _finish_auth 0 2026-02-17T11:58:34.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 1 -- 10.20.193.10:0/2750103716 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e400ca60 con 0x7fe4dc004e40 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 1 -- 10.20.193.10:0/2750103716 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400ce50 con 0x7fe4dc004e40 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 5 monclient: authenticate success, global_id 4803 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e3fff640 4 set_mon_vals no callback set 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 10 monclient: _renew_subs 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f415c350 con 0x7fe4dc004e40 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4e27fc640 10 monclient: dump: 2026-02-17T11:58:34.925 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 10 client.4803.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 10 monclient: _renew_subs 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:34.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f415c910 con 0x7fe4dc004e40 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 1 librados: init done 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.903+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f4074920 con 0x7fe4dc004e40 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.914+0000 7fe4e27fc640 1 -- 10.20.193.10:0/2750103716 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fe4e4003ce0 con 0x7fe4dc004e40 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.914+0000 7fe4e27fc640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe4c4078ff0 0x7fe4c407b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.915+0000 7fe4f958e640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe4c4078ff0 0x7fe4c407b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.915+0000 7fe4f958e640 10 monclient: get_auth_request con 0x7fe4c4078ff0 auth_method 0 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.915+0000 7fe4e27fc640 10 client.4803.objecter ms_handle_connect 0x7fe4c4078ff0 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.915+0000 7fe4f958e640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe4c4078ff0 0x7fe4c407b4b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8037000 tx=0x7fe4e8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.916+0000 7fe4e27fc640 1 -- 10.20.193.10:0/2750103716 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe4e405d7d0 con 0x7fe4dc004e40 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.916+0000 7fe4e27fc640 10 client.4803.objecter ms_dispatch2 0x7fe4f4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.916+0000 7fe4e27fc640 3 client.4803.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:34.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.916+0000 7fe4e27fc640 3 client.4803.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:34.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:34.916+0000 7fe4e27fc640 20 client.4803.objecter dump_active .. 0 homeless 2026-02-17T11:58:35.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.015+0000 7fe4e27fc640 1 -- 10.20.193.10:0/2750103716 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe4e4023020 con 0x7fe4dc004e40 2026-02-17T11:58:35.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.015+0000 7fe4e27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:35.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.015+0000 7fe4e27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:35.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.115+0000 7fe4fc01a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:35.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.115+0000 7fe4fc01a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:35.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.115+0000 7fe4fc01a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:35.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.115+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe4f41573e0 con 0x7fe4dc004e40 2026-02-17T11:58:35.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.117+0000 7fe4e27fc640 1 -- 10.20.193.10:0/2750103716 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fe4e4061790 con 0x7fe4dc004e40 2026-02-17T11:58:35.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.117+0000 7fe4e27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:35.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.117+0000 7fe4e27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:35.120 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:35.120 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:35.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 10 librados: watch_flush enter 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 10 librados: watch_flush exit 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 20 client.4803.objecter shutdown clearing up homeless session... 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 10 client.4803.objecter successfully canceled tick 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe4c4078ff0 msgr2=0x7fe4c407b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe4c4078ff0 0x7fe4c407b4b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8037000 tx=0x7fe4e8009030 comp rx=0 tx=0).stop 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 10 monclient: shutdown 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 msgr2=0x7fe4f415b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4f415b980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400ead0 tx=0x7fe4e40056d0 comp rx=0 tx=0).stop 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 shutdown_connections 2026-02-17T11:58:35.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe4c4078ff0 0x7fe4c407b4b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:35.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe4f40cca10 0x7fe4f41e4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:35.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe4f41f24d0 0x7fe4f40cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:35.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 --2- 10.20.193.10:0/2750103716 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe4dc004e40 0x7fe4f415b980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:35.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 >> 10.20.193.10:0/2750103716 conn(0x7fe4f40c9d80 msgr2=0x7fe4f4153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:35.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 shutdown_connections 2026-02-17T11:58:35.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.118+0000 7fe4fc01a640 1 -- 10.20.193.10:0/2750103716 wait complete. 2026-02-17T11:58:35.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:35.119+0000 7fe4fc01a640 1 librados: shutdown 2026-02-17T11:58:35.249 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:04:52.417 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:35.250 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:04:52.413 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:35.251 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:04:52.419 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:35.253 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:04:52.416 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:35.259 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:04:52.427 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:35.261 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:04:52.424 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:35.276 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:04:52.404 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:35.277 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:04:52.405 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:35.285 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:04:52.414 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:38.129 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:38.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.197+0000 7facc6e98640 10 monclient: get_monmap_and_config 2026-02-17T11:58:38.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.197+0000 7facc6e98640 10 monclient: build_initial_monmap 2026-02-17T11:58:38.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.197+0000 7facc6e98640 10 monclient: monmap: 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:38.198809+0000 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:38.198809+0000 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:38.200 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:38.201 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:38.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 1 Processor -- start 2026-02-17T11:58:38.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 1 -- start start 2026-02-17T11:58:38.203 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient: init 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient: _add_conns ranks=[1,4,3,0,2,5] 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7facc015d220 addr v1:10.20.193.71:6789/0 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7facc00c92f0 0x7facc015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient(hunting): picked mon.noname-b con 0x7facc00c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7facc0074920 0x7facc0153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient(hunting): picked mon.noname-a con 0x7facc0074920 addr v2:10.20.193.10:3300/0 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc00c58a0 con 0x7facc015d220 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7facc00c55c0 con 0x7facc0074920 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:38.204 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7facc00c7e20 con 0x7facc00c92f0 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc6e98640 10 monclient(hunting): authenticate will time out at 1187.920676s 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.198+0000 7facc540e640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7facc0074920 0x7facc0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facc540e640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7facc0074920 0x7facc0153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:46890/0 (socket says 10.20.193.10:46890) 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facc540e640 1 -- 10.20.193.10:0/3925421147 learned_addr learned my addr 10.20.193.10:0/3925421147 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facc540e640 10 monclient(hunting): get_auth_request con 0x7facc0074920 auth_method 0 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facc540e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facc540e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facc540e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facc540e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facc540e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:38.205 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facc540e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.199+0000 7facb7fff640 1 --2- 10.20.193.10:0/3925421147 >> v2:10.20.193.71:3300/0 conn(0x7facc00c92f0 0x7facc015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.200+0000 7facc540e640 10 monclient(hunting): handle_auth_done global_id 4806 payload 274 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.200+0000 7facc540e640 1 -- 10.20.193.10:0/3925421147 >> v2:10.20.193.71:3300/0 conn(0x7facc00c92f0 msgr2=0x7facc015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.200+0000 7facc540e640 1 --2- 10.20.193.10:0/3925421147 >> v2:10.20.193.71:3300/0 conn(0x7facc00c92f0 0x7facc015d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.200+0000 7facc540e640 1 -- 10.20.193.10:0/3925421147 >> v1:10.20.193.71:6789/0 conn(0x7facc015d220 legacy=0x7facc00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.200+0000 7facc540e640 10 monclient: _finish_hunting 0 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.200+0000 7facc540e640 1 monclient: found mon.noname-a 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.200+0000 7facc540e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.200+0000 7facc540e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.200+0000 7facc540e640 1 -- 10.20.193.10:0/3925421147 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc00c8100 con 0x7facc0074920 2026-02-17T11:58:38.206 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.201+0000 7facc540e640 1 --2- 10.20.193.10:0/3925421147 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc0074920 0x7facc0153650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facbc009e50 tx=0x7facbc02f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84db51bca23b69cf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:38.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 1 -- 10.20.193.10:0/3925421147 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc02fd60 con 0x7facc0074920 2026-02-17T11:58:38.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:38.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:38.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 10 monclient: dump: 2026-02-17T11:58:38.213 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:38.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facc6e98640 5 monclient: authenticate success, global_id 4806 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 1 -- 10.20.193.10:0/3925421147 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facbc0373f0 con 0x7facc0074920 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facc6e98640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 1 -- 10.20.193.10:0/3925421147 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc0377c0 con 0x7facc0074920 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facc6e98640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facc6e98640 4 set_mon_vals no callback set 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facb77fe640 10 monclient: dump: 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:38.215 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facc6e98640 10 monclient: shutdown 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facc6e98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facc6e98640 1 -- 10.20.193.10:0/3925421147 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc0074920 msgr2=0x7facc0153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.203+0000 7facc6e98640 1 --2- 10.20.193.10:0/3925421147 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc0074920 0x7facc0153650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facbc009e50 tx=0x7facbc02f2a0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 -- 10.20.193.10:0/3925421147 shutdown_connections 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 --2- 10.20.193.10:0/3925421147 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc0074920 0x7facc0153650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 --2- 10.20.193.10:0/3925421147 >> v2:10.20.193.71:3300/0 conn(0x7facc00c92f0 0x7facc015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 -- 10.20.193.10:0/3925421147 >> 10.20.193.10:0/3925421147 conn(0x7facc00c9d80 msgr2=0x7facc00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 -- 10.20.193.10:0/3925421147 shutdown_connections 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 -- 10.20.193.10:0/3925421147 wait complete. 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 10 monclient: build_initial_monmap 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 10 monclient: monmap: 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:38.217 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 librados: starting msgr at 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 librados: starting objecter 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 Processor -- start 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 -- start start 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 librados: setting wanted keys 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 1 librados: calling monclient init 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.204+0000 7facc6e98640 10 monclient: init 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:38.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7facc0074920 0x7facc013c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient(hunting): picked mon.noname-c con 0x7facc0074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc00c92f0 0x7facc0142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient(hunting): picked mon.noname-a con 0x7facc00c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7facc015d220 0x7facc015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient(hunting): picked mon.noname-b con 0x7facc015d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7facc0074d70 con 0x7facc00c92f0 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7facc00c86c0 con 0x7facc015d220 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:38.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7facc0153b90 con 0x7facc0074920 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc6e98640 10 monclient(hunting): authenticate will time out at 1187.927347s 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facb7fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc00c92f0 0x7facc0142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc540e640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7facc015d220 0x7facc015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facb7fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc00c92f0 0x7facc0142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:46904/0 (socket says 10.20.193.10:46904) 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facb7fff640 1 -- 10.20.193.10:0/3093335806 learned_addr learned my addr 10.20.193.10:0/3093335806 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facb7fff640 10 monclient(hunting): get_auth_request con 0x7facc00c92f0 auth_method 0 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facb7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc4c0d640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7facc0074920 0x7facc013c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:38.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc540e640 10 monclient(hunting): get_auth_request con 0x7facc015d220 auth_method 0 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc540e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc540e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.205+0000 7facc540e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facb7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facb7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facb7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc4c0d640 10 monclient(hunting): get_auth_request con 0x7facc0074920 auth_method 0 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc4c0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc4c0d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc4c0d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc540e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc540e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:38.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc540e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc4c0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc4c0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.206+0000 7facc4c0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 10 monclient(hunting): handle_auth_done global_id 4809 payload 824 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 1 -- 10.20.193.10:0/3093335806 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7facc0074920 msgr2=0x7facc013c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7facc0074920 0x7facc013c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 1 -- 10.20.193.10:0/3093335806 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7facc015d220 msgr2=0x7facc015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7facc015d220 0x7facc015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 1 monclient: found mon.noname-a 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:38.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.207+0000 7facb7fff640 1 -- 10.20.193.10:0/3093335806 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc0140d00 con 0x7facc00c92f0 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.208+0000 7facb7fff640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc00c92f0 0x7facc0142080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faca800c7c0 tx=0x7faca800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.208+0000 7facb57fa640 10 client.?.objecter ms_handle_connect 0x7facc00c92f0 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.208+0000 7facb57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facb57fa640 1 -- 10.20.193.10:0/3093335806 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8004220 con 0x7facc00c92f0 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facb57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facb57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facb57fa640 10 monclient: dump: 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:38.223 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facb57fa640 10 monclient: _finish_auth 0 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facb57fa640 10 monclient: _check_auth_tickets 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facb57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facc6e98640 5 monclient: authenticate success, global_id 4809 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facc6e98640 10 monclient: _renew_subs 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facc6e98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc0140fe0 con 0x7facc00c92f0 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facc6e98640 10 client.4809.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:38.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facc6e98640 10 monclient: _renew_subs 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facc6e98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc01415a0 con 0x7facc00c92f0 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.209+0000 7facc6e98640 1 librados: init done 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facc6e98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facc6e98640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facc6e98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc015e100 con 0x7facc00c92f0 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facb57fa640 1 -- 10.20.193.10:0/3093335806 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca80043c0 con 0x7facc00c92f0 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facb57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facb57fa640 1 -- 10.20.193.10:0/3093335806 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8007ab0 con 0x7facc00c92f0 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facb57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facb57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:38.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facb57fa640 10 monclient: dump: 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:38.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.210+0000 7facb6ffd640 4 set_mon_vals no callback set 2026-02-17T11:58:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.316+0000 7facb57fa640 1 -- 10.20.193.10:0/3093335806 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7faca8007c50 con 0x7facc00c92f0 2026-02-17T11:58:38.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.316+0000 7facb57fa640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac90078e00 0x7fac9007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.316+0000 7facc4c0d640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac90078e00 0x7fac9007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.316+0000 7facc4c0d640 10 monclient: get_auth_request con 0x7fac90078e00 auth_method 0 2026-02-17T11:58:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.317+0000 7facc4c0d640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac90078e00 0x7fac9007b2c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7facb0005110 tx=0x7facb0007f30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:38.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.317+0000 7facb57fa640 10 client.4809.objecter ms_handle_connect 0x7fac90078e00 2026-02-17T11:58:38.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.325+0000 7facb57fa640 1 -- 10.20.193.10:0/3093335806 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7faca805e580 con 0x7facc00c92f0 2026-02-17T11:58:38.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.325+0000 7facb57fa640 10 client.4809.objecter ms_dispatch2 0x7facc0000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:38.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.325+0000 7facb57fa640 3 client.4809.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:38.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.325+0000 7facb57fa640 3 client.4809.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:38.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.325+0000 7facb57fa640 20 client.4809.objecter dump_active .. 0 homeless 2026-02-17T11:58:38.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.325+0000 7facb57fa640 1 -- 10.20.193.10:0/3093335806 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7facc015e100 con 0x7facc00c92f0 2026-02-17T11:58:38.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.325+0000 7facb57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:38.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.325+0000 7facb57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:38.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.425+0000 7facc6e98640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:38.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.425+0000 7facc6e98640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:38.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.425+0000 7facc6e98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:38.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.425+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7facc01573e0 con 0x7facc00c92f0 2026-02-17T11:58:38.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.428+0000 7facb57fa640 1 -- 10.20.193.10:0/3093335806 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7faca801e020 con 0x7facc00c92f0 2026-02-17T11:58:38.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.428+0000 7facb57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:38.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.428+0000 7facb57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:38.430 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:38.430 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:38.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 10 librados: watch_flush enter 2026-02-17T11:58:38.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 10 librados: watch_flush exit 2026-02-17T11:58:38.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 20 client.4809.objecter shutdown clearing up homeless session... 2026-02-17T11:58:38.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 10 client.4809.objecter successfully canceled tick 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac90078e00 msgr2=0x7fac9007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac90078e00 0x7fac9007b2c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7facb0005110 tx=0x7facb0007f30 comp rx=0 tx=0).stop 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 10 monclient: shutdown 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc00c92f0 msgr2=0x7facc0142080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc00c92f0 0x7facc0142080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faca800c7c0 tx=0x7faca800cc90 comp rx=0 tx=0).stop 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 shutdown_connections 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac90078e00 0x7fac9007b2c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7facc015d220 0x7facc015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7facc00c92f0 0x7facc0142080 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 --2- 10.20.193.10:0/3093335806 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7facc0074920 0x7facc013c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:38.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 >> 10.20.193.10:0/3093335806 conn(0x7facc00c9d80 msgr2=0x7facc006f490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:38.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 shutdown_connections 2026-02-17T11:58:38.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 -- 10.20.193.10:0/3093335806 wait complete. 2026-02-17T11:58:38.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:38.429+0000 7facc6e98640 1 librados: shutdown 2026-02-17T11:58:41.441 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:41.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.509+0000 7f5ef2e32640 10 monclient: get_monmap_and_config 2026-02-17T11:58:41.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.509+0000 7f5ef2e32640 10 monclient: build_initial_monmap 2026-02-17T11:58:41.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.509+0000 7f5ef2e32640 10 monclient: monmap: 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:41.510324+0000 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:41.510324+0000 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:41.512 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:41.513 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:41.513 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:41.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.509+0000 7f5ef2e32640 1 Processor -- start 2026-02-17T11:58:41.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.509+0000 7f5ef2e32640 1 -- start start 2026-02-17T11:58:41.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.509+0000 7f5ef2e32640 10 monclient: init 2026-02-17T11:58:41.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.509+0000 7f5ef2e32640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:41.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.509+0000 7f5ef2e32640 10 monclient: _add_conns ranks=[2,0,3,4,1,5] 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5eec15d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5eec0c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f5eec153d60 0x7f5eec15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 10 monclient(hunting): picked mon.noname-a con 0x7f5eec153d60 addr v2:10.20.193.10:3300/0 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec0c58a0 con 0x7f5eec0c92f0 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec0c55c0 con 0x7f5eec15d220 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f5eec0c7e20 con 0x7f5eec153d60 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef2e32640 10 monclient(hunting): authenticate will time out at 1191.232100s 2026-02-17T11:58:41.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef13a8640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f5eec153d60 0x7f5eec15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef0ba7640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f5eec15d220 0x7f5eec0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:48030/0 (socket says 10.20.193.10:48030) 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.510+0000 7f5ef0ba7640 1 -- 10.20.193.10:0/3545909360 learned_addr learned my addr 10.20.193.10:0/3545909360 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.511+0000 7f5ef13a8640 10 monclient(hunting): get_auth_request con 0x7f5eec153d60 auth_method 0 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.511+0000 7f5ef13a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.511+0000 7f5ef13a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.511+0000 7f5ef13a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.511+0000 7f5ef13a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.511+0000 7f5ef13a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.511+0000 7f5ef13a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ee37fe640 1 -- 10.20.193.10:0/3545909360 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735310451 0 0) 0x7f5eec0c55c0 con 0x7f5eec15d220 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ee37fe640 10 monclient(hunting): _negotiate 2026-02-17T11:58:41.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ee37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ee37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ee37fe640 10 monclient(hunting): my global_id is 4889 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ee37fe640 1 -- 10.20.193.10:0/3545909360 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ed8003620 con 0x7f5eec15d220 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ef13a8640 10 monclient(hunting): handle_auth_done global_id 4812 payload 274 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ef13a8640 1 -- 10.20.193.10:0/3545909360 >> v1:10.20.193.153:6789/0 conn(0x7f5eec15d220 legacy=0x7f5eec0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ef13a8640 1 -- 10.20.193.10:0/3545909360 >> v1:10.20.193.10:6789/0 conn(0x7f5eec0c92f0 legacy=0x7f5eec153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ef13a8640 10 monclient: _finish_hunting 0 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ef13a8640 1 monclient: found mon.noname-a 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ef13a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ef13a8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.512+0000 7f5ef13a8640 1 -- 10.20.193.10:0/3545909360 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec0c8100 con 0x7f5eec153d60 2026-02-17T11:58:41.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.514+0000 7f5ef13a8640 1 --2- 10.20.193.10:0/3545909360 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec153d60 0x7f5eec15d600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009dc0 tx=0x7f5ee802f280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f959f79f1e60a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:41.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 1 -- 10.20.193.10:0/3545909360 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee803c070 con 0x7f5eec153d60 2026-02-17T11:58:41.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:41.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:41.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 10 monclient: dump: 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:41.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 1 -- 10.20.193.10:0/3545909360 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee8037440 con 0x7f5eec153d60 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 5 monclient: authenticate success, global_id 4812 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 1 -- 10.20.193.10:0/3545909360 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8037810 con 0x7f5eec153d60 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 4 set_mon_vals no callback set 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ee37fe640 10 monclient: dump: 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:41.528 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 10 monclient: shutdown 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3545909360 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec153d60 msgr2=0x7f5eec15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 1 --2- 10.20.193.10:0/3545909360 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec153d60 0x7f5eec15d600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009dc0 tx=0x7f5ee802f280 comp rx=0 tx=0).stop 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3545909360 shutdown_connections 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 1 --2- 10.20.193.10:0/3545909360 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec153d60 0x7f5eec15d600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:41.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3545909360 >> 10.20.193.10:0/3545909360 conn(0x7f5eec0c9d80 msgr2=0x7f5eec0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3545909360 shutdown_connections 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.516+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3545909360 wait complete. 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.517+0000 7f5ef2e32640 10 monclient: build_initial_monmap 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.517+0000 7f5ef2e32640 10 monclient: monmap: 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:41.530 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.517+0000 7f5ef2e32640 1 librados: starting msgr at 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.517+0000 7f5ef2e32640 1 librados: starting objecter 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.517+0000 7f5ef2e32640 1 Processor -- start 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.517+0000 7f5ef2e32640 1 -- start start 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.517+0000 7f5ef2e32640 1 librados: setting wanted keys 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.517+0000 7f5ef2e32640 1 librados: calling monclient init 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.517+0000 7f5ef2e32640 10 monclient: init 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec0c92f0 0x7f5eec1f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient(hunting): picked mon.noname-a con 0x7f5eec0c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5eec153d60 0x7f5eec14a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient(hunting): picked mon.noname-c con 0x7f5eec153d60 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5eec15d220 0x7f5eec1f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient(hunting): picked mon.noname-b con 0x7f5eec15d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:41.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec074920 con 0x7f5eec0c92f0 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec0c86c0 con 0x7f5eec15d220 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec074aa0 con 0x7f5eec153d60 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef2e32640 10 monclient(hunting): authenticate will time out at 1191.240128s 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec0c92f0 0x7f5eec1f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec0c92f0 0x7f5eec1f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:46920/0 (socket says 10.20.193.10:46920) 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 1 -- 10.20.193.10:0/3991548385 learned_addr learned my addr 10.20.193.10:0/3991548385 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 10 monclient(hunting): get_auth_request con 0x7f5eec0c92f0 auth_method 0 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:41.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ee3fff640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5eec153d60 0x7f5eec14a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef13a8640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5eec15d220 0x7f5eec1f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef0ba7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ee3fff640 10 monclient(hunting): get_auth_request con 0x7f5eec153d60 auth_method 0 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ee3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ee3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ee3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef13a8640 10 monclient(hunting): get_auth_request con 0x7f5eec15d220 auth_method 0 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef13a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef13a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.518+0000 7f5ef13a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.519+0000 7f5ee3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.519+0000 7f5ee3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.519+0000 7f5ee3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.519+0000 7f5ef13a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.519+0000 7f5ef13a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:41.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.519+0000 7f5ef13a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 10 monclient(hunting): handle_auth_done global_id 4818 payload 824 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 1 -- 10.20.193.10:0/3991548385 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5eec153d60 msgr2=0x7f5eec14a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5eec153d60 0x7f5eec14a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 1 -- 10.20.193.10:0/3991548385 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5eec15d220 msgr2=0x7f5eec1f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5eec15d220 0x7f5eec1f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 10 monclient: _finish_hunting 0 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 1 monclient: found mon.noname-a 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.520+0000 7f5ef0ba7640 1 -- 10.20.193.10:0/3991548385 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec1f5350 con 0x7f5eec0c92f0 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.521+0000 7f5ef0ba7640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec0c92f0 0x7f5eec1f2130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00c500 tx=0x7f5edc00c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.521+0000 7f5ee17fa640 10 client.?.objecter ms_handle_connect 0x7f5eec0c92f0 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.521+0000 7f5ee17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 1 -- 10.20.193.10:0/3991548385 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc017070 con 0x7f5eec0c92f0 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:41.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 10 monclient: dump: 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 10 monclient: _finish_auth 0 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 10 monclient: _check_auth_tickets 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 1 -- 10.20.193.10:0/3991548385 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5edc005de0 con 0x7f5eec0c92f0 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 1 -- 10.20.193.10:0/3991548385 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0072b0 con 0x7f5eec0c92f0 2026-02-17T11:58:41.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee2ffd640 4 set_mon_vals no callback set 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ee17fa640 10 monclient: dump: 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ef2e32640 5 monclient: authenticate success, global_id 4818 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ef2e32640 10 monclient: _renew_subs 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ef2e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec1f5630 con 0x7f5eec0c92f0 2026-02-17T11:58:41.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ef2e32640 10 client.4818.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:41.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ef2e32640 10 monclient: _renew_subs 2026-02-17T11:58:41.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ef2e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:41.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eec1f1650 con 0x7f5eec0c92f0 2026-02-17T11:58:41.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.522+0000 7f5ef2e32640 1 librados: init done 2026-02-17T11:58:41.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.523+0000 7f5ef2e32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:41.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.523+0000 7f5ef2e32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:41.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.523+0000 7f5ef2e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:41.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.523+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eec15d600 con 0x7f5eec0c92f0 2026-02-17T11:58:41.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.535+0000 7f5ee17fa640 1 -- 10.20.193.10:0/3991548385 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5edc007450 con 0x7f5eec0c92f0 2026-02-17T11:58:41.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.535+0000 7f5ee17fa640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5ebc078e80 0x7f5ebc07b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:41.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.535+0000 7f5ee3fff640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5ebc078e80 0x7f5ebc07b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:41.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.536+0000 7f5ee3fff640 10 monclient: get_auth_request con 0x7f5ebc078e80 auth_method 0 2026-02-17T11:58:41.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.536+0000 7f5ee17fa640 10 client.4818.objecter ms_handle_connect 0x7f5ebc078e80 2026-02-17T11:58:41.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.536+0000 7f5ee3fff640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5ebc078e80 0x7f5ebc07b340 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4002410 tx=0x7f5ed4007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:41.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.536+0000 7f5ee17fa640 1 -- 10.20.193.10:0/3991548385 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5edc007770 con 0x7f5eec0c92f0 2026-02-17T11:58:41.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.536+0000 7f5ee17fa640 10 client.4818.objecter ms_dispatch2 0x7f5eec000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:41.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.536+0000 7f5ee17fa640 3 client.4818.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:41.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.536+0000 7f5ee17fa640 3 client.4818.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:41.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.537+0000 7f5ee17fa640 20 client.4818.objecter dump_active .. 0 homeless 2026-02-17T11:58:41.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.635+0000 7f5ee17fa640 1 -- 10.20.193.10:0/3991548385 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5edc021020 con 0x7f5eec0c92f0 2026-02-17T11:58:41.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.635+0000 7f5ee17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:41.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.635+0000 7f5ee17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:41.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.741+0000 7f5ef2e32640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:41.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.741+0000 7f5ef2e32640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:41.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.741+0000 7f5ef2e32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:58:41.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.741+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5eec1573e0 con 0x7f5eec0c92f0 2026-02-17T11:58:41.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.743+0000 7f5ee17fa640 1 -- 10.20.193.10:0/3991548385 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f5edc061440 con 0x7f5eec0c92f0 2026-02-17T11:58:41.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.743+0000 7f5ee17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:41.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.743+0000 7f5ee17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:41.746 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:41.746 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:41.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 10 librados: watch_flush enter 2026-02-17T11:58:41.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 10 librados: watch_flush exit 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 20 client.4818.objecter shutdown clearing up homeless session... 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 10 client.4818.objecter successfully canceled tick 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5ebc078e80 msgr2=0x7f5ebc07b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5ebc078e80 0x7f5ebc07b340 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4002410 tx=0x7f5ed4007ef0 comp rx=0 tx=0).stop 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 10 monclient: shutdown 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec0c92f0 msgr2=0x7f5eec1f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec0c92f0 0x7f5eec1f2130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00c500 tx=0x7f5edc00c9d0 comp rx=0 tx=0).stop 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 shutdown_connections 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5ebc078e80 0x7f5ebc07b340 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:41.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5eec15d220 0x7f5eec1f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:41.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5eec153d60 0x7f5eec14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:41.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 --2- 10.20.193.10:0/3991548385 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5eec0c92f0 0x7f5eec1f2130 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:41.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 >> 10.20.193.10:0/3991548385 conn(0x7f5eec0c9d80 msgr2=0x7f5eec1510e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:41.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 shutdown_connections 2026-02-17T11:58:41.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.744+0000 7f5ef2e32640 1 -- 10.20.193.10:0/3991548385 wait complete. 2026-02-17T11:58:41.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:41.745+0000 7f5ef2e32640 1 librados: shutdown 2026-02-17T11:58:44.756 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:44.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.822+0000 7f786e961640 10 monclient: get_monmap_and_config 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.822+0000 7f786e961640 10 monclient: build_initial_monmap 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.822+0000 7f786e961640 10 monclient: monmap: 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:44.823539+0000 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:44.823539+0000 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:44.825 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:44.826 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:44.826 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:44.826 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:44.826 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:44.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.822+0000 7f786e961640 1 Processor -- start 2026-02-17T11:58:44.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.822+0000 7f786e961640 1 -- start start 2026-02-17T11:58:44.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.822+0000 7f786e961640 10 monclient: init 2026-02-17T11:58:44.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:44.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 10 monclient: _add_conns ranks=[0,2,1,3,5,4] 2026-02-17T11:58:44.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7868152660 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:44.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f786815b030 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:44.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f78680c6ce0 addr v1:10.20.193.71:6789/0 2026-02-17T11:58:44.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78680c71e0 con 0x7f7868152660 2026-02-17T11:58:44.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78680c74c0 con 0x7f78680c6ce0 2026-02-17T11:58:44.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7868159e40 con 0x7f786815b030 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f786e961640 10 monclient(hunting): authenticate will time out at 1194.545241s 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f7867fff640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f7868152660 0x7f786815a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:58428/0 (socket says 10.20.193.10:58428) 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.823+0000 7f7867fff640 1 -- 10.20.193.10:0/500143680 learned_addr learned my addr 10.20.193.10:0/500143680 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.824+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 407656186 0 0) 0x7f78680c71e0 con 0x7f7868152660 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.824+0000 7f7866ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.824+0000 7f7866ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.824+0000 7f7866ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.824+0000 7f7866ffd640 10 monclient(hunting): my global_id is 4821 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.824+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f784c003620 con 0x7f7868152660 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900213960 0 0) 0x7f7868159e40 con 0x7f786815b030 2026-02-17T11:58:44.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 10 monclient(hunting): my global_id is 4895 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78680c71e0 con 0x7f786815b030 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1737557062 0 0) 0x7f78680c74c0 con 0x7f78680c6ce0 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 10 monclient(hunting): my global_id is 4846 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.825+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7868159e40 con 0x7f78680c6ce0 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 296790957 0 0) 0x7f784c003620 con 0x7f7868152660 2026-02-17T11:58:44.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 >> v1:10.20.193.153:6789/0 conn(0x7f786815b030 legacy=0x7f78680c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 >> v1:10.20.193.71:6789/0 conn(0x7f78680c6ce0 legacy=0x7f78681631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786815a120 con 0x7f7868152660 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f7854002f20 con 0x7f7868152660 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:44.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient: dump: 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T11:58:44.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 >> v1:10.20.193.10:6789/0 conn(0x7f7868152660 legacy=0x7f786815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f784c003fe0 0x7f784c004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient(hunting): picked mon.a con 0x7f784c003fe0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f784c004e40 0x7f784c0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient(hunting): picked mon.b con 0x7f784c004e40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 0x7f784c00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient(hunting): picked mon.c con 0x7f784c009ab0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f784c00c570 con 0x7f784c003fe0 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:44.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f784c00c6f0 con 0x7f784c004e40 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f784c00c8f0 con 0x7f784c009ab0 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.826+0000 7f7866ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.827+0000 7f786ced7640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 0x7f784c00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.827+0000 7f786ced7640 10 monclient(hunting): get_auth_request con 0x7f784c009ab0 auth_method 0 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.827+0000 7f786ced7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.827+0000 7f786ced7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.827+0000 7f786ced7640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f78677fe640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f784c004e40 0x7f784c0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f786ced7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:44.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f786ced7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f786ced7640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f7867fff640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f784c003fe0 0x7f784c004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f78677fe640 10 monclient(hunting): get_auth_request con 0x7f784c004e40 auth_method 0 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f78677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f78677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f78677fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f7867fff640 10 monclient(hunting): get_auth_request con 0x7f784c003fe0 auth_method 0 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f7867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f7867fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f7867fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f78677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f78677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:44.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f78677fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f7867fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f7867fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.828+0000 7f7867fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 10 monclient(hunting): handle_auth_done global_id 4821 payload 293 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 1 -- 10.20.193.10:0/500143680 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f784c004e40 msgr2=0x7f784c0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f784c004e40 0x7f784c0052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 1 -- 10.20.193.10:0/500143680 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f784c003fe0 msgr2=0x7f784c004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f784c003fe0 0x7f784c004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 10 monclient: _finish_hunting 0 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 1 monclient: found mon.c 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:44.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 1 -- 10.20.193.10:0/500143680 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c003620 con 0x7f784c009ab0 2026-02-17T11:58:44.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 10 monclient: _finish_auth 0 2026-02-17T11:58:44.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 10 monclient: _check_auth_tickets 2026-02-17T11:58:44.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:44.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786e961640 5 monclient: authenticate success, global_id 4821 2026-02-17T11:58:44.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786e961640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:44.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.829+0000 7f786ced7640 1 -- 10.20.193.10:0/500143680 reap_dead start 2026-02-17T11:58:44.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.830+0000 7f786ced7640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 0x7f784c00bea0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f785c00c320 tx=0x7f785c02f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b07c45f61bbbdd54 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:44.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c003860 con 0x7f784c009ab0 2026-02-17T11:58:44.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 10 monclient: dump: 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:44.848 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f785c003c70 con 0x7f784c009ab0 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f786e961640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 1 -- 10.20.193.10:0/500143680 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c005310 con 0x7f784c009ab0 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f786e961640 4 set_mon_vals no callback set 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.831+0000 7f7866ffd640 10 monclient: dump: 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:44.849 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 10 monclient: shutdown 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 -- 10.20.193.10:0/500143680 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 msgr2=0x7f784c00bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 0x7f784c00bea0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f785c00c320 tx=0x7f785c02f610 comp rx=0 tx=0).stop 2026-02-17T11:58:44.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 -- 10.20.193.10:0/500143680 shutdown_connections 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 --2- 10.20.193.10:0/500143680 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 0x7f784c00bea0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 -- 10.20.193.10:0/500143680 >> 10.20.193.10:0/500143680 conn(0x7f78680c9d80 msgr2=0x7f78680ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 -- 10.20.193.10:0/500143680 shutdown_connections 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 -- 10.20.193.10:0/500143680 wait complete. 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 10 monclient: build_initial_monmap 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 10 monclient: monmap: 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:44.851 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 librados: starting msgr at 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 librados: starting objecter 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 Processor -- start 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 -- start start 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 librados: setting wanted keys 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 1 librados: calling monclient init 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.832+0000 7f786e961640 10 monclient: init 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:58:44.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 0x7f7868147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient(hunting): picked mon.noname-c con 0x7f784c009ab0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f78681582b0 0x7f78680c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient(hunting): picked mon.noname-b con 0x7f78681582b0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f78680c8250 0x7f78681f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient(hunting): picked mon.noname-a con 0x7f78680c8250 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f7868152a40 con 0x7f78680c8250 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f78680c77a0 con 0x7f78681582b0 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7868152bc0 con 0x7f784c009ab0 2026-02-17T11:58:44.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:44.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786e961640 10 monclient(hunting): authenticate will time out at 1194.555316s 2026-02-17T11:58:44.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f78680c8250 0x7f78681f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:44.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f7867fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 0x7f7868147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:44.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f78677fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f78681582b0 0x7f78680c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:44.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f78680c8250 0x7f78681f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:34992/0 (socket says 10.20.193.10:34992) 2026-02-17T11:58:44.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 1 -- 10.20.193.10:0/1914986520 learned_addr learned my addr 10.20.193.10:0/1914986520 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:44.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 10 monclient(hunting): get_auth_request con 0x7f78680c8250 auth_method 0 2026-02-17T11:58:44.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:44.854 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f7867fff640 10 monclient(hunting): get_auth_request con 0x7f784c009ab0 auth_method 0 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f7867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f7867fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f7867fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f78677fe640 10 monclient(hunting): get_auth_request con 0x7f78681582b0 auth_method 0 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f78677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f78677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f78677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:44.855 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.833+0000 7f786ced7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.834+0000 7f7867fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.834+0000 7f7867fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.834+0000 7f7867fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.834+0000 7f78677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.834+0000 7f78677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.834+0000 7f78677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 10 monclient(hunting): handle_auth_done global_id 4849 payload 824 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 1 -- 10.20.193.10:0/1914986520 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 msgr2=0x7f7868147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 0x7f7868147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 1 -- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f78680c8250 msgr2=0x7f78681f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f78680c8250 0x7f78681f7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:44.856 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 1 monclient: found mon.noname-b 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f78677fe640 1 -- 10.20.193.10:0/1914986520 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786814ac20 con 0x7f78681582b0 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.835+0000 7f786ced7640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f78680c8250 0x7f78681f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.836+0000 7f78677fe640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f78681582b0 0x7f78680c7d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f785800eaa0 tx=0x7f785800ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.836+0000 7f7864ff9640 10 client.?.objecter ms_handle_connect 0x7f78681582b0 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.836+0000 7f7864ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 1 -- 10.20.193.10:0/1914986520 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785800c990 con 0x7f78681582b0 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 10 monclient: dump: 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:44.857 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 10 monclient: _finish_auth 0 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 1 -- 10.20.193.10:0/1914986520 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f785801a070 con 0x7f78681582b0 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 1 -- 10.20.193.10:0/1914986520 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785800cd70 con 0x7f78681582b0 2026-02-17T11:58:44.858 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f7864ff9640 10 monclient: dump: 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f78667fc640 4 set_mon_vals no callback set 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 5 monclient: authenticate success, global_id 4849 2026-02-17T11:58:44.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 10 monclient: _renew_subs 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78681498c0 con 0x7f78681582b0 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 10 client.4849.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 10 monclient: _renew_subs 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7868149e80 con 0x7f78681582b0 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 1 librados: init done 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:44.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.838+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f786815a920 con 0x7f78681582b0 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.850+0000 7f7864ff9640 1 -- 10.20.193.10:0/1914986520 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f7858014070 con 0x7f78681582b0 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.851+0000 7f7864ff9640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7838078e50 0x7f783807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.851+0000 7f7867fff640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7838078e50 0x7f783807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.851+0000 7f7867fff640 10 monclient: get_auth_request con 0x7f7838078e50 auth_method 0 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.851+0000 7f7867fff640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7838078e50 0x7f783807b310 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78540028f0 tx=0x7f78540026e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.851+0000 7f7864ff9640 10 client.4849.objecter ms_handle_connect 0x7f7838078e50 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.851+0000 7f7864ff9640 1 -- 10.20.193.10:0/1914986520 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f785805e760 con 0x7f78681582b0 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.851+0000 7f7864ff9640 10 client.4849.objecter ms_dispatch2 0x7f7868000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.851+0000 7f7864ff9640 3 client.4849.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.851+0000 7f7864ff9640 3 client.4849.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:44.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.852+0000 7f7864ff9640 20 client.4849.objecter dump_active .. 0 homeless 2026-02-17T11:58:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.953+0000 7f7864ff9640 1 -- 10.20.193.10:0/1914986520 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f786814ac20 con 0x7f78681582b0 2026-02-17T11:58:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.953+0000 7f7864ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:44.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:44.953+0000 7f7864ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:45.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.055+0000 7f786e961640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:45.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.055+0000 7f786e961640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:45.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.055+0000 7f786e961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:45.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.055+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7868150eb0 con 0x7f78681582b0 2026-02-17T11:58:45.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.057+0000 7f7864ff9640 1 -- 10.20.193.10:0/1914986520 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f7858062720 con 0x7f78681582b0 2026-02-17T11:58:45.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.057+0000 7f7864ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:45.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.057+0000 7f7864ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:45.059 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:45.059 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:45.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 10 librados: watch_flush enter 2026-02-17T11:58:45.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 10 librados: watch_flush exit 2026-02-17T11:58:45.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 20 client.4849.objecter shutdown clearing up homeless session... 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 10 client.4849.objecter successfully canceled tick 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7838078e50 msgr2=0x7f783807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7838078e50 0x7f783807b310 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78540028f0 tx=0x7f78540026e0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 10 monclient: shutdown 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f78681582b0 msgr2=0x7f78680c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f78681582b0 0x7f78680c7d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f785800eaa0 tx=0x7f785800ef70 comp rx=0 tx=0).stop 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 shutdown_connections 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7838078e50 0x7f783807b310 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f78680c8250 0x7f78681f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f78681582b0 0x7f78680c7d10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 --2- 10.20.193.10:0/1914986520 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f784c009ab0 0x7f7868147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:45.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 >> 10.20.193.10:0/1914986520 conn(0x7f78680c9d80 msgr2=0x7f786814c970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:45.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 shutdown_connections 2026-02-17T11:58:45.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 -- 10.20.193.10:0/1914986520 wait complete. 2026-02-17T11:58:45.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:45.058+0000 7f786e961640 1 librados: shutdown 2026-02-17T11:58:48.070 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:48.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.138+0000 7f918c785640 10 monclient: get_monmap_and_config 2026-02-17T11:58:48.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.138+0000 7f918c785640 10 monclient: build_initial_monmap 2026-02-17T11:58:48.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.138+0000 7f918c785640 10 monclient: monmap: 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:48.139365+0000 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:48.139365+0000 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:48.141 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:48.142 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:48.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.138+0000 7f918c785640 1 Processor -- start 2026-02-17T11:58:48.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.138+0000 7f918c785640 1 -- start start 2026-02-17T11:58:48.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.138+0000 7f918c785640 10 monclient: init 2026-02-17T11:58:48.144 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:48.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 10 monclient: _add_conns ranks=[2,4,3,1,0,5] 2026-02-17T11:58:48.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f918415d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:48.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f91840c92f0 0x7f918415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 10 monclient(hunting): picked mon.noname-b con 0x7f91840c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:48.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f9184074920 0x7f9184153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 10 monclient(hunting): picked mon.noname-a con 0x7f9184074920 addr v2:10.20.193.10:3300/0 2026-02-17T11:58:48.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91840c58a0 con 0x7f918415d220 2026-02-17T11:58:48.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f91840c55c0 con 0x7f9184074920 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f91840c7e20 con 0x7f91840c92f0 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918c785640 10 monclient(hunting): authenticate will time out at 1197.861094s 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918acfb640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f9184074920 0x7f9184153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918a4fa640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f918415d220 0x7f91840c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:44514/0 (socket says 10.20.193.10:44514) 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918a4fa640 1 -- 10.20.193.10:0/1030494793 learned_addr learned my addr 10.20.193.10:0/1030494793 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918acfb640 10 monclient(hunting): get_auth_request con 0x7f9184074920 auth_method 0 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918acfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918acfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f918acfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f9189cf9640 1 --2- 10.20.193.10:0/1030494793 >> v2:10.20.193.71:3300/0 conn(0x7f91840c92f0 0x7f918415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f9189cf9640 10 monclient(hunting): get_auth_request con 0x7f91840c92f0 auth_method 0 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f9189cf9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f9189cf9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.139+0000 7f9189cf9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.140+0000 7f918acfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.140+0000 7f918acfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.140+0000 7f918acfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.140+0000 7f9189cf9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.140+0000 7f9189cf9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.140+0000 7f9189cf9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.141+0000 7f918acfb640 10 monclient(hunting): handle_auth_done global_id 4827 payload 274 2026-02-17T11:58:48.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.141+0000 7f918acfb640 1 -- 10.20.193.10:0/1030494793 >> v2:10.20.193.71:3300/0 conn(0x7f91840c92f0 msgr2=0x7f918415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:48.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.141+0000 7f918acfb640 1 --2- 10.20.193.10:0/1030494793 >> v2:10.20.193.71:3300/0 conn(0x7f91840c92f0 0x7f918415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.141+0000 7f918acfb640 1 -- 10.20.193.10:0/1030494793 >> v1:10.20.193.153:6789/0 conn(0x7f918415d220 legacy=0x7f91840c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:48.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.141+0000 7f918acfb640 10 monclient: _finish_hunting 0 2026-02-17T11:58:48.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.141+0000 7f918acfb640 1 monclient: found mon.noname-a 2026-02-17T11:58:48.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.141+0000 7f918acfb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:48.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.141+0000 7f918acfb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:58:48.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.141+0000 7f918acfb640 1 -- 10.20.193.10:0/1030494793 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91840c8100 con 0x7f9184074920 2026-02-17T11:58:48.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.142+0000 7f918acfb640 1 --2- 10.20.193.10:0/1030494793 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9184074920 0x7f9184153650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9180009d90 tx=0x7f918002f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5f6f18f372a741 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:48.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 1 -- 10.20.193.10:0/1030494793 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918003c070 con 0x7f9184074920 2026-02-17T11:58:48.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:48.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:58:48.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 10 monclient: dump: 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:48.156 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:48.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 10 monclient: _finish_auth 0 2026-02-17T11:58:48.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 10 monclient: _check_auth_tickets 2026-02-17T11:58:48.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:48.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f918c785640 5 monclient: authenticate success, global_id 4827 2026-02-17T11:58:48.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f918c785640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:48.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 1 -- 10.20.193.10:0/1030494793 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9180037440 con 0x7f9184074920 2026-02-17T11:58:48.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:48.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 1 -- 10.20.193.10:0/1030494793 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180037810 con 0x7f9184074920 2026-02-17T11:58:48.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:48.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:58:48.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f91894f8640 10 monclient: dump: 2026-02-17T11:58:48.158 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:48.158 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:48.158 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:48.158 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:48.158 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:48.158 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:48.159 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:48.159 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:48.159 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:48.159 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:48.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f918c785640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:48.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.143+0000 7f918c785640 4 set_mon_vals no callback set 2026-02-17T11:58:48.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 10 monclient: shutdown 2026-02-17T11:58:48.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:48.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 -- 10.20.193.10:0/1030494793 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9184074920 msgr2=0x7f9184153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 --2- 10.20.193.10:0/1030494793 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9184074920 0x7f9184153650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9180009d90 tx=0x7f918002f1e0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 -- 10.20.193.10:0/1030494793 shutdown_connections 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 --2- 10.20.193.10:0/1030494793 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9184074920 0x7f9184153650 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 --2- 10.20.193.10:0/1030494793 >> v2:10.20.193.71:3300/0 conn(0x7f91840c92f0 0x7f918415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 -- 10.20.193.10:0/1030494793 >> 10.20.193.10:0/1030494793 conn(0x7f91840c9d80 msgr2=0x7f91840ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 -- 10.20.193.10:0/1030494793 shutdown_connections 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 -- 10.20.193.10:0/1030494793 wait complete. 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 10 monclient: build_initial_monmap 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 10 monclient: monmap: 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:48.160 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 librados: starting msgr at 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 librados: starting objecter 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 Processor -- start 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 -- start start 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 librados: setting wanted keys 2026-02-17T11:58:48.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 1 librados: calling monclient init 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.144+0000 7f918c785640 10 monclient: init 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9184074920 0x7f918414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient(hunting): picked mon.noname-b con 0x7f9184074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f91840c92f0 0x7f91840cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient(hunting): picked mon.noname-c con 0x7f91840c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f918415d220 0x7f91841f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient(hunting): picked mon.noname-a con 0x7f918415d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f9184074d70 con 0x7f918415d220 2026-02-17T11:58:48.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91840c86c0 con 0x7f9184074920 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9184153b90 con 0x7f91840c92f0 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918c785640 10 monclient(hunting): authenticate will time out at 1197.867356s 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918a4fa640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9184074920 0x7f918414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f9189cf9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f91840c92f0 0x7f91840cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.145+0000 7f918acfb640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f918415d220 0x7f91841f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f9189cf9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f91840c92f0 0x7f91840cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:33702/0 (socket says 10.20.193.10:33702) 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f9189cf9640 1 -- 10.20.193.10:0/3856519471 learned_addr learned my addr 10.20.193.10:0/3856519471 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:48.163 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f9189cf9640 10 monclient(hunting): get_auth_request con 0x7f91840c92f0 auth_method 0 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f9189cf9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f9189cf9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f9189cf9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918a4fa640 10 monclient(hunting): get_auth_request con 0x7f9184074920 auth_method 0 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918a4fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918a4fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918a4fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918acfb640 10 monclient(hunting): get_auth_request con 0x7f918415d220 auth_method 0 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918acfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918acfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918acfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918a4fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:48.164 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918a4fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918a4fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f9189cf9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f9189cf9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f9189cf9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918acfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918acfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.146+0000 7f918acfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 10 monclient(hunting): handle_auth_done global_id 4855 payload 824 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 1 -- 10.20.193.10:0/3856519471 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f91840c92f0 msgr2=0x7f91840cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f91840c92f0 0x7f91840cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 1 -- 10.20.193.10:0/3856519471 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f918415d220 msgr2=0x7f91841f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:48.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f918415d220 0x7f91841f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 10 monclient: _finish_hunting 0 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 1 monclient: found mon.noname-b 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.147+0000 7f918a4fa640 1 -- 10.20.193.10:0/3856519471 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918415adb0 con 0x7f9184074920 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.148+0000 7f918a4fa640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9184074920 0x7f918414a5e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f917400c460 tx=0x7f917400c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.148+0000 7f916affd640 10 client.?.objecter ms_handle_connect 0x7f9184074920 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.148+0000 7f916affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 1 -- 10.20.193.10:0/3856519471 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174017070 con 0x7f9184074920 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:48.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 10 monclient: dump: 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 10 monclient: _finish_auth 0 2026-02-17T11:58:48.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 1 -- 10.20.193.10:0/3856519471 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9174005de0 con 0x7f9184074920 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 1 -- 10.20.193.10:0/3856519471 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91740072f0 con 0x7f9184074920 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f918c785640 5 monclient: authenticate success, global_id 4855 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f9188cf7640 4 set_mon_vals no callback set 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f918c785640 10 monclient: _renew_subs 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f918c785640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91841f2570 con 0x7f9184074920 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:48.168 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f916affd640 10 monclient: dump: 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:48.169 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:48.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f918c785640 10 client.4855.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:48.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f918c785640 10 monclient: _renew_subs 2026-02-17T11:58:48.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f918c785640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:48.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f918415b050 con 0x7f9184074920 2026-02-17T11:58:48.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.150+0000 7f918c785640 1 librados: init done 2026-02-17T11:58:48.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.151+0000 7f918c785640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:48.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.151+0000 7f918c785640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:48.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.151+0000 7f918c785640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:48.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.151+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9184153f70 con 0x7f9184074920 2026-02-17T11:58:48.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.163+0000 7f916affd640 1 -- 10.20.193.10:0/3856519471 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f9174007490 con 0x7f9184074920 2026-02-17T11:58:48.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.163+0000 7f916affd640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9154078e00 0x7f915407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:48.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.163+0000 7f9189cf9640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9154078e00 0x7f915407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:48.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.163+0000 7f9189cf9640 10 monclient: get_auth_request con 0x7f9154078e00 auth_method 0 2026-02-17T11:58:48.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.163+0000 7f916affd640 10 client.4855.objecter ms_handle_connect 0x7f9154078e00 2026-02-17T11:58:48.172 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.163+0000 7f9189cf9640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9154078e00 0x7f915407b2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f91841ef640 tx=0x7f9178009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:48.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.262+0000 7f916affd640 1 -- 10.20.193.10:0/3856519471 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f91740077b0 con 0x7f9184074920 2026-02-17T11:58:48.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.262+0000 7f916affd640 10 client.4855.objecter ms_dispatch2 0x7f9184000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:48.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.262+0000 7f916affd640 3 client.4855.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:48.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.262+0000 7f916affd640 3 client.4855.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:48.265 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.262+0000 7f916affd640 20 client.4855.objecter dump_active .. 0 homeless 2026-02-17T11:58:48.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.269+0000 7f916affd640 1 -- 10.20.193.10:0/3856519471 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9174021020 con 0x7f9184074920 2026-02-17T11:58:48.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.269+0000 7f916affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:48.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.269+0000 7f916affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:48.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.370+0000 7f918c785640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:48.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.370+0000 7f918c785640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:48.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.370+0000 7f918c785640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:48.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.370+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f91840c6010 con 0x7f9184074920 2026-02-17T11:58:48.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.373+0000 7f916affd640 1 -- 10.20.193.10:0/3856519471 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f91740613b0 con 0x7f9184074920 2026-02-17T11:58:48.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.373+0000 7f916affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:48.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.373+0000 7f916affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:48.375 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:48.376 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:48.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 10 librados: watch_flush enter 2026-02-17T11:58:48.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 10 librados: watch_flush exit 2026-02-17T11:58:48.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 20 client.4855.objecter shutdown clearing up homeless session... 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 10 client.4855.objecter successfully canceled tick 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9154078e00 msgr2=0x7f915407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9154078e00 0x7f915407b2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f91841ef640 tx=0x7f9178009290 comp rx=0 tx=0).stop 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 10 monclient: shutdown 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9184074920 msgr2=0x7f918414a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9184074920 0x7f918414a5e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f917400c460 tx=0x7f917400c930 comp rx=0 tx=0).stop 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 shutdown_connections 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9154078e00 0x7f915407b2c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f918415d220 0x7f91841f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f91840c92f0 0x7f91840cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 --2- 10.20.193.10:0/3856519471 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9184074920 0x7f918414a5e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:48.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 >> 10.20.193.10:0/3856519471 conn(0x7f91840c9d80 msgr2=0x7f918406b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:48.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 shutdown_connections 2026-02-17T11:58:48.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 -- 10.20.193.10:0/3856519471 wait complete. 2026-02-17T11:58:48.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:48.374+0000 7f918c785640 1 librados: shutdown 2026-02-17T11:58:51.385 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:51.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.453+0000 7fe0e147c640 10 monclient: get_monmap_and_config 2026-02-17T11:58:51.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.453+0000 7fe0e147c640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.453+0000 7fe0e147c640 10 monclient: monmap: 2026-02-17T11:58:51.456 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:51.456 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:51.455073+0000 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:51.455073+0000 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:51.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 1 Processor -- start 2026-02-17T11:58:51.458 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 1 -- start start 2026-02-17T11:58:51.458 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient: init 2026-02-17T11:58:51.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient: _add_conns ranks=[0,3,4,5,2,1] 2026-02-17T11:58:51.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe0dc0c3e80 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:51.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fe0dc15f920 0x7fe0dc06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient(hunting): picked mon.noname-a con 0x7fe0dc15f920 addr v2:10.20.193.10:3300/0 2026-02-17T11:58:51.460 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fe0dc0c92e0 0x7fe0dc0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient(hunting): picked mon.noname-b con 0x7fe0dc0c92e0 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0dc0c9710 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fe0dc0c8e50 con 0x7fe0dc15f920 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe0dc0c7c80 con 0x7fe0dc0c92e0 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.454+0000 7fe0e147c640 10 monclient(hunting): authenticate will time out at 1201.176784s 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0da7fc640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fe0dc15f920 0x7fe0dc06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fe0dc0c92e0 0x7fe0dc0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fe0dc0c92e0 0x7fe0dc0730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:51300/0 (socket says 10.20.193.10:51300) 2026-02-17T11:58:51.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 1 -- 10.20.193.10:0/3826604902 learned_addr learned my addr 10.20.193.10:0/3826604902 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 10 monclient(hunting): get_auth_request con 0x7fe0dc0c92e0 auth_method 0 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0da7fc640 10 monclient(hunting): get_auth_request con 0x7fe0dc15f920 auth_method 0 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.455+0000 7fe0db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0db7fe640 10 monclient(hunting): handle_auth_done global_id 4858 payload 274 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0db7fe640 1 -- 10.20.193.10:0/3826604902 >> v2:10.20.193.10:3300/0 conn(0x7fe0dc15f920 msgr2=0x7fe0dc06d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0db7fe640 1 --2- 10.20.193.10:0/3826604902 >> v2:10.20.193.10:3300/0 conn(0x7fe0dc15f920 0x7fe0dc06d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0db7fe640 1 -- 10.20.193.10:0/3826604902 >> v1:10.20.193.10:6789/0 conn(0x7fe0dc0c3e80 legacy=0x7fe0dc15f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0db7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0db7fe640 1 monclient: found mon.noname-b 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0db7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.456+0000 7fe0db7fe640 1 -- 10.20.193.10:0/3826604902 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc0c7f60 con 0x7fe0dc0c92e0 2026-02-17T11:58:51.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.457+0000 7fe0db7fe640 1 --2- 10.20.193.10:0/3826604902 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c92e0 0x7fe0dc0730a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc159760 tx=0x7fe0cc02f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f4b6e1a2527d21a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 1 -- 10.20.193.10:0/3826604902 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc02fd70 con 0x7fe0dc0c92e0 2026-02-17T11:58:51.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:51.470 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 10 monclient: dump: 2026-02-17T11:58:51.470 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:51.470 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:51.470 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:51.470 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0e147c640 5 monclient: authenticate success, global_id 4858 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0e147c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:51.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 1 -- 10.20.193.10:0/3826604902 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0373f0 con 0x7fe0dc0c92e0 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 1 -- 10.20.193.10:0/3826604902 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0377c0 con 0x7fe0dc0c92e0 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0e147c640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0e147c640 4 set_mon_vals no callback set 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.459+0000 7fe0d9ffb640 10 monclient: dump: 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.472 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 10 monclient: shutdown 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 -- 10.20.193.10:0/3826604902 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c92e0 msgr2=0x7fe0dc0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 --2- 10.20.193.10:0/3826604902 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c92e0 0x7fe0dc0730a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc159760 tx=0x7fe0cc02f270 comp rx=0 tx=0).stop 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 -- 10.20.193.10:0/3826604902 shutdown_connections 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 --2- 10.20.193.10:0/3826604902 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c92e0 0x7fe0dc0730a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 --2- 10.20.193.10:0/3826604902 >> v2:10.20.193.10:3300/0 conn(0x7fe0dc15f920 0x7fe0dc06d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 -- 10.20.193.10:0/3826604902 >> 10.20.193.10:0/3826604902 conn(0x7fe0dc0c9d80 msgr2=0x7fe0dc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 -- 10.20.193.10:0/3826604902 shutdown_connections 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 -- 10.20.193.10:0/3826604902 wait complete. 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 10 monclient: build_initial_monmap 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 10 monclient: monmap: 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:51.474 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 librados: starting msgr at 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 librados: starting objecter 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 Processor -- start 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 -- start start 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 librados: setting wanted keys 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 1 librados: calling monclient init 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.460+0000 7fe0e147c640 10 monclient: init 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c3e80 0x7fe0dc14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient(hunting): picked mon.noname-b con 0x7fe0dc0c3e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe0dc0c92e0 0x7fe0dc149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient(hunting): picked mon.noname-c con 0x7fe0dc0c92e0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe0dc15f920 0x7fe0dc1f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient(hunting): picked mon.noname-a con 0x7fe0dc15f920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0c8800 con 0x7fe0dc15f920 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0c8520 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0c8ae0 con 0x7fe0dc0c92e0 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0e147c640 10 monclient(hunting): authenticate will time out at 1201.183294s 2026-02-17T11:58:51.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0db7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe0dc15f920 0x7fe0dc1f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0daffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c3e80 0x7fe0dc14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0db7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe0dc15f920 0x7fe0dc1f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:35024/0 (socket says 10.20.193.10:35024) 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0db7fe640 1 -- 10.20.193.10:0/3338743754 learned_addr learned my addr 10.20.193.10:0/3338743754 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0db7fe640 10 monclient(hunting): get_auth_request con 0x7fe0dc15f920 auth_method 0 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0daffd640 10 monclient(hunting): get_auth_request con 0x7fe0dc0c3e80 auth_method 0 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.461+0000 7fe0da7fc640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe0dc0c92e0 0x7fe0dc149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0da7fc640 10 monclient(hunting): get_auth_request con 0x7fe0dc0c92e0 auth_method 0 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.462+0000 7fe0da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:51.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 10 monclient(hunting): handle_auth_done global_id 4861 payload 824 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 1 -- 10.20.193.10:0/3338743754 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe0dc0c92e0 msgr2=0x7fe0dc149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe0dc0c92e0 0x7fe0dc149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 1 -- 10.20.193.10:0/3338743754 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe0dc15f920 msgr2=0x7fe0dc1f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe0dc15f920 0x7fe0dc1f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 10 monclient: _finish_hunting 0 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 1 monclient: found mon.noname-b 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.463+0000 7fe0daffd640 1 -- 10.20.193.10:0/3338743754 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc148ad0 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.464+0000 7fe0daffd640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c3e80 0x7fe0dc14b390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000c460 tx=0x7fe0d000c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.464+0000 7fe0bb7fe640 10 client.?.objecter ms_handle_connect 0x7fe0dc0c3e80 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.464+0000 7fe0bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:51.479 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 1 -- 10.20.193.10:0/3338743754 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00052d0 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 10 monclient: dump: 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:51.480 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 1 -- 10.20.193.10:0/3338743754 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d0005470 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 5 monclient: authenticate success, global_id 4861 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 10 monclient: _renew_subs 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc1f4090 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 1 -- 10.20.193.10:0/3338743754 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00038c0 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:51.481 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0bb7fe640 10 monclient: dump: 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0d97fa640 4 set_mon_vals no callback set 2026-02-17T11:58:51.482 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 10 client.4861.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:51.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 10 monclient: _renew_subs 2026-02-17T11:58:51.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:51.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc149070 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 1 librados: init done 2026-02-17T11:58:51.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:51.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.466+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc070d90 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.478+0000 7fe0bb7fe640 1 -- 10.20.193.10:0/3338743754 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fe0d0003a60 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.479+0000 7fe0bb7fe640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe0a8078e50 0x7fe0a807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:51.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.479+0000 7fe0da7fc640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe0a8078e50 0x7fe0a807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:51.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.479+0000 7fe0da7fc640 10 monclient: get_auth_request con 0x7fe0a8078e50 auth_method 0 2026-02-17T11:58:51.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.479+0000 7fe0bb7fe640 10 client.4861.objecter ms_handle_connect 0x7fe0a8078e50 2026-02-17T11:58:51.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.479+0000 7fe0da7fc640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe0a8078e50 0x7fe0a807b310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc15cd00 tx=0x7fe0c4009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:51.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.577+0000 7fe0bb7fe640 1 -- 10.20.193.10:0/3338743754 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe0d005df30 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.577+0000 7fe0bb7fe640 10 client.4861.objecter ms_dispatch2 0x7fe0dc000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:51.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.577+0000 7fe0bb7fe640 3 client.4861.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:51.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.577+0000 7fe0bb7fe640 3 client.4861.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:51.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.577+0000 7fe0bb7fe640 20 client.4861.objecter dump_active .. 0 homeless 2026-02-17T11:58:51.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.584+0000 7fe0bb7fe640 1 -- 10.20.193.10:0/3338743754 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe0d0061ef0 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.584+0000 7fe0bb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:51.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.584+0000 7fe0bb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:51.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.684+0000 7fe0e147c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:51.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.684+0000 7fe0e147c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:51.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.684+0000 7fe0e147c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:58:51.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.684+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe0dc06d5c0 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.687+0000 7fe0bb7fe640 1 -- 10.20.193.10:0/3338743754 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fe0d00661f0 con 0x7fe0dc0c3e80 2026-02-17T11:58:51.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.687+0000 7fe0bb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:51.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.687+0000 7fe0bb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:51.689 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:51.689 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 10 librados: watch_flush enter 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 10 librados: watch_flush exit 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 20 client.4861.objecter shutdown clearing up homeless session... 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 10 client.4861.objecter successfully canceled tick 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe0a8078e50 msgr2=0x7fe0a807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe0a8078e50 0x7fe0a807b310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc15cd00 tx=0x7fe0c4009290 comp rx=0 tx=0).stop 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 10 monclient: shutdown 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c3e80 msgr2=0x7fe0dc14b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c3e80 0x7fe0dc14b390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000c460 tx=0x7fe0d000c930 comp rx=0 tx=0).stop 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 shutdown_connections 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe0a8078e50 0x7fe0a807b310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe0dc15f920 0x7fe0dc1f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe0dc0c92e0 0x7fe0dc149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 --2- 10.20.193.10:0/3338743754 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe0dc0c3e80 0x7fe0dc14b390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 >> 10.20.193.10:0/3338743754 conn(0x7fe0dc0c9d80 msgr2=0x7fe0dc0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 shutdown_connections 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.688+0000 7fe0e147c640 1 -- 10.20.193.10:0/3338743754 wait complete. 2026-02-17T11:58:51.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:51.689+0000 7fe0e147c640 1 librados: shutdown 2026-02-17T11:58:54.700 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:54.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.769+0000 7f8ca6c64640 10 monclient: get_monmap_and_config 2026-02-17T11:58:54.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.769+0000 7f8ca6c64640 10 monclient: build_initial_monmap 2026-02-17T11:58:54.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.769+0000 7f8ca6c64640 10 monclient: monmap: 2026-02-17T11:58:54.772 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:54.771210+0000 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:54.771210+0000 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:54.773 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:54.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 1 Processor -- start 2026-02-17T11:58:54.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 1 -- start start 2026-02-17T11:58:54.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient: init 2026-02-17T11:58:54.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:54.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient: _add_conns ranks=[5,3,4,2,1,0] 2026-02-17T11:58:54.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f8ca015d220 0x7f8ca015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient(hunting): picked mon.noname-c con 0x7f8ca015d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:58:54.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8ca0074920 0x7f8ca00c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient(hunting): picked mon.noname-a con 0x7f8ca0074920 addr v2:10.20.193.10:3300/0 2026-02-17T11:58:54.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8ca00c9120 0x7f8ca0153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient(hunting): picked mon.noname-b con 0x7f8ca00c9120 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:54.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca00c95b0 con 0x7f8ca0074920 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca00c58a0 con 0x7f8ca00c9120 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca00c55c0 con 0x7f8ca015d220 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.770+0000 7f8ca6c64640 10 monclient(hunting): authenticate will time out at 1204.492930s 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca51da640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8ca00c9120 0x7f8ca0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8c97fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8ca0074920 0x7f8ca00c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f8ca015d220 0x7f8ca015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f8ca015d220 0x7f8ca015d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:48178/0 (socket says 10.20.193.10:48178) 2026-02-17T11:58:54.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 1 -- 10.20.193.10:0/2178996261 learned_addr learned my addr 10.20.193.10:0/2178996261 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 10 monclient(hunting): get_auth_request con 0x7f8ca015d220 auth_method 0 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8c97fff640 10 monclient(hunting): get_auth_request con 0x7f8ca0074920 auth_method 0 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8c97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8c97fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8c97fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca51da640 10 monclient(hunting): get_auth_request con 0x7f8ca00c9120 auth_method 0 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca51da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:54.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca51da640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca51da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8ca49d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8c97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.771+0000 7f8c97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8c97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca51da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca51da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca51da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 10 monclient(hunting): handle_auth_done global_id 4910 payload 274 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 1 -- 10.20.193.10:0/2178996261 >> v2:10.20.193.71:3300/0 conn(0x7f8ca00c9120 msgr2=0x7f8ca0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:54.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 1 --2- 10.20.193.10:0/2178996261 >> v2:10.20.193.71:3300/0 conn(0x7f8ca00c9120 0x7f8ca0153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 1 -- 10.20.193.10:0/2178996261 >> v2:10.20.193.10:3300/0 conn(0x7f8ca0074920 msgr2=0x7f8ca00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 1 --2- 10.20.193.10:0/2178996261 >> v2:10.20.193.10:3300/0 conn(0x7f8ca0074920 0x7f8ca00c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 10 monclient: _finish_hunting 0 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 1 monclient: found mon.noname-c 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.772+0000 7f8ca49d9640 1 -- 10.20.193.10:0/2178996261 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00c7e20 con 0x7f8ca015d220 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.773+0000 7f8ca49d9640 1 --2- 10.20.193.10:0/2178996261 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca015d220 0x7f8ca015d600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0076d10 tx=0x7f8c9002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ebdf90a995aff5e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 1 -- 10.20.193.10:0/2178996261 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9003c070 con 0x7f8ca015d220 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:54.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 10 monclient: dump: 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 10 monclient: _finish_auth 0 2026-02-17T11:58:54.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 10 monclient: _check_auth_tickets 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 1 -- 10.20.193.10:0/2178996261 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9002fb50 con 0x7f8ca015d220 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8ca6c64640 5 monclient: authenticate success, global_id 4910 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8ca6c64640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 1 -- 10.20.193.10:0/2178996261 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90037440 con 0x7f8ca015d220 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8ca6c64640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8ca6c64640 4 set_mon_vals no callback set 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:54.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.775+0000 7f8c977fe640 10 monclient: dump: 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:54.788 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 10 monclient: shutdown 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 1 -- 10.20.193.10:0/2178996261 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca015d220 msgr2=0x7f8ca015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/2178996261 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca015d220 0x7f8ca015d600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0076d10 tx=0x7f8c9002eed0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 1 -- 10.20.193.10:0/2178996261 shutdown_connections 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/2178996261 >> v2:10.20.193.71:3300/0 conn(0x7f8ca00c9120 0x7f8ca0153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/2178996261 >> v2:10.20.193.10:3300/0 conn(0x7f8ca0074920 0x7f8ca00c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/2178996261 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca015d220 0x7f8ca015d600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 1 -- 10.20.193.10:0/2178996261 >> 10.20.193.10:0/2178996261 conn(0x7f8ca00c9d80 msgr2=0x7f8ca00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 1 -- 10.20.193.10:0/2178996261 shutdown_connections 2026-02-17T11:58:54.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 1 -- 10.20.193.10:0/2178996261 wait complete. 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 10 monclient: build_initial_monmap 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.776+0000 7f8ca6c64640 10 monclient: monmap: 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:54.790 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 librados: starting msgr at 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 librados: starting objecter 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 Processor -- start 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 -- start start 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 librados: setting wanted keys 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 librados: calling monclient init 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient: init 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca0074920 0x7f8ca006f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient(hunting): picked mon.noname-c con 0x7f8ca0074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ca00c9120 0x7f8ca01f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient(hunting): picked mon.noname-a con 0x7f8ca00c9120 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ca015d220 0x7f8ca0147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient(hunting): picked mon.noname-b con 0x7f8ca015d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00c86c0 con 0x7f8ca00c9120 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00c83e0 con 0x7f8ca015d220 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca0074d70 con 0x7f8ca0074920 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca6c64640 10 monclient(hunting): authenticate will time out at 1204.499590s 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8ca49d9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca0074920 0x7f8ca006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.777+0000 7f8c97fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ca00c9120 0x7f8ca01f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca49d9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca0074920 0x7f8ca006f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:48188/0 (socket says 10.20.193.10:48188) 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca49d9640 1 -- 10.20.193.10:0/3100915786 learned_addr learned my addr 10.20.193.10:0/3100915786 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca49d9640 10 monclient(hunting): get_auth_request con 0x7f8ca0074920 auth_method 0 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca49d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca49d9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca49d9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca51da640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ca015d220 0x7f8ca0147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8c97fff640 10 monclient(hunting): get_auth_request con 0x7f8ca00c9120 auth_method 0 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8c97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8c97fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8c97fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:54.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca49d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca49d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca49d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca51da640 10 monclient(hunting): get_auth_request con 0x7f8ca015d220 auth_method 0 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca51da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca51da640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca51da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8c97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8c97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8c97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca51da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca51da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:54.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.778+0000 7f8ca51da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:54.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 10 monclient(hunting): handle_auth_done global_id 4913 payload 824 2026-02-17T11:58:54.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 1 -- 10.20.193.10:0/3100915786 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ca015d220 msgr2=0x7f8ca0147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:54.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ca015d220 0x7f8ca0147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 1 -- 10.20.193.10:0/3100915786 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ca00c9120 msgr2=0x7f8ca01f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ca00c9120 0x7f8ca01f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 10 monclient: _finish_hunting 0 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 1 monclient: found mon.noname-c 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.779+0000 7f8ca49d9640 1 -- 10.20.193.10:0/3100915786 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca01542b0 con 0x7f8ca0074920 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.780+0000 7f8ca49d9640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca0074920 0x7f8ca006f700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8c9002f430 tx=0x7f8c900047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.780+0000 7f8c957fa640 10 client.?.objecter ms_handle_connect 0x7f8ca0074920 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.780+0000 7f8c957fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 1 -- 10.20.193.10:0/3100915786 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9003c040 con 0x7f8ca0074920 2026-02-17T11:58:54.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 10 monclient: dump: 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:54.799 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 10 monclient: _finish_auth 0 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 10 monclient: _check_auth_tickets 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 1 -- 10.20.193.10:0/3100915786 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c90042430 con 0x7f8ca0074920 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 1 -- 10.20.193.10:0/3100915786 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90042800 con 0x7f8ca0074920 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8ca6c64640 5 monclient: authenticate success, global_id 4913 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8ca6c64640 10 monclient: _renew_subs 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8ca6c64640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c96ffd640 4 set_mon_vals no callback set 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca01f4cb0 con 0x7f8ca0074920 2026-02-17T11:58:54.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8c957fa640 10 monclient: dump: 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:54.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8ca6c64640 10 client.4913.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:54.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8ca6c64640 10 monclient: _renew_subs 2026-02-17T11:58:54.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8ca6c64640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:54.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca01f5270 con 0x7f8ca0074920 2026-02-17T11:58:54.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.782+0000 7f8ca6c64640 1 librados: init done 2026-02-17T11:58:54.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.783+0000 7f8ca6c64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:54.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.783+0000 7f8ca6c64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:54.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.783+0000 7f8ca6c64640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:54.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.783+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca01f1310 con 0x7f8ca0074920 2026-02-17T11:58:54.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.893+0000 7f8c957fa640 1 -- 10.20.193.10:0/3100915786 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f8c900429a0 con 0x7f8ca0074920 2026-02-17T11:58:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.893+0000 7f8c957fa640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8c70078e80 0x7f8c7007b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.893+0000 7f8c97fff640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8c70078e80 0x7f8c7007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.893+0000 7f8c97fff640 10 monclient: get_auth_request con 0x7f8c70078e80 auth_method 0 2026-02-17T11:58:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.894+0000 7f8c957fa640 10 client.4913.objecter ms_handle_connect 0x7f8c70078e80 2026-02-17T11:58:54.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.894+0000 7f8c97fff640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8c70078e80 0x7f8c7007b340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0147af0 tx=0x7f8c88009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.895+0000 7f8c957fa640 1 -- 10.20.193.10:0/3100915786 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f8c900836b0 con 0x7f8ca0074920 2026-02-17T11:58:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.895+0000 7f8c957fa640 10 client.4913.objecter ms_dispatch2 0x7f8ca0000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.895+0000 7f8c957fa640 3 client.4913.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.895+0000 7f8c957fa640 3 client.4913.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:54.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.896+0000 7f8c957fa640 20 client.4913.objecter dump_active .. 0 homeless 2026-02-17T11:58:54.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.902+0000 7f8c957fa640 1 -- 10.20.193.10:0/3100915786 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8ca01542b0 con 0x7f8ca0074920 2026-02-17T11:58:54.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.902+0000 7f8c957fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:54.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:54.902+0000 7f8c957fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:55.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.000+0000 7f8ca6c64640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:55.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.000+0000 7f8ca6c64640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:55.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.000+0000 7f8ca6c64640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:55.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.000+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8ca00c9b60 con 0x7f8ca0074920 2026-02-17T11:58:55.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.003+0000 7f8c957fa640 1 -- 10.20.193.10:0/3100915786 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f8c90087670 con 0x7f8ca0074920 2026-02-17T11:58:55.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.003+0000 7f8c957fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:55.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.003+0000 7f8c957fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:55.006 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:55.006 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:55.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 10 librados: watch_flush enter 2026-02-17T11:58:55.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 10 librados: watch_flush exit 2026-02-17T11:58:55.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 20 client.4913.objecter shutdown clearing up homeless session... 2026-02-17T11:58:55.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 10 client.4913.objecter successfully canceled tick 2026-02-17T11:58:55.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8c70078e80 msgr2=0x7f8c7007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:55.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8c70078e80 0x7f8c7007b340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0147af0 tx=0x7f8c88009290 comp rx=0 tx=0).stop 2026-02-17T11:58:55.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 10 monclient: shutdown 2026-02-17T11:58:55.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:55.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca0074920 msgr2=0x7f8ca006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca0074920 0x7f8ca006f700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8c9002f430 tx=0x7f8c900047c0 comp rx=0 tx=0).stop 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 shutdown_connections 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8c70078e80 0x7f8c7007b340 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8ca015d220 0x7f8ca0147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8ca00c9120 0x7f8ca01f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 --2- 10.20.193.10:0/3100915786 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8ca0074920 0x7f8ca006f700 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 >> 10.20.193.10:0/3100915786 conn(0x7f8ca00c9d80 msgr2=0x7f8ca014df90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 shutdown_connections 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 -- 10.20.193.10:0/3100915786 wait complete. 2026-02-17T11:58:55.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:55.004+0000 7f8ca6c64640 1 librados: shutdown 2026-02-17T11:58:55.270 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:05:12.438 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:55.272 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:05:12.440 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:55.280 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:05:12.448 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:55.298 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:05:12.427 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:55.299 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:05:12.428 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:55.300 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:05:12.463 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:55.300 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:05:12.463 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:55.307 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:05:12.436 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:55.308 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:05:12.471 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:58:58.015 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:58:58.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.094+0000 7f5a7e322640 10 monclient: get_monmap_and_config 2026-02-17T11:58:58.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.094+0000 7f5a7e322640 10 monclient: build_initial_monmap 2026-02-17T11:58:58.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.094+0000 7f5a7e322640 10 monclient: monmap: 2026-02-17T11:58:58.096 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:58.096 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:58.096 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:58:58.094779+0000 2026-02-17T11:58:58.096 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:58:58.094779+0000 2026-02-17T11:58:58.096 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:58.096 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.094+0000 7f5a7e322640 1 Processor -- start 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.094+0000 7f5a7e322640 1 -- start start 2026-02-17T11:58:58.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.094+0000 7f5a7e322640 10 monclient: init 2026-02-17T11:58:58.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:58.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 10 monclient: _add_conns ranks=[2,0,4,3,1,5] 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5a7815d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5a780c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5a78153d60 0x7f5a7815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 10 monclient(hunting): picked mon.noname-b con 0x7f5a78153d60 addr v2:10.20.193.71:3300/0 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a780c58a0 con 0x7f5a780c92f0 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a780c55c0 con 0x7f5a7815d220 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5a780c7e20 con 0x7f5a78153d60 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:58.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a7e322640 10 monclient(hunting): authenticate will time out at 1207.816491s 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a777fe640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f5a780c92f0 0x7f5a78153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:48044/0 (socket says 10.20.193.10:48044) 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.095+0000 7f5a777fe640 1 -- 10.20.193.10:0/408162943 learned_addr learned my addr 10.20.193.10:0/408162943 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.096+0000 7f5a7c898640 1 --2- 10.20.193.10:0/408162943 >> v2:10.20.193.71:3300/0 conn(0x7f5a78153d60 0x7f5a7815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.096+0000 7f5a7c898640 10 monclient(hunting): get_auth_request con 0x7f5a78153d60 auth_method 0 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.096+0000 7f5a7c898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.096+0000 7f5a7c898640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.096+0000 7f5a7c898640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.096+0000 7f5a7c898640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.096+0000 7f5a7c898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.096+0000 7f5a7c898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 1 -- 10.20.193.10:0/408162943 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357978848 0 0) 0x7f5a780c58a0 con 0x7f5a780c92f0 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:58:58.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 10 monclient(hunting): my global_id is 4848 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 1 -- 10.20.193.10:0/408162943 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a5c003620 con 0x7f5a780c92f0 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 1 -- 10.20.193.10:0/408162943 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 703471996 0 0) 0x7f5a780c55c0 con 0x7f5a7815d220 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 10 monclient(hunting): my global_id is 4916 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.097+0000 7f5a76ffd640 1 -- 10.20.193.10:0/408162943 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a780c58a0 con 0x7f5a7815d220 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.098+0000 7f5a7c898640 10 monclient(hunting): handle_auth_done global_id 4870 payload 274 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.098+0000 7f5a7c898640 1 -- 10.20.193.10:0/408162943 >> v1:10.20.193.153:6789/0 conn(0x7f5a7815d220 legacy=0x7f5a780c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:58.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.098+0000 7f5a7c898640 1 -- 10.20.193.10:0/408162943 >> v1:10.20.193.10:6789/0 conn(0x7f5a780c92f0 legacy=0x7f5a78153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:58.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.098+0000 7f5a7c898640 10 monclient: _finish_hunting 0 2026-02-17T11:58:58.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.098+0000 7f5a7c898640 1 monclient: found mon.noname-b 2026-02-17T11:58:58.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.098+0000 7f5a7c898640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:58.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.098+0000 7f5a7c898640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:58:58.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.098+0000 7f5a7c898640 1 -- 10.20.193.10:0/408162943 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a780c8100 con 0x7f5a78153d60 2026-02-17T11:58:58.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.099+0000 7f5a7c898640 1 --2- 10.20.193.10:0/408162943 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5a78153d60 0x7f5a7815d600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009dc0 tx=0x7f5a6c02f280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=496c00217d4a8018 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:58.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 1 -- 10.20.193.10:0/408162943 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c03c070 con 0x7f5a78153d60 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 10 monclient: dump: 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:58.112 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 10 monclient: _finish_auth 0 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 1 -- 10.20.193.10:0/408162943 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c037440 con 0x7f5a78153d60 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 5 monclient: authenticate success, global_id 4870 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 1 -- 10.20.193.10:0/408162943 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c037810 con 0x7f5a78153d60 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:58.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a76ffd640 10 monclient: dump: 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:58.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 10 monclient: get_monmap_and_config success 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 4 set_mon_vals no callback set 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 10 monclient: shutdown 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 1 -- 10.20.193.10:0/408162943 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5a78153d60 msgr2=0x7f5a7815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 1 --2- 10.20.193.10:0/408162943 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5a78153d60 0x7f5a7815d600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009dc0 tx=0x7f5a6c02f280 comp rx=0 tx=0).stop 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 1 -- 10.20.193.10:0/408162943 shutdown_connections 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 1 --2- 10.20.193.10:0/408162943 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5a78153d60 0x7f5a7815d600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 1 -- 10.20.193.10:0/408162943 >> 10.20.193.10:0/408162943 conn(0x7f5a780c9d80 msgr2=0x7f5a780ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 1 -- 10.20.193.10:0/408162943 shutdown_connections 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.101+0000 7f5a7e322640 1 -- 10.20.193.10:0/408162943 wait complete. 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.102+0000 7f5a7e322640 10 monclient: build_initial_monmap 2026-02-17T11:58:58.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.102+0000 7f5a7e322640 10 monclient: monmap: 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.102+0000 7f5a7e322640 1 librados: starting msgr at 2026-02-17T11:58:58.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.102+0000 7f5a7e322640 1 librados: starting objecter 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.102+0000 7f5a7e322640 1 Processor -- start 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.102+0000 7f5a7e322640 1 -- start start 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.102+0000 7f5a7e322640 1 librados: setting wanted keys 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.102+0000 7f5a7e322640 1 librados: calling monclient init 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.102+0000 7f5a7e322640 10 monclient: init 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient: _reopen_session rank -1 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5a780c92f0 0x7f5a781f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient(hunting): picked mon.noname-c con 0x7f5a780c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5a78153d60 0x7f5a7814a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient(hunting): picked mon.noname-a con 0x7f5a78153d60 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:58:58.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5a7815d220 0x7f5a781f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient(hunting): picked mon.noname-b con 0x7f5a7815d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78074920 con 0x7f5a78153d60 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a780c86c0 con 0x7f5a7815d220 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78074aa0 con 0x7f5a780c92f0 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient(hunting): _renew_subs 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7e322640 10 monclient(hunting): authenticate will time out at 1207.824198s 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a777fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5a78153d60 0x7f5a7814a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a77fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5a780c92f0 0x7f5a781f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:58.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7c898640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5a7815d220 0x7f5a781f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a777fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5a78153d60 0x7f5a7814a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:34320/0 (socket says 10.20.193.10:34320) 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a777fe640 1 -- 10.20.193.10:0/3167782059 learned_addr learned my addr 10.20.193.10:0/3167782059 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a777fe640 10 monclient(hunting): get_auth_request con 0x7f5a78153d60 auth_method 0 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a77fff640 10 monclient(hunting): get_auth_request con 0x7f5a780c92f0 auth_method 0 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7c898640 10 monclient(hunting): get_auth_request con 0x7f5a7815d220 auth_method 0 2026-02-17T11:58:58.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7c898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7c898640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7c898640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7c898640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.103+0000 7f5a7c898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.104+0000 7f5a7c898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.104+0000 7f5a777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.104+0000 7f5a777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.104+0000 7f5a777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 10 monclient(hunting): handle_auth_done global_id 4919 payload 824 2026-02-17T11:58:58.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 1 -- 10.20.193.10:0/3167782059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5a7815d220 msgr2=0x7f5a781f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5a7815d220 0x7f5a781f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 1 -- 10.20.193.10:0/3167782059 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5a78153d60 msgr2=0x7f5a7814a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5a78153d60 0x7f5a7814a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 10 monclient: _finish_hunting 0 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 1 monclient: found mon.noname-c 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.105+0000 7f5a77fff640 1 -- 10.20.193.10:0/3167782059 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a781f5350 con 0x7f5a780c92f0 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.106+0000 7f5a77fff640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5a780c92f0 0x7f5a781f2130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c460 tx=0x7f5a6400c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.106+0000 7f5a74ff9640 10 client.?.objecter ms_handle_connect 0x7f5a780c92f0 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.106+0000 7f5a74ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:58:58.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 1 -- 10.20.193.10:0/3167782059 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640052d0 con 0x7f5a780c92f0 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 10 monclient: dump: 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:58.122 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 10 monclient: _finish_auth 0 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 1 -- 10.20.193.10:0/3167782059 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64005470 con 0x7f5a780c92f0 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 1 -- 10.20.193.10:0/3167782059 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64003930 con 0x7f5a780c92f0 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a74ff9640 10 monclient: dump: 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:58:58.123 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a767fc640 4 set_mon_vals no callback set 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a7e322640 5 monclient: authenticate success, global_id 4919 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a7e322640 10 monclient: _renew_subs 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a7e322640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a781f5630 con 0x7f5a780c92f0 2026-02-17T11:58:58.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a7e322640 10 client.4919.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:58:58.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a7e322640 10 monclient: _renew_subs 2026-02-17T11:58:58.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a7e322640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:58.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a781f1650 con 0x7f5a780c92f0 2026-02-17T11:58:58.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.108+0000 7f5a7e322640 1 librados: init done 2026-02-17T11:58:58.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.109+0000 7f5a7e322640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:58.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.109+0000 7f5a7e322640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:58.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.109+0000 7f5a7e322640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:58.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.109+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7815d600 con 0x7f5a780c92f0 2026-02-17T11:58:58.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.120+0000 7f5a74ff9640 1 -- 10.20.193.10:0/3167782059 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5a64003ad0 con 0x7f5a780c92f0 2026-02-17T11:58:58.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.121+0000 7f5a74ff9640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5a48078e30 0x7f5a4807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:58:58.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.121+0000 7f5a777fe640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5a48078e30 0x7f5a4807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:58:58.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.121+0000 7f5a777fe640 10 monclient: get_auth_request con 0x7f5a48078e30 auth_method 0 2026-02-17T11:58:58.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.121+0000 7f5a777fe640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5a48078e30 0x7f5a4807b2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5a68002410 tx=0x7f5a68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:58:58.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.121+0000 7f5a74ff9640 10 client.4919.objecter ms_handle_connect 0x7f5a48078e30 2026-02-17T11:58:58.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.220+0000 7f5a74ff9640 1 -- 10.20.193.10:0/3167782059 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5a6405e030 con 0x7f5a780c92f0 2026-02-17T11:58:58.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.220+0000 7f5a74ff9640 10 client.4919.objecter ms_dispatch2 0x7f5a78000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:58:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.220+0000 7f5a74ff9640 3 client.4919.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:58:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.220+0000 7f5a74ff9640 3 client.4919.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:58:58.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.220+0000 7f5a74ff9640 20 client.4919.objecter dump_active .. 0 homeless 2026-02-17T11:58:58.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.227+0000 7f5a74ff9640 1 -- 10.20.193.10:0/3167782059 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5a64061ff0 con 0x7f5a780c92f0 2026-02-17T11:58:58.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.227+0000 7f5a74ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:58:58.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.227+0000 7f5a74ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:58:58.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.326+0000 7f5a7e322640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:58:58.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.326+0000 7f5a7e322640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:58.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.326+0000 7f5a7e322640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:58:58.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.326+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5a781573e0 con 0x7f5a780c92f0 2026-02-17T11:58:58.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.328+0000 7f5a74ff9640 1 -- 10.20.193.10:0/3167782059 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f5a640662f0 con 0x7f5a780c92f0 2026-02-17T11:58:58.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.328+0000 7f5a74ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:58:58.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.328+0000 7f5a74ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:58:58.330 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:58:58.330 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:58:58.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 10 librados: watch_flush enter 2026-02-17T11:58:58.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 10 librados: watch_flush exit 2026-02-17T11:58:58.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 20 client.4919.objecter shutdown clearing up homeless session... 2026-02-17T11:58:58.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 10 client.4919.objecter successfully canceled tick 2026-02-17T11:58:58.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5a48078e30 msgr2=0x7f5a4807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:58.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5a48078e30 0x7f5a4807b2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5a68002410 tx=0x7f5a68009040 comp rx=0 tx=0).stop 2026-02-17T11:58:58.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 10 monclient: shutdown 2026-02-17T11:58:58.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:58:58.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5a780c92f0 msgr2=0x7f5a781f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:58:58.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.329+0000 7f5a7e322640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5a780c92f0 0x7f5a781f2130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c460 tx=0x7f5a6400c930 comp rx=0 tx=0).stop 2026-02-17T11:58:58.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.330+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 shutdown_connections 2026-02-17T11:58:58.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.330+0000 7f5a7e322640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5a48078e30 0x7f5a4807b2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:58.333 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.330+0000 7f5a7e322640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5a7815d220 0x7f5a781f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:58.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.330+0000 7f5a7e322640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5a78153d60 0x7f5a7814a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:58.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.330+0000 7f5a7e322640 1 --2- 10.20.193.10:0/3167782059 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5a780c92f0 0x7f5a781f2130 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:58:58.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.330+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 >> 10.20.193.10:0/3167782059 conn(0x7f5a780c9d80 msgr2=0x7f5a781510e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:58:58.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.330+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 shutdown_connections 2026-02-17T11:58:58.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.330+0000 7f5a7e322640 1 -- 10.20.193.10:0/3167782059 wait complete. 2026-02-17T11:58:58.334 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:58:58.330+0000 7f5a7e322640 1 librados: shutdown 2026-02-17T11:59:01.340 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:01.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.406+0000 7f74313bc640 10 monclient: get_monmap_and_config 2026-02-17T11:59:01.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.406+0000 7f74313bc640 10 monclient: build_initial_monmap 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.406+0000 7f74313bc640 10 monclient: monmap: 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:01.406946+0000 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:01.406946+0000 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:01.408 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:01.409 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:01.409 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:01.409 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:01.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 1 Processor -- start 2026-02-17T11:59:01.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 1 -- start start 2026-02-17T11:59:01.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient: init 2026-02-17T11:59:01.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:01.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient: _add_conns ranks=[1,4,3,5,0,2] 2026-02-17T11:59:01.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f742c15b7e0 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:01.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f742c15bbc0 0x7f742c0c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient(hunting): picked mon.noname-b con 0x7f742c15bbc0 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f742c06e8f0 0x7f742c06ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient(hunting): picked mon.noname-a con 0x7f742c06e8f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c0c9760 con 0x7f742c15b7e0 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f742c15c010 con 0x7f742c06e8f0 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f742c0c81c0 con 0x7f742c15bbc0 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.407+0000 7f74313bc640 10 monclient(hunting): authenticate will time out at 1211.128802s 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f742c06e8f0 0x7f742c06ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:01.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742a7fc640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f742c15bbc0 0x7f742c0c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f742c06e8f0 0x7f742c06ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:34322/0 (socket says 10.20.193.10:34322) 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 1 -- 10.20.193.10:0/302554757 learned_addr learned my addr 10.20.193.10:0/302554757 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 10 monclient(hunting): get_auth_request con 0x7f742c06e8f0 auth_method 0 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742a7fc640 10 monclient(hunting): get_auth_request con 0x7f742c15bbc0 auth_method 0 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:01.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.408+0000 7f742b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742b7fe640 10 monclient(hunting): handle_auth_done global_id 4854 payload 274 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742b7fe640 1 -- 10.20.193.10:0/302554757 >> v2:10.20.193.71:3300/0 conn(0x7f742c15bbc0 msgr2=0x7f742c0c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742b7fe640 1 --2- 10.20.193.10:0/302554757 >> v2:10.20.193.71:3300/0 conn(0x7f742c15bbc0 0x7f742c0c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742b7fe640 1 -- 10.20.193.10:0/302554757 >> v1:10.20.193.71:6789/0 conn(0x7f742c15b7e0 legacy=0x7f742c159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:01.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.409+0000 7f742b7fe640 1 -- 10.20.193.10:0/302554757 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c0c83e0 con 0x7f742c06e8f0 2026-02-17T11:59:01.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.410+0000 7f742b7fe640 1 --2- 10.20.193.10:0/302554757 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 0x7f742c06ed40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f742c0693e0 tx=0x7f741c030470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f87e3a166e9231 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:01.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 1 -- 10.20.193.10:0/302554757 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c03c070 con 0x7f742c06e8f0 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 10 monclient: dump: 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:01.422 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 1 -- 10.20.193.10:0/302554757 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741c008540 con 0x7f742c06e8f0 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 1 -- 10.20.193.10:0/302554757 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c008910 con 0x7f742c06e8f0 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 5 monclient: authenticate success, global_id 4854 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 4 set_mon_vals no callback set 2026-02-17T11:59:01.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f7429ffb640 10 monclient: dump: 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:01.424 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 10 monclient: shutdown 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 1 -- 10.20.193.10:0/302554757 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 msgr2=0x7f742c06ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 1 --2- 10.20.193.10:0/302554757 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 0x7f742c06ed40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f742c0693e0 tx=0x7f741c030470 comp rx=0 tx=0).stop 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 1 -- 10.20.193.10:0/302554757 shutdown_connections 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 1 --2- 10.20.193.10:0/302554757 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 0x7f742c06ed40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 1 --2- 10.20.193.10:0/302554757 >> v2:10.20.193.71:3300/0 conn(0x7f742c15bbc0 0x7f742c0c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 1 -- 10.20.193.10:0/302554757 >> 10.20.193.10:0/302554757 conn(0x7f742c0c9d80 msgr2=0x7f742c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 1 -- 10.20.193.10:0/302554757 shutdown_connections 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.412+0000 7f74313bc640 1 -- 10.20.193.10:0/302554757 wait complete. 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.413+0000 7f74313bc640 10 monclient: build_initial_monmap 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.413+0000 7f74313bc640 10 monclient: monmap: 2026-02-17T11:59:01.425 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.413+0000 7f74313bc640 1 librados: starting msgr at 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.413+0000 7f74313bc640 1 librados: starting objecter 2026-02-17T11:59:01.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.413+0000 7f74313bc640 1 Processor -- start 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.413+0000 7f74313bc640 1 -- start start 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.413+0000 7f74313bc640 1 librados: setting wanted keys 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.413+0000 7f74313bc640 1 librados: calling monclient init 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.413+0000 7f74313bc640 10 monclient: init 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 0x7f742c1f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient(hunting): picked mon.noname-a con 0x7f742c06e8f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f742c15b7e0 0x7f742c143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient(hunting): picked mon.noname-c con 0x7f742c15b7e0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f742c15bbc0 0x7f742c073960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient(hunting): picked mon.noname-b con 0x7f742c15bbc0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:01.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0c89a0 con 0x7f742c06e8f0 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0c92d0 con 0x7f742c15bbc0 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0c8c80 con 0x7f742c15b7e0 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f74313bc640 10 monclient(hunting): authenticate will time out at 1211.135251s 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 0x7f742c1f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742b7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f742c15bbc0 0x7f742c073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 0x7f742c1f6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:34324/0 (socket says 10.20.193.10:34324) 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 1 -- 10.20.193.10:0/3912190789 learned_addr learned my addr 10.20.193.10:0/3912190789 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:01.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 10 monclient(hunting): get_auth_request con 0x7f742c06e8f0 auth_method 0 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742b7fe640 10 monclient(hunting): get_auth_request con 0x7f742c15bbc0 auth_method 0 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.414+0000 7f742a7fc640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f742c15b7e0 0x7f742c143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:01.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742a7fc640 10 monclient(hunting): get_auth_request con 0x7f742c15b7e0 auth_method 0 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.415+0000 7f742a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 10 monclient(hunting): handle_auth_done global_id 4857 payload 824 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 1 -- 10.20.193.10:0/3912190789 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f742c15b7e0 msgr2=0x7f742c143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f742c15b7e0 0x7f742c143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 1 -- 10.20.193.10:0/3912190789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f742c15bbc0 msgr2=0x7f742c073960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f742c15bbc0 0x7f742c073960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:01.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 10 monclient: _finish_hunting 0 2026-02-17T11:59:01.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 1 monclient: found mon.noname-a 2026-02-17T11:59:01.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:01.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:01.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.416+0000 7f742affd640 1 -- 10.20.193.10:0/3912190789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c1f3ae0 con 0x7f742c06e8f0 2026-02-17T11:59:01.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.417+0000 7f742affd640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 0x7f742c1f6fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f742000c5b0 tx=0x7f742000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:01.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.417+0000 7f740b7fe640 10 client.?.objecter ms_handle_connect 0x7f742c06e8f0 2026-02-17T11:59:01.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.417+0000 7f740b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:01.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 1 -- 10.20.193.10:0/3912190789 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74200052d0 con 0x7f742c06e8f0 2026-02-17T11:59:01.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:01.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:01.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 10 monclient: dump: 2026-02-17T11:59:01.432 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:01.432 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:01.432 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:01.432 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:01.432 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:01.432 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:01.432 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:01.433 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:01.433 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:01.433 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:01.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:59:01.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:59:01.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:01.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 5 monclient: authenticate success, global_id 4857 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 10 monclient: _renew_subs 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c1f7520 con 0x7f742c06e8f0 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 10 client.4857.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 10 monclient: _renew_subs 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c1f7ad0 con 0x7f742c06e8f0 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 1 librados: init done 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c0c8f60 con 0x7f742c06e8f0 2026-02-17T11:59:01.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 1 -- 10.20.193.10:0/3912190789 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7420005470 con 0x7f742c06e8f0 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 1 -- 10.20.193.10:0/3912190789 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420002aa0 con 0x7f742c06e8f0 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f740b7fe640 10 monclient: dump: 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:01.435 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:01.436 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:01.436 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:01.436 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:01.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.418+0000 7f74297fa640 4 set_mon_vals no callback set 2026-02-17T11:59:01.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.526+0000 7f740b7fe640 1 -- 10.20.193.10:0/3912190789 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f74200038d0 con 0x7f742c06e8f0 2026-02-17T11:59:01.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.527+0000 7f740b7fe640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f73f8078e30 0x7f73f807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:01.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.527+0000 7f742a7fc640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f73f8078e30 0x7f73f807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:01.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.527+0000 7f742a7fc640 10 monclient: get_auth_request con 0x7f73f8078e30 auth_method 0 2026-02-17T11:59:01.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.527+0000 7f742a7fc640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f73f8078e30 0x7f73f807b2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f742c161c70 tx=0x7f7414009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:01.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.527+0000 7f740b7fe640 10 client.4857.objecter ms_handle_connect 0x7f73f8078e30 2026-02-17T11:59:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.535+0000 7f740b7fe640 1 -- 10.20.193.10:0/3912190789 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f742005e000 con 0x7f742c06e8f0 2026-02-17T11:59:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.535+0000 7f740b7fe640 10 client.4857.objecter ms_dispatch2 0x7f742c000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.535+0000 7f740b7fe640 3 client.4857.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.535+0000 7f740b7fe640 3 client.4857.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.535+0000 7f740b7fe640 20 client.4857.objecter dump_active .. 0 homeless 2026-02-17T11:59:01.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.535+0000 7f740b7fe640 1 -- 10.20.193.10:0/3912190789 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7420061fc0 con 0x7f742c06e8f0 2026-02-17T11:59:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.535+0000 7f740b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:01.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.535+0000 7f740b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:01.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.631+0000 7f74313bc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:01.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.631+0000 7f74313bc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:01.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.631+0000 7f74313bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:01.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.631+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f742c0ca650 con 0x7f742c06e8f0 2026-02-17T11:59:01.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.635+0000 7f740b7fe640 1 -- 10.20.193.10:0/3912190789 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f74200662c0 con 0x7f742c06e8f0 2026-02-17T11:59:01.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.635+0000 7f740b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:01.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.635+0000 7f740b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:01.636 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:01.636 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:01.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.635+0000 7f74313bc640 10 librados: watch_flush enter 2026-02-17T11:59:01.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 10 librados: watch_flush exit 2026-02-17T11:59:01.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 20 client.4857.objecter shutdown clearing up homeless session... 2026-02-17T11:59:01.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 10 client.4857.objecter successfully canceled tick 2026-02-17T11:59:01.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f73f8078e30 msgr2=0x7f73f807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:01.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f73f8078e30 0x7f73f807b2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f742c161c70 tx=0x7f7414009290 comp rx=0 tx=0).stop 2026-02-17T11:59:01.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 10 monclient: shutdown 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 msgr2=0x7f742c1f6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 0x7f742c1f6fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f742000c5b0 tx=0x7f742000ca80 comp rx=0 tx=0).stop 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 shutdown_connections 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f73f8078e30 0x7f73f807b2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f742c15bbc0 0x7f742c073960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f742c15b7e0 0x7f742c143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 --2- 10.20.193.10:0/3912190789 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f742c06e8f0 0x7f742c1f6fe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 >> 10.20.193.10:0/3912190789 conn(0x7f742c0c9d80 msgr2=0x7f742c0c7950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 shutdown_connections 2026-02-17T11:59:01.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 -- 10.20.193.10:0/3912190789 wait complete. 2026-02-17T11:59:01.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:01.636+0000 7f74313bc640 1 librados: shutdown 2026-02-17T11:59:04.646 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:04.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.713+0000 7f6d698aa640 10 monclient: get_monmap_and_config 2026-02-17T11:59:04.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.713+0000 7f6d698aa640 10 monclient: build_initial_monmap 2026-02-17T11:59:04.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.713+0000 7f6d698aa640 10 monclient: monmap: 2026-02-17T11:59:04.715 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:04.715 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:04.715 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:04.714328+0000 2026-02-17T11:59:04.715 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:04.714328+0000 2026-02-17T11:59:04.716 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:04.716 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:04.716 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:04.716 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:04.716 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:04.716 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:04.716 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:04.716 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:04.716 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:04.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.713+0000 7f6d698aa640 1 Processor -- start 2026-02-17T11:59:04.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.713+0000 7f6d698aa640 1 -- start start 2026-02-17T11:59:04.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.713+0000 7f6d698aa640 10 monclient: init 2026-02-17T11:59:04.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:04.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 10 monclient: _add_conns ranks=[0,5,1,3,2,4] 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6d64152400 addr v1:10.20.193.10:6789/0 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6d640cb9b0 0x7f6d6415c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 10 monclient(hunting): picked mon.noname-c con 0x7f6d640cb9b0 addr v2:10.20.193.153:3300/0 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6d64068480 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d64068f70 con 0x7f6d64152400 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d64069250 con 0x7f6d64068480 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6d640cac80 con 0x7f6d640cb9b0 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d698aa640 10 monclient(hunting): authenticate will time out at 1214.436140s 2026-02-17T11:59:04.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d688a8640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f6d64152400 0x7f6d6415cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:54208/0 (socket says 10.20.193.10:54208) 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d688a8640 1 -- 10.20.193.10:0/235960187 learned_addr learned my addr 10.20.193.10:0/235960187 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d5bfff640 1 --2- 10.20.193.10:0/235960187 >> v2:10.20.193.153:3300/0 conn(0x7f6d640cb9b0 0x7f6d6415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d5bfff640 10 monclient(hunting): get_auth_request con 0x7f6d640cb9b0 auth_method 0 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.714+0000 7f6d5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5b7fe640 1 -- 10.20.193.10:0/235960187 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3247759218 0 0) 0x7f6d64068f70 con 0x7f6d64152400 2026-02-17T11:59:04.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5b7fe640 10 monclient(hunting): _negotiate 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5b7fe640 10 monclient(hunting): my global_id is 4860 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5b7fe640 1 -- 10.20.193.10:0/235960187 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d50003620 con 0x7f6d64152400 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 10 monclient(hunting): handle_auth_done global_id 4925 payload 274 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 1 -- 10.20.193.10:0/235960187 >> v1:10.20.193.71:6789/0 conn(0x7f6d64068480 legacy=0x7f6d640c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 1 -- 10.20.193.10:0/235960187 >> v1:10.20.193.10:6789/0 conn(0x7f6d64152400 legacy=0x7f6d6415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 1 monclient: found mon.noname-c 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:59:04.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.715+0000 7f6d5bfff640 1 -- 10.20.193.10:0/235960187 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d640caed0 con 0x7f6d640cb9b0 2026-02-17T11:59:04.723 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.716+0000 7f6d5bfff640 1 --2- 10.20.193.10:0/235960187 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d640cb9b0 0x7f6d6415c510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0098a0 tx=0x7f6d4c02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214bce73ea8f6d56 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:04.729 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 1 -- 10.20.193.10:0/235960187 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c03c070 con 0x7f6d640cb9b0 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 10 monclient: dump: 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:04.730 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 1 -- 10.20.193.10:0/235960187 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4c02fb70 con 0x7f6d640cb9b0 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 1 -- 10.20.193.10:0/235960187 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c037440 con 0x7f6d640cb9b0 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 5 monclient: authenticate success, global_id 4925 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 4 set_mon_vals no callback set 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d5b7fe640 10 monclient: dump: 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:04.732 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 10 monclient: shutdown 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 1 -- 10.20.193.10:0/235960187 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d640cb9b0 msgr2=0x7f6d6415c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 1 --2- 10.20.193.10:0/235960187 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d640cb9b0 0x7f6d6415c510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0098a0 tx=0x7f6d4c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 1 -- 10.20.193.10:0/235960187 shutdown_connections 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 1 --2- 10.20.193.10:0/235960187 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d640cb9b0 0x7f6d6415c510 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 1 -- 10.20.193.10:0/235960187 >> 10.20.193.10:0/235960187 conn(0x7f6d64073f30 msgr2=0x7f6d64074340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.718+0000 7f6d698aa640 1 -- 10.20.193.10:0/235960187 shutdown_connections 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 1 -- 10.20.193.10:0/235960187 wait complete. 2026-02-17T11:59:04.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 10 monclient: build_initial_monmap 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 10 monclient: monmap: 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:04.734 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 1 librados: starting msgr at 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 1 librados: starting objecter 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 1 Processor -- start 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 1 -- start start 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 1 librados: setting wanted keys 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 1 librados: calling monclient init 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.719+0000 7f6d698aa640 10 monclient: init 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6d64068480 0x7f6d641f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient(hunting): picked mon.noname-b con 0x7f6d64068480 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6d640cb9b0 0x7f6d641f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient(hunting): picked mon.noname-a con 0x7f6d640cb9b0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d64152400 0x7f6d640c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient(hunting): picked mon.noname-c con 0x7f6d64152400 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f6d641527e0 con 0x7f6d640cb9b0 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d640cb490 con 0x7f6d64068480 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64152960 con 0x7f6d64152400 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d698aa640 10 monclient(hunting): authenticate will time out at 1214.442387s 2026-02-17T11:59:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d5bfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6d640cb9b0 0x7f6d641f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d688a8640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6d64068480 0x7f6d641f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d690a9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d64152400 0x7f6d640c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d5bfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6d640cb9b0 0x7f6d641f7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:52264/0 (socket says 10.20.193.10:52264) 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d5bfff640 1 -- 10.20.193.10:0/1314527681 learned_addr learned my addr 10.20.193.10:0/1314527681 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d5bfff640 10 monclient(hunting): get_auth_request con 0x7f6d640cb9b0 auth_method 0 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d690a9640 10 monclient(hunting): get_auth_request con 0x7f6d64152400 auth_method 0 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d690a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:04.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d690a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d690a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d688a8640 10 monclient(hunting): get_auth_request con 0x7f6d64068480 auth_method 0 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d688a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d688a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.720+0000 7f6d688a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.721+0000 7f6d690a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.721+0000 7f6d690a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.721+0000 7f6d690a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.721+0000 7f6d5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.721+0000 7f6d5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.721+0000 7f6d5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:04.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.721+0000 7f6d688a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.721+0000 7f6d688a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.721+0000 7f6d688a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 10 monclient(hunting): handle_auth_done global_id 4928 payload 824 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 1 -- 10.20.193.10:0/1314527681 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6d64068480 msgr2=0x7f6d641f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6d64068480 0x7f6d641f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 1 -- 10.20.193.10:0/1314527681 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6d640cb9b0 msgr2=0x7f6d641f7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6d640cb9b0 0x7f6d641f7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 10 monclient: _finish_hunting 0 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 1 monclient: found mon.noname-c 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:59:04.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.722+0000 7f6d690a9640 1 -- 10.20.193.10:0/1314527681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6414dce0 con 0x7f6d64152400 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.723+0000 7f6d690a9640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d64152400 0x7f6d640c3350 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000cb10 tx=0x7f6d6000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.723+0000 7f6d597fa640 10 client.?.objecter ms_handle_connect 0x7f6d64152400 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.723+0000 7f6d597fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 1 -- 10.20.193.10:0/1314527681 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000acb0 con 0x7f6d64152400 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 10 monclient: dump: 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:04.740 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 10 monclient: _finish_auth 0 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 10 monclient: _check_auth_tickets 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 5 monclient: authenticate success, global_id 4928 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 10 monclient: _renew_subs 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:04.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d640c2e20 con 0x7f6d64152400 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 10 client.4928.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 10 monclient: _renew_subs 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d640c22a0 con 0x7f6d64152400 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 1 librados: init done 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d64072f50 con 0x7f6d64152400 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 1 -- 10.20.193.10:0/1314527681 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6000ae50 con 0x7f6d64152400 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:04.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 1 -- 10.20.193.10:0/1314527681 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d600033b0 con 0x7f6d64152400 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d5affd640 4 set_mon_vals no callback set 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.724+0000 7f6d597fa640 10 monclient: dump: 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:04.743 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:04.744 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:04.744 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:04.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.831+0000 7f6d597fa640 1 -- 10.20.193.10:0/1314527681 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6d60003c70 con 0x7f6d64152400 2026-02-17T11:59:04.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.832+0000 7f6d597fa640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d34078e30 0x7f6d3407b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:04.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.832+0000 7f6d688a8640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d34078e30 0x7f6d3407b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:04.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.832+0000 7f6d688a8640 10 monclient: get_auth_request con 0x7f6d34078e30 auth_method 0 2026-02-17T11:59:04.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.832+0000 7f6d688a8640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d34078e30 0x7f6d3407b2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005980 tx=0x7f6d54007dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:04.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.832+0000 7f6d597fa640 10 client.4928.objecter ms_handle_connect 0x7f6d34078e30 2026-02-17T11:59:04.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.834+0000 7f6d597fa640 1 -- 10.20.193.10:0/1314527681 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f6d6005e600 con 0x7f6d64152400 2026-02-17T11:59:04.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.834+0000 7f6d597fa640 10 client.4928.objecter ms_dispatch2 0x7f6d64000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:04.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.834+0000 7f6d597fa640 3 client.4928.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:04.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.834+0000 7f6d597fa640 3 client.4928.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:04.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.834+0000 7f6d597fa640 20 client.4928.objecter dump_active .. 0 homeless 2026-02-17T11:59:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.840+0000 7f6d597fa640 1 -- 10.20.193.10:0/1314527681 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6d64072f50 con 0x7f6d64152400 2026-02-17T11:59:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.840+0000 7f6d597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:04.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.840+0000 7f6d597fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:04.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.939+0000 7f6d698aa640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:04.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.939+0000 7f6d698aa640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:04.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.939+0000 7f6d698aa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:04.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.939+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6d64074ba0 con 0x7f6d64152400 2026-02-17T11:59:04.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d597fa640 1 -- 10.20.193.10:0/1314527681 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f6d6414dce0 con 0x7f6d64152400 2026-02-17T11:59:04.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:04.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d597fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:04.944 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:04.944 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:04.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 10 librados: watch_flush enter 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 10 librados: watch_flush exit 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 20 client.4928.objecter shutdown clearing up homeless session... 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 10 client.4928.objecter successfully canceled tick 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d34078e30 msgr2=0x7f6d3407b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d34078e30 0x7f6d3407b2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005980 tx=0x7f6d54007dd0 comp rx=0 tx=0).stop 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 10 monclient: shutdown 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d64152400 msgr2=0x7f6d640c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.942+0000 7f6d698aa640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d64152400 0x7f6d640c3350 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000cb10 tx=0x7f6d6000a060 comp rx=0 tx=0).stop 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.943+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 shutdown_connections 2026-02-17T11:59:04.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.943+0000 7f6d698aa640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d34078e30 0x7f6d3407b2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:04.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.943+0000 7f6d698aa640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6d64152400 0x7f6d640c3350 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:04.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.943+0000 7f6d698aa640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6d640cb9b0 0x7f6d641f7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:04.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.943+0000 7f6d698aa640 1 --2- 10.20.193.10:0/1314527681 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6d64068480 0x7f6d641f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:04.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.943+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 >> 10.20.193.10:0/1314527681 conn(0x7f6d64073f30 msgr2=0x7f6d6415f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:04.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.943+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 shutdown_connections 2026-02-17T11:59:04.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.943+0000 7f6d698aa640 1 -- 10.20.193.10:0/1314527681 wait complete. 2026-02-17T11:59:04.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:04.943+0000 7f6d698aa640 1 librados: shutdown 2026-02-17T11:59:07.954 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:08.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.024+0000 7f5e8c83a640 10 monclient: get_monmap_and_config 2026-02-17T11:59:08.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.024+0000 7f5e8c83a640 10 monclient: build_initial_monmap 2026-02-17T11:59:08.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.024+0000 7f5e8c83a640 10 monclient: monmap: 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:08.025806+0000 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:08.025806+0000 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:08.027 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:08.028 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:08.028 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:08.030 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.024+0000 7f5e8c83a640 1 Processor -- start 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 1 -- start start 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient: init 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient: _add_conns ranks=[0,5,4,3,1,2] 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5e84152660 addr v1:10.20.193.10:6789/0 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5e8415b030 0x7f5e840c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient(hunting): picked mon.noname-c con 0x7f5e8415b030 addr v2:10.20.193.153:3300/0 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5e84152a40 0x7f5e840c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient(hunting): picked mon.noname-b con 0x7f5e84152a40 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e840c71e0 con 0x7f5e84152660 2026-02-17T11:59:08.031 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5e840c77a0 con 0x7f5e84152a40 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5e840c74c0 con 0x7f5e8415b030 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8c83a640 10 monclient(hunting): authenticate will time out at 1217.747522s 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8a5af640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f5e84152660 0x7f5e8415a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:54220/0 (socket says 10.20.193.10:54220) 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.025+0000 7f5e8a5af640 1 -- 10.20.193.10:0/2453834839 learned_addr learned my addr 10.20.193.10:0/2453834839 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e8adb0640 1 --2- 10.20.193.10:0/2453834839 >> v2:10.20.193.71:3300/0 conn(0x7f5e84152a40 0x7f5e840c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e89dae640 1 --2- 10.20.193.10:0/2453834839 >> v2:10.20.193.153:3300/0 conn(0x7f5e8415b030 0x7f5e840c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e8adb0640 10 monclient(hunting): get_auth_request con 0x7f5e84152a40 auth_method 0 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e8adb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:08.032 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e8adb0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e8adb0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e89dae640 10 monclient(hunting): get_auth_request con 0x7f5e8415b030 auth_method 0 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e89dae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e89dae640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e89dae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e8adb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e8adb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e8adb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e89dae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e89dae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.026+0000 7f5e89dae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.027+0000 7f5e8adb0640 10 monclient(hunting): handle_auth_done global_id 4888 payload 274 2026-02-17T11:59:08.033 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.027+0000 7f5e8adb0640 1 -- 10.20.193.10:0/2453834839 >> v2:10.20.193.153:3300/0 conn(0x7f5e8415b030 msgr2=0x7f5e840c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:08.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.027+0000 7f5e8adb0640 1 --2- 10.20.193.10:0/2453834839 >> v2:10.20.193.153:3300/0 conn(0x7f5e8415b030 0x7f5e840c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.027+0000 7f5e8adb0640 1 -- 10.20.193.10:0/2453834839 >> v1:10.20.193.10:6789/0 conn(0x7f5e84152660 legacy=0x7f5e8415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:08.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.027+0000 7f5e8adb0640 10 monclient: _finish_hunting 0 2026-02-17T11:59:08.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.027+0000 7f5e8adb0640 1 monclient: found mon.noname-b 2026-02-17T11:59:08.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.027+0000 7f5e8adb0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:08.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.027+0000 7f5e8adb0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:08.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.027+0000 7f5e8adb0640 1 -- 10.20.193.10:0/2453834839 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e84159e40 con 0x7f5e84152a40 2026-02-17T11:59:08.034 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.028+0000 7f5e8adb0640 1 --2- 10.20.193.10:0/2453834839 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e84152a40 0x7f5e840c9310 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5e841563f0 tx=0x7f5e7802f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c311e40c8af66f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:08.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 1 -- 10.20.193.10:0/2453834839 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7803c070 con 0x7f5e84152a40 2026-02-17T11:59:08.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:08.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 10 monclient: dump: 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:08.041 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 10 monclient: _finish_auth 0 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 10 monclient: _check_auth_tickets 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 1 -- 10.20.193.10:0/2453834839 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e78037440 con 0x7f5e84152a40 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 5 monclient: authenticate success, global_id 4888 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 1 -- 10.20.193.10:0/2453834839 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78037810 con 0x7f5e84152a40 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 4 set_mon_vals no callback set 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:08.042 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e895ad640 10 monclient: dump: 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 10 monclient: shutdown 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:08.043 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2453834839 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e84152a40 msgr2=0x7f5e840c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 1 --2- 10.20.193.10:0/2453834839 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e84152a40 0x7f5e840c9310 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5e841563f0 tx=0x7f5e7802f1c0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2453834839 shutdown_connections 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 1 --2- 10.20.193.10:0/2453834839 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e84152a40 0x7f5e840c9310 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 1 --2- 10.20.193.10:0/2453834839 >> v2:10.20.193.153:3300/0 conn(0x7f5e8415b030 0x7f5e840c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2453834839 >> 10.20.193.10:0/2453834839 conn(0x7f5e840c9d80 msgr2=0x7f5e840ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2453834839 shutdown_connections 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.030+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2453834839 wait complete. 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.031+0000 7f5e8c83a640 10 monclient: build_initial_monmap 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.031+0000 7f5e8c83a640 10 monclient: monmap: 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:08.044 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.031+0000 7f5e8c83a640 1 librados: starting msgr at 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.031+0000 7f5e8c83a640 1 librados: starting objecter 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.031+0000 7f5e8c83a640 1 Processor -- start 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.031+0000 7f5e8c83a640 1 -- start start 2026-02-17T11:59:08.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.031+0000 7f5e8c83a640 1 librados: setting wanted keys 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.031+0000 7f5e8c83a640 1 librados: calling monclient init 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.031+0000 7f5e8c83a640 10 monclient: init 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5e84152660 0x7f5e841f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient(hunting): picked mon.noname-a con 0x7f5e84152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5e84152a40 0x7f5e8406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient(hunting): picked mon.noname-c con 0x7f5e84152a40 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e8415b030 0x7f5e841f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient(hunting): picked mon.noname-b con 0x7f5e8415b030 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840c5cd0 con 0x7f5e84152660 2026-02-17T11:59:08.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8415a400 con 0x7f5e8415b030 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840c5e50 con 0x7f5e84152a40 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8c83a640 10 monclient(hunting): authenticate will time out at 1217.754162s 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5e84152660 0x7f5e841f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8adb0640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e8415b030 0x7f5e841f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e89dae640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5e84152a40 0x7f5e8406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5e84152660 0x7f5e841f4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:52280/0 (socket says 10.20.193.10:52280) 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 1 -- 10.20.193.10:0/2295077247 learned_addr learned my addr 10.20.193.10:0/2295077247 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:08.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 10 monclient(hunting): get_auth_request con 0x7f5e84152660 auth_method 0 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8adb0640 10 monclient(hunting): get_auth_request con 0x7f5e8415b030 auth_method 0 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8adb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8adb0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8adb0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e89dae640 10 monclient(hunting): get_auth_request con 0x7f5e84152a40 auth_method 0 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e89dae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e89dae640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e89dae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8adb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:08.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8adb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8adb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.032+0000 7f5e8a5af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.033+0000 7f5e89dae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.033+0000 7f5e89dae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.033+0000 7f5e89dae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 10 monclient(hunting): handle_auth_done global_id 4891 payload 824 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 1 -- 10.20.193.10:0/2295077247 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5e84152a40 msgr2=0x7f5e8406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5e84152a40 0x7f5e8406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 1 -- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5e84152660 msgr2=0x7f5e841f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5e84152660 0x7f5e841f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 10 monclient: _finish_hunting 0 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 1 monclient: found mon.noname-b 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8adb0640 1 -- 10.20.193.10:0/2295077247 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e841f5ae0 con 0x7f5e8415b030 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.034+0000 7f5e8a5af640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5e84152660 0x7f5e841f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.035+0000 7f5e8adb0640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e8415b030 0x7f5e841f17f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e78036000 tx=0x7f5e78004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.035+0000 7f5e6effd640 10 client.?.objecter ms_handle_connect 0x7f5e8415b030 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.035+0000 7f5e6effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 1 -- 10.20.193.10:0/2295077247 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7803c050 con 0x7f5e8415b030 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:08.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 10 monclient: dump: 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 10 monclient: _finish_auth 0 2026-02-17T11:59:08.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 1 -- 10.20.193.10:0/2295077247 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e78048070 con 0x7f5e8415b030 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 5 monclient: authenticate success, global_id 4891 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 10 monclient: _renew_subs 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e841f5dc0 con 0x7f5e8415b030 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 1 -- 10.20.193.10:0/2295077247 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78041a70 con 0x7f5e8415b030 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e88dac640 4 set_mon_vals no callback set 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e6effd640 10 monclient: dump: 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:08.052 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 10 client.4891.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:08.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 10 monclient: _renew_subs 2026-02-17T11:59:08.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:08.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e841f6380 con 0x7f5e8415b030 2026-02-17T11:59:08.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 1 librados: init done 2026-02-17T11:59:08.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:08.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:08.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:08.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.037+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e841f4760 con 0x7f5e8415b030 2026-02-17T11:59:08.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.049+0000 7f5e6effd640 1 -- 10.20.193.10:0/2295077247 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5e78041c10 con 0x7f5e8415b030 2026-02-17T11:59:08.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.050+0000 7f5e6effd640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5e54078e80 0x7f5e5407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:08.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.050+0000 7f5e8a5af640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5e54078e80 0x7f5e5407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:08.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.050+0000 7f5e8a5af640 10 monclient: get_auth_request con 0x7f5e54078e80 auth_method 0 2026-02-17T11:59:08.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.050+0000 7f5e6effd640 10 client.4891.objecter ms_handle_connect 0x7f5e54078e80 2026-02-17T11:59:08.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.050+0000 7f5e8a5af640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5e54078e80 0x7f5e5407b340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e84156210 tx=0x7f5e7c0029b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:08.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.052+0000 7f5e6effd640 1 -- 10.20.193.10:0/2295077247 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5e780843e0 con 0x7f5e8415b030 2026-02-17T11:59:08.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.052+0000 7f5e6effd640 10 client.4891.objecter ms_dispatch2 0x7f5e84000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:08.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.052+0000 7f5e6effd640 3 client.4891.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:08.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.052+0000 7f5e6effd640 3 client.4891.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:08.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.052+0000 7f5e6effd640 20 client.4891.objecter dump_active .. 0 homeless 2026-02-17T11:59:08.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.153+0000 7f5e6effd640 1 -- 10.20.193.10:0/2295077247 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5e841f4760 con 0x7f5e8415b030 2026-02-17T11:59:08.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.153+0000 7f5e6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:08.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.153+0000 7f5e6effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.252+0000 7f5e8c83a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.252+0000 7f5e8c83a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.252+0000 7f5e8c83a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.252+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5e84156240 con 0x7f5e8415b030 2026-02-17T11:59:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.255+0000 7f5e6effd640 1 -- 10.20.193.10:0/2295077247 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f5e780883a0 con 0x7f5e8415b030 2026-02-17T11:59:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.255+0000 7f5e6effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.255+0000 7f5e6effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:08.258 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:08.259 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:08.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 10 librados: watch_flush enter 2026-02-17T11:59:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 10 librados: watch_flush exit 2026-02-17T11:59:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 20 client.4891.objecter shutdown clearing up homeless session... 2026-02-17T11:59:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 10 client.4891.objecter successfully canceled tick 2026-02-17T11:59:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5e54078e80 msgr2=0x7f5e5407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5e54078e80 0x7f5e5407b340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e84156210 tx=0x7f5e7c0029b0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 10 monclient: shutdown 2026-02-17T11:59:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e8415b030 msgr2=0x7f5e841f17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e8415b030 0x7f5e841f17f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e78036000 tx=0x7f5e78004b40 comp rx=0 tx=0).stop 2026-02-17T11:59:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 shutdown_connections 2026-02-17T11:59:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5e54078e80 0x7f5e5407b340 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5e8415b030 0x7f5e841f17f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5e84152a40 0x7f5e8406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 --2- 10.20.193.10:0/2295077247 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5e84152660 0x7f5e841f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 >> 10.20.193.10:0/2295077247 conn(0x7f5e840c9d80 msgr2=0x7f5e840ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 shutdown_connections 2026-02-17T11:59:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 -- 10.20.193.10:0/2295077247 wait complete. 2026-02-17T11:59:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:08.257+0000 7f5e8c83a640 1 librados: shutdown 2026-02-17T11:59:11.269 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:11.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.337+0000 7fc4d93f5640 10 monclient: get_monmap_and_config 2026-02-17T11:59:11.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.337+0000 7fc4d93f5640 10 monclient: build_initial_monmap 2026-02-17T11:59:11.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.337+0000 7fc4d93f5640 10 monclient: monmap: 2026-02-17T11:59:11.340 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:11.340 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:11.340 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:11.339155+0000 2026-02-17T11:59:11.340 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:11.339155+0000 2026-02-17T11:59:11.340 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:11.340 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:11.340 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:11.341 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:11.341 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:11.341 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:11.341 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:11.341 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:11.341 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:11.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 1 Processor -- start 2026-02-17T11:59:11.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 1 -- start start 2026-02-17T11:59:11.344 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 10 monclient: init 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 10 monclient: _add_conns ranks=[5,4,0,1,2,3] 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc4d415d220 0x7fc4d415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 10 monclient(hunting): picked mon.noname-c con 0x7fc4d415d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fc4d4074920 0x7fc4d40c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 10 monclient(hunting): picked mon.noname-b con 0x7fc4d4074920 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.338+0000 7fc4d93f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc4d40c9120 addr v1:10.20.193.10:6789/0 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d93f5640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40c95b0 con 0x7fc4d40c9120 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d93f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d93f5640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40c58a0 con 0x7fc4d4074920 2026-02-17T11:59:11.345 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d93f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d93f5640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40c55c0 con 0x7fc4d415d220 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d93f5640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d93f5640 10 monclient(hunting): authenticate will time out at 1221.061017s 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d37fe640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fc4d40c9120 0x7fc4d4153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:54222/0 (socket says 10.20.193.10:54222) 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d37fe640 1 -- 10.20.193.10:0/1512077872 learned_addr learned my addr 10.20.193.10:0/1512077872 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d27fc640 1 --2- 10.20.193.10:0/1512077872 >> v2:10.20.193.71:3300/0 conn(0x7fc4d4074920 0x7fc4d40c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d2ffd640 1 --2- 10.20.193.10:0/1512077872 >> v2:10.20.193.153:3300/0 conn(0x7fc4d415d220 0x7fc4d415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d27fc640 10 monclient(hunting): get_auth_request con 0x7fc4d4074920 auth_method 0 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:11.346 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d2ffd640 10 monclient(hunting): get_auth_request con 0x7fc4d415d220 auth_method 0 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.339+0000 7fc4d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d1ffb640 1 -- 10.20.193.10:0/1512077872 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672145776 0 0) 0x7fc4d40c95b0 con 0x7fc4d40c9120 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d1ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:11.347 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d1ffb640 10 monclient(hunting): my global_id is 4872 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.340+0000 7fc4d1ffb640 1 -- 10.20.193.10:0/1512077872 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4c0003620 con 0x7fc4d40c9120 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.341+0000 7fc4d27fc640 10 monclient(hunting): handle_auth_done global_id 4894 payload 274 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.341+0000 7fc4d27fc640 1 -- 10.20.193.10:0/1512077872 >> v2:10.20.193.153:3300/0 conn(0x7fc4d415d220 msgr2=0x7fc4d415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.341+0000 7fc4d27fc640 1 --2- 10.20.193.10:0/1512077872 >> v2:10.20.193.153:3300/0 conn(0x7fc4d415d220 0x7fc4d415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.341+0000 7fc4d27fc640 1 -- 10.20.193.10:0/1512077872 >> v1:10.20.193.10:6789/0 conn(0x7fc4d40c9120 legacy=0x7fc4d4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.341+0000 7fc4d27fc640 10 monclient: _finish_hunting 0 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.341+0000 7fc4d27fc640 1 monclient: found mon.noname-b 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.341+0000 7fc4d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.341+0000 7fc4d27fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.341+0000 7fc4d27fc640 1 -- 10.20.193.10:0/1512077872 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40c7e20 con 0x7fc4d4074920 2026-02-17T11:59:11.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.342+0000 7fc4d27fc640 1 --2- 10.20.193.10:0/1512077872 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 0x7fc4d40c8be0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0098a0 tx=0x7fc4bc02ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8875220d624b17eb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:11.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 1 -- 10.20.193.10:0/1512077872 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc03c070 con 0x7fc4d4074920 2026-02-17T11:59:11.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:11.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:11.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 10 monclient: dump: 2026-02-17T11:59:11.355 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:11.355 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:11.355 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:11.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 1 -- 10.20.193.10:0/1512077872 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc02fae0 con 0x7fc4d4074920 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 1 -- 10.20.193.10:0/1512077872 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc037440 con 0x7fc4d4074920 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 5 monclient: authenticate success, global_id 4894 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 4 set_mon_vals no callback set 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d1ffb640 10 monclient: dump: 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:11.357 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 10 monclient: shutdown 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 1 -- 10.20.193.10:0/1512077872 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 msgr2=0x7fc4d40c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:11.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 1 --2- 10.20.193.10:0/1512077872 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 0x7fc4d40c8be0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0098a0 tx=0x7fc4bc02ee10 comp rx=0 tx=0).stop 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 1 -- 10.20.193.10:0/1512077872 shutdown_connections 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 1 --2- 10.20.193.10:0/1512077872 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 0x7fc4d40c8be0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 1 --2- 10.20.193.10:0/1512077872 >> v2:10.20.193.153:3300/0 conn(0x7fc4d415d220 0x7fc4d415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 1 -- 10.20.193.10:0/1512077872 >> 10.20.193.10:0/1512077872 conn(0x7fc4d40c9d80 msgr2=0x7fc4d40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 1 -- 10.20.193.10:0/1512077872 shutdown_connections 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.344+0000 7fc4d93f5640 1 -- 10.20.193.10:0/1512077872 wait complete. 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient: build_initial_monmap 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient: monmap: 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:11.359 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 librados: starting msgr at 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 librados: starting objecter 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 Processor -- start 2026-02-17T11:59:11.360 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 -- start start 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 librados: setting wanted keys 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 librados: calling monclient init 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient: init 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 0x7fc4d41f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient(hunting): picked mon.noname-b con 0x7fc4d4074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc4d40c9120 0x7fc4d41559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient(hunting): picked mon.noname-a con 0x7fc4d40c9120 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4d415d220 0x7fc4d4145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient(hunting): picked mon.noname-c con 0x7fc4d415d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:11.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40c86c0 con 0x7fc4d40c9120 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40c83e0 con 0x7fc4d4074920 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d4074d70 con 0x7fc4d415d220 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.345+0000 7fc4d93f5640 10 monclient(hunting): authenticate will time out at 1221.067748s 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 0x7fc4d41f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d27fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc4d40c9120 0x7fc4d41559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 0x7fc4d41f4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:33664/0 (socket says 10.20.193.10:33664) 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 1 -- 10.20.193.10:0/788777092 learned_addr learned my addr 10.20.193.10:0/788777092 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 10 monclient(hunting): get_auth_request con 0x7fc4d4074920 auth_method 0 2026-02-17T11:59:11.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d27fc640 10 monclient(hunting): get_auth_request con 0x7fc4d40c9120 auth_method 0 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d37fe640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4d415d220 0x7fc4d4145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:11.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d37fe640 10 monclient(hunting): get_auth_request con 0x7fc4d415d220 auth_method 0 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.346+0000 7fc4d37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 10 monclient(hunting): handle_auth_done global_id 4897 payload 824 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 1 -- 10.20.193.10:0/788777092 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4d415d220 msgr2=0x7fc4d4145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4d415d220 0x7fc4d4145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 1 -- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc4d40c9120 msgr2=0x7fc4d41559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:11.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc4d40c9120 0x7fc4d41559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 1 monclient: found mon.noname-b 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d2ffd640 1 -- 10.20.193.10:0/788777092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d4154630 con 0x7fc4d4074920 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.347+0000 7fc4d27fc640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc4d40c9120 0x7fc4d41559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.348+0000 7fc4d2ffd640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 0x7fc4d41f4fc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800e890 tx=0x7fc4c800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.348+0000 7fc4b37fe640 10 client.?.objecter ms_handle_connect 0x7fc4d4074920 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.349+0000 7fc4b37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 1 -- 10.20.193.10:0/788777092 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8017070 con 0x7fc4d4074920 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:11.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 10 monclient: dump: 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 10 monclient: _finish_auth 0 2026-02-17T11:59:11.366 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 1 -- 10.20.193.10:0/788777092 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c800c940 con 0x7fc4d4074920 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 1 -- 10.20.193.10:0/788777092 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800cd30 con 0x7fc4d4074920 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4b37fe640 10 monclient: dump: 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:11.367 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d17fa640 4 set_mon_vals no callback set 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d93f5640 5 monclient: authenticate success, global_id 4897 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d93f5640 10 monclient: _renew_subs 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d93f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d4154910 con 0x7fc4d4074920 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d93f5640 10 client.4897.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d93f5640 10 monclient: _renew_subs 2026-02-17T11:59:11.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d93f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:11.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d4154ed0 con 0x7fc4d4074920 2026-02-17T11:59:11.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.350+0000 7fc4d93f5640 1 librados: init done 2026-02-17T11:59:11.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.351+0000 7fc4d93f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:11.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.351+0000 7fc4d93f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:11.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.351+0000 7fc4d93f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:11.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.351+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d414e3c0 con 0x7fc4d4074920 2026-02-17T11:59:11.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.362+0000 7fc4b37fe640 1 -- 10.20.193.10:0/788777092 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc4c8013470 con 0x7fc4d4074920 2026-02-17T11:59:11.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.363+0000 7fc4b37fe640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc4a0078e00 0x7fc4a007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:11.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.363+0000 7fc4d27fc640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc4a0078e00 0x7fc4a007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:11.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.363+0000 7fc4d27fc640 10 monclient: get_auth_request con 0x7fc4a0078e00 auth_method 0 2026-02-17T11:59:11.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.363+0000 7fc4d27fc640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc4a0078e00 0x7fc4a007b2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc039000 tx=0x7fc4bc033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:11.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.363+0000 7fc4b37fe640 10 client.4897.objecter ms_handle_connect 0x7fc4a0078e00 2026-02-17T11:59:11.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.443+0000 7fc4b37fe640 1 -- 10.20.193.10:0/788777092 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc4c805e3d0 con 0x7fc4d4074920 2026-02-17T11:59:11.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.443+0000 7fc4b37fe640 10 client.4897.objecter ms_dispatch2 0x7fc4d4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:11.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.443+0000 7fc4b37fe640 3 client.4897.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:11.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.443+0000 7fc4b37fe640 3 client.4897.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:11.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.443+0000 7fc4b37fe640 20 client.4897.objecter dump_active .. 0 homeless 2026-02-17T11:59:11.471 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.470+0000 7fc4b37fe640 1 -- 10.20.193.10:0/788777092 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc4d414e3c0 con 0x7fc4d4074920 2026-02-17T11:59:11.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.470+0000 7fc4b37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:11.472 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.470+0000 7fc4b37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:11.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.568+0000 7fc4d93f5640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:11.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.568+0000 7fc4d93f5640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:11.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.568+0000 7fc4d93f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:11.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.568+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc4d40c8be0 con 0x7fc4d4074920 2026-02-17T11:59:11.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.572+0000 7fc4b37fe640 1 -- 10.20.193.10:0/788777092 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fc4c8062390 con 0x7fc4d4074920 2026-02-17T11:59:11.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.572+0000 7fc4b37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:11.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.572+0000 7fc4b37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:11.575 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:11.575 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:11.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 10 librados: watch_flush enter 2026-02-17T11:59:11.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 10 librados: watch_flush exit 2026-02-17T11:59:11.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 20 client.4897.objecter shutdown clearing up homeless session... 2026-02-17T11:59:11.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 10 client.4897.objecter successfully canceled tick 2026-02-17T11:59:11.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc4a0078e00 msgr2=0x7fc4a007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:11.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc4a0078e00 0x7fc4a007b2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc039000 tx=0x7fc4bc033000 comp rx=0 tx=0).stop 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 10 monclient: shutdown 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 msgr2=0x7fc4d41f4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 0x7fc4d41f4fc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800e890 tx=0x7fc4c800ed60 comp rx=0 tx=0).stop 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 shutdown_connections 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc4a0078e00 0x7fc4a007b2c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4d415d220 0x7fc4d4145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc4d40c9120 0x7fc4d41559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 --2- 10.20.193.10:0/788777092 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc4d4074920 0x7fc4d41f4fc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 >> 10.20.193.10:0/788777092 conn(0x7fc4d40c9d80 msgr2=0x7fc4d414db60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 shutdown_connections 2026-02-17T11:59:11.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 -- 10.20.193.10:0/788777092 wait complete. 2026-02-17T11:59:11.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:11.573+0000 7fc4d93f5640 1 librados: shutdown 2026-02-17T11:59:14.585 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:14.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.653+0000 7f5bede98640 10 monclient: get_monmap_and_config 2026-02-17T11:59:14.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.653+0000 7f5bede98640 10 monclient: build_initial_monmap 2026-02-17T11:59:14.655 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.653+0000 7f5bede98640 10 monclient: monmap: 2026-02-17T11:59:14.655 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:14.655 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:14.655 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:14.654431+0000 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:14.654431+0000 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:14.656 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.653+0000 7f5bede98640 1 Processor -- start 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.653+0000 7f5bede98640 1 -- start start 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.653+0000 7f5bede98640 10 monclient: init 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 10 monclient: _add_conns ranks=[1,0,2,4,3,5] 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5be815d220 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5be80c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5be8153d60 addr v1:10.20.193.153:6789/0 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be80c58a0 con 0x7f5be80c92f0 2026-02-17T11:59:14.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be80c55c0 con 0x7f5be815d220 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be80c7e20 con 0x7f5be8153d60 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5bede98640 10 monclient(hunting): authenticate will time out at 1224.376262s 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5be6ffd640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f5be80c92f0 0x7f5be8153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:41798/0 (socket says 10.20.193.10:41798) 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.654+0000 7f5be6ffd640 1 -- 10.20.193.10:0/2449278318 learned_addr learned my addr 10.20.193.10:0/2449278318 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1457102447 0 0) 0x7f5be80c58a0 con 0x7f5be80c92f0 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 10 monclient(hunting): _negotiate 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 10 monclient(hunting): my global_id is 4878 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bcc003620 con 0x7f5be80c92f0 2026-02-17T11:59:14.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2426639041 0 0) 0x7f5be80c55c0 con 0x7f5be815d220 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 10 monclient(hunting): _negotiate 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 10 monclient(hunting): my global_id is 4900 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.655+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5be80c58a0 con 0x7f5be815d220 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.656+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244679817 0 0) 0x7f5be80c7e20 con 0x7f5be8153d60 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.656+0000 7f5be67fc640 10 monclient(hunting): _negotiate 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.656+0000 7f5be67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.656+0000 7f5be67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.656+0000 7f5be67fc640 10 monclient(hunting): my global_id is 4943 2026-02-17T11:59:14.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.656+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5be80c55c0 con 0x7f5be8153d60 2026-02-17T11:59:14.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2487197761 0 0) 0x7f5be80c58a0 con 0x7f5be815d220 2026-02-17T11:59:14.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 >> v1:10.20.193.153:6789/0 conn(0x7f5be8153d60 legacy=0x7f5be80c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:14.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 >> v1:10.20.193.10:6789/0 conn(0x7f5be80c92f0 legacy=0x7f5be8153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be80c8100 con 0x7f5be815d220 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f5bd4002ee0 con 0x7f5be815d220 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:59:14.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient: dump: 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T11:59:14.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 >> v1:10.20.193.71:6789/0 conn(0x7f5be815d220 legacy=0x7f5be80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5bcc003f40 0x7f5bcc004320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient(hunting): picked mon.c con 0x7f5bcc003f40 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5bcc004a10 0x7f5bcc004e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient(hunting): picked mon.a con 0x7f5bcc004a10 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5bcc009ab0 0x7f5bcc00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient(hunting): picked mon.b con 0x7f5bcc009ab0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc00c490 con 0x7f5bcc004a10 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:14.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc00c640 con 0x7f5bcc009ab0 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc00c840 con 0x7f5bcc003f40 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.657+0000 7f5be67fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be77fe640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5bcc003f40 0x7f5bcc004320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be6ffd640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5bcc004a10 0x7f5bcc004e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be77fe640 10 monclient(hunting): get_auth_request con 0x7f5bcc003f40 auth_method 0 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:14.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be6ffd640 10 monclient(hunting): get_auth_request con 0x7f5bcc004a10 auth_method 0 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be7fff640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5bcc009ab0 0x7f5bcc00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:14.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.658+0000 7f5be77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be7fff640 10 monclient(hunting): get_auth_request con 0x7f5bcc009ab0 auth_method 0 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 10 monclient(hunting): handle_auth_done global_id 4900 payload 293 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 1 -- 10.20.193.10:0/2449278318 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5bcc003f40 msgr2=0x7f5bcc004320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5bcc003f40 0x7f5bcc004320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 1 -- 10.20.193.10:0/2449278318 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5bcc009ab0 msgr2=0x7f5bcc00bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5bcc009ab0 0x7f5bcc00bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 1 monclient: found mon.a 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 1 -- 10.20.193.10:0/2449278318 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be80c58a0 con 0x7f5bcc004a10 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be7fff640 1 -- 10.20.193.10:0/2449278318 reap_dead start 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5be6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5bede98640 5 monclient: authenticate success, global_id 4900 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.659+0000 7f5bede98640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:14.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.660+0000 7f5be6ffd640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5bcc004a10 0x7f5bcc004e90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8007fd0 tx=0x7f5bd802f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab638eab7d0883c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8007e30 con 0x7f5bcc004a10 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 10 monclient: dump: 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:14.680 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd8004ba0 con 0x7f5bcc004a10 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 1 -- 10.20.193.10:0/2449278318 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80070d0 con 0x7f5bcc004a10 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 4 set_mon_vals no callback set 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5be67fc640 10 monclient: dump: 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:14.681 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 10 monclient: shutdown 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 1 -- 10.20.193.10:0/2449278318 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5bcc004a10 msgr2=0x7f5bcc004e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:14.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5bcc004a10 0x7f5bcc004e90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8007fd0 tx=0x7f5bd802f5e0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 1 -- 10.20.193.10:0/2449278318 shutdown_connections 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 1 --2- 10.20.193.10:0/2449278318 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5bcc004a10 0x7f5bcc004e90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 1 -- 10.20.193.10:0/2449278318 >> 10.20.193.10:0/2449278318 conn(0x7f5be80c9d80 msgr2=0x7f5be80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 1 -- 10.20.193.10:0/2449278318 shutdown_connections 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.662+0000 7f5bede98640 1 -- 10.20.193.10:0/2449278318 wait complete. 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.663+0000 7f5bede98640 10 monclient: build_initial_monmap 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.663+0000 7f5bede98640 10 monclient: monmap: 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:14.683 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.663+0000 7f5bede98640 1 librados: starting msgr at 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.663+0000 7f5bede98640 1 librados: starting objecter 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.663+0000 7f5bede98640 1 Processor -- start 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.663+0000 7f5bede98640 1 -- start start 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.663+0000 7f5bede98640 1 librados: setting wanted keys 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.663+0000 7f5bede98640 1 librados: calling monclient init 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.663+0000 7f5bede98640 10 monclient: init 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:14.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5bcc004a10 0x7f5be81f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient(hunting): picked mon.noname-c con 0x7f5bcc004a10 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5be8145940 0x7f5be8073430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient(hunting): picked mon.noname-b con 0x7f5be8145940 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5be8073970 0x7f5be8148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient(hunting): picked mon.noname-a con 0x7f5be8073970 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5be815d600 con 0x7f5be8073970 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5be80c86c0 con 0x7f5be8145940 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:14.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5be815d780 con 0x7f5bcc004a10 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5bede98640 10 monclient(hunting): authenticate will time out at 1224.386124s 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5be8073970 0x7f5be8148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be77fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5bcc004a10 0x7f5be81f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be6ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5be8145940 0x7f5be8073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5be8073970 0x7f5be8148aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:47734/0 (socket says 10.20.193.10:47734) 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 1 -- 10.20.193.10:0/2852849988 learned_addr learned my addr 10.20.193.10:0/2852849988 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 10 monclient(hunting): get_auth_request con 0x7f5be8073970 auth_method 0 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:14.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be77fe640 10 monclient(hunting): get_auth_request con 0x7f5bcc004a10 auth_method 0 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be6ffd640 10 monclient(hunting): get_auth_request con 0x7f5be8145940 auth_method 0 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:14.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.664+0000 7f5be77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.665+0000 7f5be6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.665+0000 7f5be6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.665+0000 7f5be6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 10 monclient(hunting): handle_auth_done global_id 4881 payload 824 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 1 -- 10.20.193.10:0/2852849988 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5bcc004a10 msgr2=0x7f5be81f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5bcc004a10 0x7f5be81f4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 1 -- 10.20.193.10:0/2852849988 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5be8145940 msgr2=0x7f5be8073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5be8145940 0x7f5be8073430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 1 monclient: found mon.noname-a 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:14.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 1 -- 10.20.193.10:0/2852849988 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be815bc00 con 0x7f5be8073970 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5be7fff640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5be8073970 0x7f5be8148aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc004fd0 tx=0x7f5bdc00f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5bc3fff640 10 client.?.objecter ms_handle_connect 0x7f5be8073970 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.666+0000 7f5bc3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bc3fff640 1 -- 10.20.193.10:0/2852849988 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc019070 con 0x7f5be8073970 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bc3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bc3fff640 10 monclient: dump: 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:14.689 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bc3fff640 10 monclient: _finish_auth 0 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bc3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bc3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bede98640 5 monclient: authenticate success, global_id 4881 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bede98640 10 monclient: _renew_subs 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bede98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be8072670 con 0x7f5be8073970 2026-02-17T11:59:14.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bede98640 10 client.4881.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bede98640 10 monclient: _renew_subs 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bede98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be8072c30 con 0x7f5be8073970 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.667+0000 7f5bede98640 1 librados: init done 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bede98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bede98640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bede98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be8069900 con 0x7f5be8073970 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bc3fff640 1 -- 10.20.193.10:0/2852849988 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00fb60 con 0x7f5be8073970 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bc3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bc3fff640 1 -- 10.20.193.10:0/2852849988 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc004030 con 0x7f5be8073970 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:14.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bc3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5bc3fff640 10 monclient: dump: 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:14.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.668+0000 7f5be5ffb640 4 set_mon_vals no callback set 2026-02-17T11:59:14.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.774+0000 7f5bc3fff640 1 -- 10.20.193.10:0/2852849988 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5bdc0041d0 con 0x7f5be8073970 2026-02-17T11:59:14.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.774+0000 7f5bc3fff640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5bb8078e00 0x7f5bb807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:14.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.774+0000 7f5be77fe640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5bb8078e00 0x7f5bb807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:14.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.774+0000 7f5be77fe640 10 monclient: get_auth_request con 0x7f5bb8078e00 auth_method 0 2026-02-17T11:59:14.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.775+0000 7f5bc3fff640 10 client.4881.objecter ms_handle_connect 0x7f5bb8078e00 2026-02-17T11:59:14.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.775+0000 7f5be77fe640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5bb8078e00 0x7f5bb807b2c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40028f0 tx=0x7f5bd40035a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:14.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.782+0000 7f5bc3fff640 1 -- 10.20.193.10:0/2852849988 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5bdc0044f0 con 0x7f5be8073970 2026-02-17T11:59:14.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.782+0000 7f5bc3fff640 10 client.4881.objecter ms_dispatch2 0x7f5be8000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:14.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.782+0000 7f5bc3fff640 3 client.4881.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:14.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.782+0000 7f5bc3fff640 3 client.4881.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:14.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.782+0000 7f5bc3fff640 20 client.4881.objecter dump_active .. 0 homeless 2026-02-17T11:59:14.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.782+0000 7f5bc3fff640 1 -- 10.20.193.10:0/2852849988 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5be8069900 con 0x7f5be8073970 2026-02-17T11:59:14.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.782+0000 7f5bc3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:14.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.782+0000 7f5bc3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:14.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.879+0000 7f5bede98640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:14.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.879+0000 7f5bede98640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:14.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.879+0000 7f5bede98640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:14.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.879+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5be8074920 con 0x7f5be8073970 2026-02-17T11:59:14.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.882+0000 7f5bc3fff640 1 -- 10.20.193.10:0/2852849988 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f5bdc024020 con 0x7f5be8073970 2026-02-17T11:59:14.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.882+0000 7f5bc3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:14.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.882+0000 7f5bc3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:14.885 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:14.885 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:14.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 10 librados: watch_flush enter 2026-02-17T11:59:14.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 10 librados: watch_flush exit 2026-02-17T11:59:14.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 20 client.4881.objecter shutdown clearing up homeless session... 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 10 client.4881.objecter successfully canceled tick 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5bb8078e00 msgr2=0x7f5bb807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5bb8078e00 0x7f5bb807b2c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40028f0 tx=0x7f5bd40035a0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 10 monclient: shutdown 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5be8073970 msgr2=0x7f5be8148aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5be8073970 0x7f5be8148aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc004fd0 tx=0x7f5bdc00f5a0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 shutdown_connections 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5bb8078e00 0x7f5bb807b2c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5be8073970 0x7f5be8148aa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5be8145940 0x7f5be8073430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 --2- 10.20.193.10:0/2852849988 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5bcc004a10 0x7f5be81f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:14.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 >> 10.20.193.10:0/2852849988 conn(0x7f5be80c9d80 msgr2=0x7f5be8152be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:14.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 shutdown_connections 2026-02-17T11:59:14.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 -- 10.20.193.10:0/2852849988 wait complete. 2026-02-17T11:59:14.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:14.883+0000 7f5bede98640 1 librados: shutdown 2026-02-17T11:59:15.273 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:05:32.441 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:15.302 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:05:32.470 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:15.303 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:05:32.466 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:15.305 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:05:32.468 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:15.310 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:05:32.478 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:15.313 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:05:32.476 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:15.328 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:05:32.456 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:15.328 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:05:32.457 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:15.337 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:05:32.465 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:17.895 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:17.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.961+0000 7fb548efc640 10 monclient: get_monmap_and_config 2026-02-17T11:59:17.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.961+0000 7fb548efc640 10 monclient: build_initial_monmap 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.961+0000 7fb548efc640 10 monclient: monmap: 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:17.962426+0000 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:17.962426+0000 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:17.964 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:17.965 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:17.965 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:17.965 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:17.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.961+0000 7fb548efc640 1 Processor -- start 2026-02-17T11:59:17.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.961+0000 7fb548efc640 1 -- start start 2026-02-17T11:59:17.965 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.961+0000 7fb548efc640 10 monclient: init 2026-02-17T11:59:17.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:17.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 10 monclient: _add_conns ranks=[4,2,0,3,1,5] 2026-02-17T11:59:17.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fb5440725f0 0x7fb5440729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:17.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 10 monclient(hunting): picked mon.noname-b con 0x7fb5440725f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:17.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb5440733f0 addr v1:10.20.193.153:6789/0 2026-02-17T11:59:17.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb5441591b0 addr v1:10.20.193.10:6789/0 2026-02-17T11:59:17.968 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440738c0 con 0x7fb5441591b0 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb544073ba0 con 0x7fb5440733f0 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb5440c9a00 con 0x7fb5440725f0 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb548efc640 10 monclient(hunting): authenticate will time out at 1227.684194s 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb543fff640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fb5441591b0 0x7fb5440c57b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:41810/0 (socket says 10.20.193.10:41810) 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb543fff640 1 -- 10.20.193.10:0/2599447389 learned_addr learned my addr 10.20.193.10:0/2599447389 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb5437fe640 1 --2- 10.20.193.10:0/2599447389 >> v2:10.20.193.71:3300/0 conn(0x7fb5440725f0 0x7fb5440729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb5437fe640 10 monclient(hunting): get_auth_request con 0x7fb5440725f0 auth_method 0 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb5437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb5437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:17.969 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.962+0000 7fb5437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.963+0000 7fb5437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.963+0000 7fb5437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.963+0000 7fb5437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.963+0000 7fb5427fc640 1 -- 10.20.193.10:0/2599447389 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4085293942 0 0) 0x7fb5440738c0 con 0x7fb5441591b0 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.963+0000 7fb5427fc640 10 monclient(hunting): _negotiate 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.963+0000 7fb5427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.963+0000 7fb5427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.963+0000 7fb5427fc640 10 monclient(hunting): my global_id is 4884 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.963+0000 7fb5427fc640 1 -- 10.20.193.10:0/2599447389 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb528003620 con 0x7fb5441591b0 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5427fc640 1 -- 10.20.193.10:0/2599447389 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2486917591 0 0) 0x7fb544073ba0 con 0x7fb5440733f0 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5427fc640 10 monclient(hunting): _negotiate 2026-02-17T11:59:17.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5427fc640 10 monclient(hunting): my global_id is 4949 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5427fc640 1 -- 10.20.193.10:0/2599447389 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5440738c0 con 0x7fb5440733f0 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5437fe640 10 monclient(hunting): handle_auth_done global_id 4906 payload 274 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5437fe640 1 -- 10.20.193.10:0/2599447389 >> v1:10.20.193.153:6789/0 conn(0x7fb5440733f0 legacy=0x7fb5440c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5437fe640 1 -- 10.20.193.10:0/2599447389 >> v1:10.20.193.10:6789/0 conn(0x7fb5441591b0 legacy=0x7fb5440c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5437fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5437fe640 1 monclient: found mon.noname-b 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5437fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.964+0000 7fb5437fe640 1 -- 10.20.193.10:0/2599447389 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb544073e80 con 0x7fb5440725f0 2026-02-17T11:59:17.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.965+0000 7fb5437fe640 1 --2- 10.20.193.10:0/2599447389 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb5440725f0 0x7fb5440729d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5300098a0 tx=0x7fb53002ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b25698a85d291e54 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:17.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 1 -- 10.20.193.10:0/2599447389 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53003c070 con 0x7fb5440725f0 2026-02-17T11:59:17.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:17.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:17.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 10 monclient: dump: 2026-02-17T11:59:17.978 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:17.978 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:17.978 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:17.978 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:17.978 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 1 -- 10.20.193.10:0/2599447389 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53002fb70 con 0x7fb5440725f0 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 5 monclient: authenticate success, global_id 4906 2026-02-17T11:59:17.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 1 -- 10.20.193.10:0/2599447389 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530037440 con 0x7fb5440725f0 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 4 set_mon_vals no callback set 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb5427fc640 10 monclient: dump: 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:17.980 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 10 monclient: shutdown 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 1 -- 10.20.193.10:0/2599447389 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb5440725f0 msgr2=0x7fb5440729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 1 --2- 10.20.193.10:0/2599447389 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb5440725f0 0x7fb5440729d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5300098a0 tx=0x7fb53002ee60 comp rx=0 tx=0).stop 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 1 -- 10.20.193.10:0/2599447389 shutdown_connections 2026-02-17T11:59:17.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 1 --2- 10.20.193.10:0/2599447389 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb5440725f0 0x7fb5440729d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 1 -- 10.20.193.10:0/2599447389 >> 10.20.193.10:0/2599447389 conn(0x7fb5440c9bd0 msgr2=0x7fb5440c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 1 -- 10.20.193.10:0/2599447389 shutdown_connections 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 1 -- 10.20.193.10:0/2599447389 wait complete. 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 10 monclient: build_initial_monmap 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.967+0000 7fb548efc640 10 monclient: monmap: 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:17.982 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 librados: starting msgr at 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 librados: starting objecter 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 Processor -- start 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 -- start start 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 librados: setting wanted keys 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 librados: calling monclient init 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient: init 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:17.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb5440725f0 0x7fb5441efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient(hunting): picked mon.noname-a con 0x7fb5440725f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb5440733f0 0x7fb544154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient(hunting): picked mon.noname-b con 0x7fb5440733f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5441591b0 0x7fb5441f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient(hunting): picked mon.noname-c con 0x7fb5441591b0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fb544074720 con 0x7fb5440725f0 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb544074440 con 0x7fb5440733f0 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb544159600 con 0x7fb5441591b0 2026-02-17T11:59:17.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb548efc640 10 monclient(hunting): authenticate will time out at 1227.690556s 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb5437fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb5440725f0 0x7fb5441efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb542ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb5440733f0 0x7fb544154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb543fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5441591b0 0x7fb5441f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb5437fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb5440725f0 0x7fb5441efe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:47746/0 (socket says 10.20.193.10:47746) 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb5437fe640 1 -- 10.20.193.10:0/3350725261 learned_addr learned my addr 10.20.193.10:0/3350725261 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb5437fe640 10 monclient(hunting): get_auth_request con 0x7fb5440725f0 auth_method 0 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb5437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb5437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.968+0000 7fb5437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb542ffd640 10 monclient(hunting): get_auth_request con 0x7fb5440733f0 auth_method 0 2026-02-17T11:59:17.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb542ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb542ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb542ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb543fff640 10 monclient(hunting): get_auth_request con 0x7fb5441591b0 auth_method 0 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb543fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb543fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb543fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb5437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb5437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb5437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb542ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb542ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:17.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb542ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb543fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb543fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.969+0000 7fb543fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 10 monclient(hunting): handle_auth_done global_id 4887 payload 824 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 1 -- 10.20.193.10:0/3350725261 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5441591b0 msgr2=0x7fb5441f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5441591b0 0x7fb5441f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 1 -- 10.20.193.10:0/3350725261 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb5440733f0 msgr2=0x7fb544154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb5440733f0 0x7fb544154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:17.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.970+0000 7fb5437fe640 1 -- 10.20.193.10:0/3350725261 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5441f03a0 con 0x7fb5440725f0 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.971+0000 7fb5437fe640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb5440725f0 0x7fb5441efe60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb530016e30 tx=0x7fb5300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.971+0000 7fb51ffff640 10 client.?.objecter ms_handle_connect 0x7fb5440725f0 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.971+0000 7fb51ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 1 -- 10.20.193.10:0/3350725261 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530046020 con 0x7fb5440725f0 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 10 monclient: dump: 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:17.988 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 10 monclient: _finish_auth 0 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb548efc640 5 monclient: authenticate success, global_id 4887 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 1 -- 10.20.193.10:0/3350725261 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb530042450 con 0x7fb5440725f0 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:17.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 1 -- 10.20.193.10:0/3350725261 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53003c040 con 0x7fb5440725f0 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb51ffff640 10 monclient: dump: 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:17.990 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb541ffb640 4 set_mon_vals no callback set 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb548efc640 10 monclient: _renew_subs 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb548efc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb544155150 con 0x7fb5440725f0 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb548efc640 10 client.4887.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb548efc640 10 monclient: _renew_subs 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb548efc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb544155710 con 0x7fb5440725f0 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.973+0000 7fb548efc640 1 librados: init done 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.974+0000 7fb548efc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.974+0000 7fb548efc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.974+0000 7fb548efc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:17.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.974+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb544074c40 con 0x7fb5440725f0 2026-02-17T11:59:17.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.985+0000 7fb51ffff640 1 -- 10.20.193.10:0/3350725261 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fb53004a3b0 con 0x7fb5440725f0 2026-02-17T11:59:17.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.986+0000 7fb51ffff640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb514078e50 0x7fb51407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:17.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.986+0000 7fb542ffd640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb514078e50 0x7fb51407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:17.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.986+0000 7fb542ffd640 10 monclient: get_auth_request con 0x7fb514078e50 auth_method 0 2026-02-17T11:59:17.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.986+0000 7fb542ffd640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb514078e50 0x7fb51407b310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb5440c5800 tx=0x7fb534003d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:17.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.986+0000 7fb51ffff640 10 client.4887.objecter ms_handle_connect 0x7fb514078e50 2026-02-17T11:59:17.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.987+0000 7fb51ffff640 1 -- 10.20.193.10:0/3350725261 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb5300829b0 con 0x7fb5440725f0 2026-02-17T11:59:17.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.987+0000 7fb51ffff640 10 client.4887.objecter ms_dispatch2 0x7fb544000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:17.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.987+0000 7fb51ffff640 3 client.4887.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:17.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.987+0000 7fb51ffff640 3 client.4887.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:17.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:17.987+0000 7fb51ffff640 20 client.4887.objecter dump_active .. 0 homeless 2026-02-17T11:59:18.089 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.087+0000 7fb51ffff640 1 -- 10.20.193.10:0/3350725261 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb530050020 con 0x7fb5440725f0 2026-02-17T11:59:18.089 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.087+0000 7fb51ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:18.089 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.087+0000 7fb51ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:18.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.185+0000 7fb548efc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:18.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.185+0000 7fb548efc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:18.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.185+0000 7fb548efc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:18.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.185+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb544072cd0 con 0x7fb5440725f0 2026-02-17T11:59:18.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.187+0000 7fb51ffff640 1 -- 10.20.193.10:0/3350725261 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fb530086970 con 0x7fb5440725f0 2026-02-17T11:59:18.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.187+0000 7fb51ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:18.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.187+0000 7fb51ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:18.190 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:18.190 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:18.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 10 librados: watch_flush enter 2026-02-17T11:59:18.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 10 librados: watch_flush exit 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 20 client.4887.objecter shutdown clearing up homeless session... 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 10 client.4887.objecter successfully canceled tick 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb514078e50 msgr2=0x7fb51407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb514078e50 0x7fb51407b310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb5440c5800 tx=0x7fb534003d90 comp rx=0 tx=0).stop 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 10 monclient: shutdown 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb5440725f0 msgr2=0x7fb5441efe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb5440725f0 0x7fb5441efe60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb530016e30 tx=0x7fb5300047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 shutdown_connections 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb514078e50 0x7fb51407b310 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:18.192 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5441591b0 0x7fb5441f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:18.193 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb5440733f0 0x7fb544154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:18.193 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 --2- 10.20.193.10:0/3350725261 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb5440725f0 0x7fb5441efe60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:18.193 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 >> 10.20.193.10:0/3350725261 conn(0x7fb5440c9bd0 msgr2=0x7fb5440c77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:18.193 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 shutdown_connections 2026-02-17T11:59:18.193 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 -- 10.20.193.10:0/3350725261 wait complete. 2026-02-17T11:59:18.193 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:18.188+0000 7fb548efc640 1 librados: shutdown 2026-02-17T11:59:21.200 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:21.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.267+0000 7fb3a86fa640 10 monclient: get_monmap_and_config 2026-02-17T11:59:21.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.267+0000 7fb3a86fa640 10 monclient: build_initial_monmap 2026-02-17T11:59:21.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.267+0000 7fb3a86fa640 10 monclient: monmap: 2026-02-17T11:59:21.270 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:21.270 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:21.270 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:21.268805+0000 2026-02-17T11:59:21.270 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:21.268805+0000 2026-02-17T11:59:21.270 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:21.270 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:21.270 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:21.271 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:21.271 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:21.271 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:21.271 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:21.271 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:21.271 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:21.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.267+0000 7fb3a86fa640 1 Processor -- start 2026-02-17T11:59:21.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.267+0000 7fb3a86fa640 1 -- start start 2026-02-17T11:59:21.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.267+0000 7fb3a86fa640 10 monclient: init 2026-02-17T11:59:21.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:21.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 10 monclient: _add_conns ranks=[5,4,2,1,0,3] 2026-02-17T11:59:21.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fb3a015d220 0x7fb3a015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:21.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 10 monclient(hunting): picked mon.noname-c con 0x7fb3a015d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:59:21.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fb3a0074920 0x7fb3a00c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:21.274 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 10 monclient(hunting): picked mon.noname-b con 0x7fb3a0074920 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb3a00c9120 addr v1:10.20.193.153:6789/0 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a00c95b0 con 0x7fb3a00c9120 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a00c58a0 con 0x7fb3a0074920 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a00c55c0 con 0x7fb3a015d220 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a86fa640 10 monclient(hunting): authenticate will time out at 1230.990504s 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.268+0000 7fb3a5c6e640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fb3a0074920 0x7fb3a00c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a646f640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fb3a015d220 0x7fb3a015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a5c6e640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fb3a0074920 0x7fb3a00c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:42368/0 (socket says 10.20.193.10:42368) 2026-02-17T11:59:21.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a5c6e640 1 -- 10.20.193.10:0/2624734208 learned_addr learned my addr 10.20.193.10:0/2624734208 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a5c6e640 10 monclient(hunting): get_auth_request con 0x7fb3a0074920 auth_method 0 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a5c6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a5c6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a5c6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a646f640 10 monclient(hunting): get_auth_request con 0x7fb3a015d220 auth_method 0 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a646f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a646f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a646f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a5c6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a5c6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a5c6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a646f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:21.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a646f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.269+0000 7fb3a646f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.270+0000 7fb3a5c6e640 10 monclient(hunting): handle_auth_done global_id 4912 payload 274 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.270+0000 7fb3a5c6e640 1 -- 10.20.193.10:0/2624734208 >> v2:10.20.193.153:3300/0 conn(0x7fb3a015d220 msgr2=0x7fb3a015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.270+0000 7fb3a5c6e640 1 --2- 10.20.193.10:0/2624734208 >> v2:10.20.193.153:3300/0 conn(0x7fb3a015d220 0x7fb3a015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.270+0000 7fb3a5c6e640 1 -- 10.20.193.10:0/2624734208 >> v1:10.20.193.153:6789/0 conn(0x7fb3a00c9120 legacy=0x7fb3a0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.270+0000 7fb3a5c6e640 10 monclient: _finish_hunting 0 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.270+0000 7fb3a5c6e640 1 monclient: found mon.noname-b 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.270+0000 7fb3a5c6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.270+0000 7fb3a5c6e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.270+0000 7fb3a5c6e640 1 -- 10.20.193.10:0/2624734208 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a00c7e20 con 0x7fb3a0074920 2026-02-17T11:59:21.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.271+0000 7fb3a5c6e640 1 --2- 10.20.193.10:0/2624734208 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a0074920 0x7fb3a00c8be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb394009970 tx=0x7fb39402eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccbdd106d0d86387 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:21.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 1 -- 10.20.193.10:0/2624734208 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39403c070 con 0x7fb3a0074920 2026-02-17T11:59:21.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:21.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:21.284 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 10 monclient: dump: 2026-02-17T11:59:21.284 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:21.284 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 10 monclient: _finish_auth 0 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 10 monclient: _check_auth_tickets 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:21.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 1 -- 10.20.193.10:0/2624734208 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39402fbc0 con 0x7fb3a0074920 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 5 monclient: authenticate success, global_id 4912 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 1 -- 10.20.193.10:0/2624734208 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394037440 con 0x7fb3a0074920 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 4 set_mon_vals no callback set 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a546d640 10 monclient: dump: 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:21.286 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 10 monclient: shutdown 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 1 -- 10.20.193.10:0/2624734208 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a0074920 msgr2=0x7fb3a00c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 1 --2- 10.20.193.10:0/2624734208 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a0074920 0x7fb3a00c8be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb394009970 tx=0x7fb39402eef0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 1 -- 10.20.193.10:0/2624734208 shutdown_connections 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 1 --2- 10.20.193.10:0/2624734208 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a0074920 0x7fb3a00c8be0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 1 --2- 10.20.193.10:0/2624734208 >> v2:10.20.193.153:3300/0 conn(0x7fb3a015d220 0x7fb3a015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 1 -- 10.20.193.10:0/2624734208 >> 10.20.193.10:0/2624734208 conn(0x7fb3a00c9d80 msgr2=0x7fb3a00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 1 -- 10.20.193.10:0/2624734208 shutdown_connections 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 1 -- 10.20.193.10:0/2624734208 wait complete. 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 10 monclient: build_initial_monmap 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.273+0000 7fb3a86fa640 10 monclient: monmap: 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:21.288 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 librados: starting msgr at 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 librados: starting objecter 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 Processor -- start 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 -- start start 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 librados: setting wanted keys 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 librados: calling monclient init 2026-02-17T11:59:21.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient: init 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3a0074920 0x7fb3a01e7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient(hunting): picked mon.noname-a con 0x7fb3a0074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3a00c9120 0x7fb3a01e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient(hunting): picked mon.noname-c con 0x7fb3a00c9120 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a015d220 0x7fb3a006da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient(hunting): picked mon.noname-b con 0x7fb3a015d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a00c86c0 con 0x7fb3a0074920 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a00c83e0 con 0x7fb3a015d220 2026-02-17T11:59:21.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0074d70 con 0x7fb3a00c9120 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a86fa640 10 monclient(hunting): authenticate will time out at 1230.996522s 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a6c70640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a015d220 0x7fb3a006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a646f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3a0074920 0x7fb3a01e7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.274+0000 7fb3a5c6e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3a00c9120 0x7fb3a01e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a6c70640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a015d220 0x7fb3a006da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:42372/0 (socket says 10.20.193.10:42372) 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a6c70640 1 -- 10.20.193.10:0/1910710844 learned_addr learned my addr 10.20.193.10:0/1910710844 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a6c70640 10 monclient(hunting): get_auth_request con 0x7fb3a015d220 auth_method 0 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a6c70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a6c70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:21.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a6c70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a646f640 10 monclient(hunting): get_auth_request con 0x7fb3a0074920 auth_method 0 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a646f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a646f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a646f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a5c6e640 10 monclient(hunting): get_auth_request con 0x7fb3a00c9120 auth_method 0 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a5c6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a5c6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a5c6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a6c70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a6c70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a6c70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a646f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:21.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a646f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a646f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a5c6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a5c6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.275+0000 7fb3a5c6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 10 monclient(hunting): handle_auth_done global_id 4915 payload 824 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 1 -- 10.20.193.10:0/1910710844 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3a00c9120 msgr2=0x7fb3a01e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3a00c9120 0x7fb3a01e8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 1 -- 10.20.193.10:0/1910710844 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3a0074920 msgr2=0x7fb3a01e7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3a0074920 0x7fb3a01e7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 10 monclient: _finish_hunting 0 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 1 monclient: found mon.noname-b 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:21.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.276+0000 7fb3a6c70640 1 -- 10.20.193.10:0/1910710844 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a01e5aa0 con 0x7fb3a015d220 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.277+0000 7fb3a6c70640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a015d220 0x7fb3a006da50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00cc50 tx=0x7fb39c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.277+0000 7fb386ffd640 10 client.?.objecter ms_handle_connect 0x7fb3a015d220 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.277+0000 7fb386ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 1 -- 10.20.193.10:0/1910710844 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c003a70 con 0x7fb3a015d220 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 10 monclient: dump: 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:21.294 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 10 monclient: _finish_auth 0 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 1 -- 10.20.193.10:0/1910710844 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c003c10 con 0x7fb3a015d220 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:21.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 1 -- 10.20.193.10:0/1910710844 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c0050d0 con 0x7fb3a015d220 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a86fa640 5 monclient: authenticate success, global_id 4915 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a86fa640 10 monclient: _renew_subs 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a4c6c640 4 set_mon_vals no callback set 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a86fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a01e5d80 con 0x7fb3a015d220 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb386ffd640 10 monclient: dump: 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:21.296 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a86fa640 10 client.4915.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a86fa640 10 monclient: _renew_subs 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a86fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a006d250 con 0x7fb3a015d220 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.279+0000 7fb3a86fa640 1 librados: init done 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.280+0000 7fb3a86fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:21.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.280+0000 7fb3a86fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:21.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.280+0000 7fb3a86fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:21.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.280+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a00c8be0 con 0x7fb3a015d220 2026-02-17T11:59:21.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.292+0000 7fb386ffd640 1 -- 10.20.193.10:0/1910710844 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fb39c005270 con 0x7fb3a015d220 2026-02-17T11:59:21.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.292+0000 7fb386ffd640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb370078e30 0x7fb37007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:21.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.293+0000 7fb3a646f640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb370078e30 0x7fb37007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:21.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.293+0000 7fb3a646f640 10 monclient: get_auth_request con 0x7fb370078e30 auth_method 0 2026-02-17T11:59:21.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.293+0000 7fb386ffd640 10 client.4915.objecter ms_handle_connect 0x7fb370078e30 2026-02-17T11:59:21.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.293+0000 7fb3a646f640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb370078e30 0x7fb37007b2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb390009ba0 tx=0x7fb390009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:21.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.387+0000 7fb386ffd640 1 -- 10.20.193.10:0/1910710844 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb39c05e700 con 0x7fb3a015d220 2026-02-17T11:59:21.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.387+0000 7fb386ffd640 10 client.4915.objecter ms_dispatch2 0x7fb3a0000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:21.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.387+0000 7fb386ffd640 3 client.4915.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:21.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.387+0000 7fb386ffd640 3 client.4915.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:21.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.387+0000 7fb386ffd640 20 client.4915.objecter dump_active .. 0 homeless 2026-02-17T11:59:21.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.393+0000 7fb386ffd640 1 -- 10.20.193.10:0/1910710844 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb39c0626c0 con 0x7fb3a015d220 2026-02-17T11:59:21.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.393+0000 7fb386ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:21.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.393+0000 7fb386ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:21.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.497+0000 7fb3a86fa640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:21.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.497+0000 7fb3a86fa640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:21.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.497+0000 7fb3a86fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:21.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.497+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb3a00c9b60 con 0x7fb3a015d220 2026-02-17T11:59:21.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.500+0000 7fb386ffd640 1 -- 10.20.193.10:0/1910710844 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fb39c0669c0 con 0x7fb3a015d220 2026-02-17T11:59:21.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.500+0000 7fb386ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:21.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.500+0000 7fb386ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:21.502 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:21.502 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:21.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 10 librados: watch_flush enter 2026-02-17T11:59:21.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 10 librados: watch_flush exit 2026-02-17T11:59:21.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 20 client.4915.objecter shutdown clearing up homeless session... 2026-02-17T11:59:21.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 10 client.4915.objecter successfully canceled tick 2026-02-17T11:59:21.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb370078e30 msgr2=0x7fb37007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:21.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb370078e30 0x7fb37007b2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb390009ba0 tx=0x7fb390009290 comp rx=0 tx=0).stop 2026-02-17T11:59:21.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 10 monclient: shutdown 2026-02-17T11:59:21.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:21.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a015d220 msgr2=0x7fb3a006da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a015d220 0x7fb3a006da50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00cc50 tx=0x7fb39c00a430 comp rx=0 tx=0).stop 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 shutdown_connections 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb370078e30 0x7fb37007b2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb3a015d220 0x7fb3a006da50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb3a00c9120 0x7fb3a01e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 --2- 10.20.193.10:0/1910710844 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb3a0074920 0x7fb3a01e7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 >> 10.20.193.10:0/1910710844 conn(0x7fb3a00c9d80 msgr2=0x7fb3a014ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 shutdown_connections 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 -- 10.20.193.10:0/1910710844 wait complete. 2026-02-17T11:59:21.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:21.501+0000 7fb3a86fa640 1 librados: shutdown 2026-02-17T11:59:24.512 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:24.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.581+0000 7f0cf08f3640 10 monclient: get_monmap_and_config 2026-02-17T11:59:24.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.581+0000 7f0cf08f3640 10 monclient: build_initial_monmap 2026-02-17T11:59:24.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.581+0000 7f0cf08f3640 10 monclient: monmap: 2026-02-17T11:59:24.584 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:24.584 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:24.584 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:24.582874+0000 2026-02-17T11:59:24.584 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:24.582874+0000 2026-02-17T11:59:24.584 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:24.584 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 1 Processor -- start 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 1 -- start start 2026-02-17T11:59:24.585 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient: init 2026-02-17T11:59:24.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:24.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient: _add_conns ranks=[4,1,3,5,2,0] 2026-02-17T11:59:24.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f0ce815d220 0x7f0ce815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:24.588 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient(hunting): picked mon.noname-b con 0x7f0ce815d220 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0ce8074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f0ce80c92f0 0x7f0ce8153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient(hunting): picked mon.noname-a con 0x7f0ce80c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ce80c58a0 con 0x7f0ce8074920 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce80c55c0 con 0x7f0ce80c92f0 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce80c7e20 con 0x7f0ce815d220 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.582+0000 7f0cf08f3640 10 monclient(hunting): authenticate will time out at 1234.304606s 2026-02-17T11:59:24.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0cee668640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f0ce815d220 0x7f0ce815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f0ce80c92f0 0x7f0ce8153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f0ce80c92f0 0x7f0ce8153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:35146/0 (socket says 10.20.193.10:35146) 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 1 -- 10.20.193.10:0/4184533151 learned_addr learned my addr 10.20.193.10:0/4184533151 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 10 monclient(hunting): get_auth_request con 0x7f0ce80c92f0 auth_method 0 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0cee668640 10 monclient(hunting): get_auth_request con 0x7f0ce815d220 auth_method 0 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0cee668640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0cee668640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:24.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0cee668640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.583+0000 7f0ceee69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0cee668640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0cee668640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0cee668640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0ceee69640 10 monclient(hunting): handle_auth_done global_id 4893 payload 274 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0ceee69640 1 -- 10.20.193.10:0/4184533151 >> v2:10.20.193.71:3300/0 conn(0x7f0ce815d220 msgr2=0x7f0ce815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0ceee69640 1 --2- 10.20.193.10:0/4184533151 >> v2:10.20.193.71:3300/0 conn(0x7f0ce815d220 0x7f0ce815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0ceee69640 1 -- 10.20.193.10:0/4184533151 >> v1:10.20.193.71:6789/0 conn(0x7f0ce8074920 legacy=0x7f0ce80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0ceee69640 10 monclient: _finish_hunting 0 2026-02-17T11:59:24.591 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0ceee69640 1 monclient: found mon.noname-a 2026-02-17T11:59:24.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0ceee69640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:24.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0ceee69640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:24.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.584+0000 7f0ceee69640 1 -- 10.20.193.10:0/4184533151 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce80c8100 con 0x7f0ce80c92f0 2026-02-17T11:59:24.592 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.585+0000 7f0ceee69640 1 --2- 10.20.193.10:0/4184533151 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce80c92f0 0x7f0ce8153650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009e50 tx=0x7f0cdc02f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c72f8b5ee836238 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:24.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 1 -- 10.20.193.10:0/4184533151 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc02fd60 con 0x7f0ce80c92f0 2026-02-17T11:59:24.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:24.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:24.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 10 monclient: dump: 2026-02-17T11:59:24.599 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:24.599 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 10 monclient: _finish_auth 0 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 10 monclient: _check_auth_tickets 2026-02-17T11:59:24.600 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 5 monclient: authenticate success, global_id 4893 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 1 -- 10.20.193.10:0/4184533151 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cdc0373f0 con 0x7f0ce80c92f0 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 1 -- 10.20.193.10:0/4184533151 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0377c0 con 0x7f0ce80c92f0 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 4 set_mon_vals no callback set 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0ced666640 10 monclient: dump: 2026-02-17T11:59:24.601 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 10 monclient: shutdown 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:24.602 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 1 -- 10.20.193.10:0/4184533151 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce80c92f0 msgr2=0x7f0ce8153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 1 --2- 10.20.193.10:0/4184533151 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce80c92f0 0x7f0ce8153650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009e50 tx=0x7f0cdc02f2a0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 1 -- 10.20.193.10:0/4184533151 shutdown_connections 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 1 --2- 10.20.193.10:0/4184533151 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce80c92f0 0x7f0ce8153650 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 1 --2- 10.20.193.10:0/4184533151 >> v2:10.20.193.71:3300/0 conn(0x7f0ce815d220 0x7f0ce815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 1 -- 10.20.193.10:0/4184533151 >> 10.20.193.10:0/4184533151 conn(0x7f0ce80c9d80 msgr2=0x7f0ce80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 1 -- 10.20.193.10:0/4184533151 shutdown_connections 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.587+0000 7f0cf08f3640 1 -- 10.20.193.10:0/4184533151 wait complete. 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.588+0000 7f0cf08f3640 10 monclient: build_initial_monmap 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.588+0000 7f0cf08f3640 10 monclient: monmap: 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:24.603 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.588+0000 7f0cf08f3640 1 librados: starting msgr at 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.588+0000 7f0cf08f3640 1 librados: starting objecter 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.588+0000 7f0cf08f3640 1 Processor -- start 2026-02-17T11:59:24.604 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.588+0000 7f0cf08f3640 1 -- start start 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.588+0000 7f0cf08f3640 1 librados: setting wanted keys 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.588+0000 7f0cf08f3640 1 librados: calling monclient init 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.588+0000 7f0cf08f3640 10 monclient: init 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce8074920 0x7f0ce814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient(hunting): picked mon.noname-c con 0x7f0ce8074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce80c92f0 0x7f0ce8072d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient(hunting): picked mon.noname-b con 0x7f0ce80c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce815d220 0x7f0ce80732b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:24.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient(hunting): picked mon.noname-a con 0x7f0ce815d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8074d70 con 0x7f0ce815d220 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce80c86c0 con 0x7f0ce80c92f0 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8153b90 con 0x7f0ce8074920 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cf08f3640 10 monclient(hunting): authenticate will time out at 1234.311236s 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce815d220 0x7f0ce80732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce815d220 0x7f0ce80732b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:35150/0 (socket says 10.20.193.10:35150) 2026-02-17T11:59:24.606 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 1 -- 10.20.193.10:0/415825326 learned_addr learned my addr 10.20.193.10:0/415825326 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 10 monclient(hunting): get_auth_request con 0x7f0ce815d220 auth_method 0 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cee668640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce8074920 0x7f0ce814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cede67640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce80c92f0 0x7f0ce8072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0ceee69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cede67640 10 monclient(hunting): get_auth_request con 0x7f0ce80c92f0 auth_method 0 2026-02-17T11:59:24.607 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cede67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cede67640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cede67640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cee668640 10 monclient(hunting): get_auth_request con 0x7f0ce8074920 auth_method 0 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cee668640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cee668640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.589+0000 7f0cee668640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.590+0000 7f0cede67640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.590+0000 7f0cede67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.590+0000 7f0cede67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.590+0000 7f0cee668640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.590+0000 7f0cee668640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:24.608 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.590+0000 7f0cee668640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 10 monclient(hunting): handle_auth_done global_id 4896 payload 824 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 1 -- 10.20.193.10:0/415825326 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce8074920 msgr2=0x7f0ce814d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce8074920 0x7f0ce814d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 1 -- 10.20.193.10:0/415825326 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce80c92f0 msgr2=0x7f0ce8072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce80c92f0 0x7f0ce8072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 10 monclient: _finish_hunting 0 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 1 monclient: found mon.noname-a 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.591+0000 7f0ceee69640 1 -- 10.20.193.10:0/415825326 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce81571b0 con 0x7f0ce815d220 2026-02-17T11:59:24.609 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.592+0000 7f0ceee69640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce815d220 0x7f0ce80732b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc02f7d0 tx=0x7f0cdc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.592+0000 7f0cd2ffd640 10 client.?.objecter ms_handle_connect 0x7f0ce815d220 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.592+0000 7f0cd2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 1 -- 10.20.193.10:0/415825326 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc046020 con 0x7f0ce815d220 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 10 monclient: dump: 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:24.610 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 1 -- 10.20.193.10:0/415825326 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cdc041450 con 0x7f0ce815d220 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 5 monclient: authenticate success, global_id 4896 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 10 monclient: _renew_subs 2026-02-17T11:59:24.611 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce814b2d0 con 0x7f0ce815d220 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 1 -- 10.20.193.10:0/415825326 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc009510 con 0x7f0ce815d220 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cd2ffd640 10 monclient: dump: 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:24.612 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cece65640 4 set_mon_vals no callback set 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 10 client.4896.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 10 monclient: _renew_subs 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce814b890 con 0x7f0ce815d220 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 1 librados: init done 2026-02-17T11:59:24.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:24.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:24.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:24.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.594+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce8153f20 con 0x7f0ce815d220 2026-02-17T11:59:24.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.699+0000 7f0cd2ffd640 1 -- 10.20.193.10:0/415825326 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f0cdc041820 con 0x7f0ce815d220 2026-02-17T11:59:24.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.700+0000 7f0cd2ffd640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb8078e30 0x7f0cb807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:24.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.700+0000 7f0cee668640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb8078e30 0x7f0cb807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:24.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.700+0000 7f0cee668640 10 monclient: get_auth_request con 0x7f0cb8078e30 auth_method 0 2026-02-17T11:59:24.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.700+0000 7f0cee668640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb8078e30 0x7f0cb807b2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009ba0 tx=0x7f0ce0009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:24.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.700+0000 7f0cd2ffd640 10 client.4896.objecter ms_handle_connect 0x7f0cb8078e30 2026-02-17T11:59:24.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.708+0000 7f0cd2ffd640 1 -- 10.20.193.10:0/415825326 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f0cdc0838b0 con 0x7f0ce815d220 2026-02-17T11:59:24.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.708+0000 7f0cd2ffd640 10 client.4896.objecter ms_dispatch2 0x7f0ce8000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:24.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.708+0000 7f0cd2ffd640 3 client.4896.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:24.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.708+0000 7f0cd2ffd640 3 client.4896.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:24.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.708+0000 7f0cd2ffd640 20 client.4896.objecter dump_active .. 0 homeless 2026-02-17T11:59:24.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.708+0000 7f0cd2ffd640 1 -- 10.20.193.10:0/415825326 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0cdc050030 con 0x7f0ce815d220 2026-02-17T11:59:24.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.708+0000 7f0cd2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:24.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.708+0000 7f0cd2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:24.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.808+0000 7f0cf08f3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:24.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.808+0000 7f0cf08f3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:24.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.808+0000 7f0cf08f3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:24.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.808+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0ce80c9b60 con 0x7f0ce815d220 2026-02-17T11:59:24.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.811+0000 7f0cd2ffd640 1 -- 10.20.193.10:0/415825326 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f0cdc087870 con 0x7f0ce815d220 2026-02-17T11:59:24.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.811+0000 7f0cd2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:24.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.811+0000 7f0cd2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:24.813 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:24.813 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:24.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.811+0000 7f0cf08f3640 10 librados: watch_flush enter 2026-02-17T11:59:24.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 10 librados: watch_flush exit 2026-02-17T11:59:24.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 20 client.4896.objecter shutdown clearing up homeless session... 2026-02-17T11:59:24.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 10 client.4896.objecter successfully canceled tick 2026-02-17T11:59:24.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb8078e30 msgr2=0x7f0cb807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:24.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb8078e30 0x7f0cb807b2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009ba0 tx=0x7f0ce0009290 comp rx=0 tx=0).stop 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 10 monclient: shutdown 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce815d220 msgr2=0x7f0ce80732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce815d220 0x7f0ce80732b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc02f7d0 tx=0x7f0cdc004b40 comp rx=0 tx=0).stop 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 shutdown_connections 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f0cb8078e30 0x7f0cb807b2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f0ce815d220 0x7f0ce80732b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f0ce80c92f0 0x7f0ce8072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 --2- 10.20.193.10:0/415825326 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ce8074920 0x7f0ce814d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 >> 10.20.193.10:0/415825326 conn(0x7f0ce80c9d80 msgr2=0x7f0ce814df70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 shutdown_connections 2026-02-17T11:59:24.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 -- 10.20.193.10:0/415825326 wait complete. 2026-02-17T11:59:24.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:24.812+0000 7f0cf08f3640 1 librados: shutdown 2026-02-17T11:59:27.823 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:27.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.889+0000 7f8459d96640 10 monclient: get_monmap_and_config 2026-02-17T11:59:27.890 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.889+0000 7f8459d96640 10 monclient: build_initial_monmap 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.889+0000 7f8459d96640 10 monclient: monmap: 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:27.889811+0000 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:27.889811+0000 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:27.891 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:27.892 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:27.892 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:27.892 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:27.895 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 1 Processor -- start 2026-02-17T11:59:27.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 1 -- start start 2026-02-17T11:59:27.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient: init 2026-02-17T11:59:27.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:27.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient: _add_conns ranks=[4,5,0,2,3,1] 2026-02-17T11:59:27.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f845415d220 0x7f845415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient(hunting): picked mon.noname-b con 0x7f845415d220 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:27.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f8454074920 0x7f84540c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient(hunting): picked mon.noname-c con 0x7f8454074920 addr v2:10.20.193.153:3300/0 2026-02-17T11:59:27.896 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f84540c9120 addr v1:10.20.193.10:6789/0 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84540c95b0 con 0x7f84540c9120 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f84540c58a0 con 0x7f845415d220 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f84540c55c0 con 0x7f8454074920 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.890+0000 7f8459d96640 10 monclient(hunting): authenticate will time out at 1237.611629s 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8453fff640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f84540c9120 0x7f8454153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:48322/0 (socket says 10.20.193.10:48322) 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8453fff640 1 -- 10.20.193.10:0/1429591270 learned_addr learned my addr 10.20.193.10:0/1429591270 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f84537fe640 1 --2- 10.20.193.10:0/1429591270 >> v2:10.20.193.71:3300/0 conn(0x7f845415d220 0x7f845415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.897 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8452ffd640 1 --2- 10.20.193.10:0/1429591270 >> v2:10.20.193.153:3300/0 conn(0x7f8454074920 0x7f84540c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f84537fe640 10 monclient(hunting): get_auth_request con 0x7f845415d220 auth_method 0 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f84537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f84537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f84537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8452ffd640 10 monclient(hunting): get_auth_request con 0x7f8454074920 auth_method 0 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8452ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8452ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8452ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f84537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f84537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:27.898 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f84537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8452ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8452ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.891+0000 7f8452ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84527fc640 1 -- 10.20.193.10:0/1429591270 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 775405920 0 0) 0x7f84540c95b0 con 0x7f84540c9120 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84527fc640 10 monclient(hunting): _negotiate 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84527fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84527fc640 10 monclient(hunting): my global_id is 4899 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84527fc640 1 -- 10.20.193.10:0/1429591270 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8438003620 con 0x7f84540c9120 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84537fe640 10 monclient(hunting): handle_auth_done global_id 4927 payload 274 2026-02-17T11:59:27.899 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84537fe640 1 -- 10.20.193.10:0/1429591270 >> v2:10.20.193.153:3300/0 conn(0x7f8454074920 msgr2=0x7f84540c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:27.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84537fe640 1 --2- 10.20.193.10:0/1429591270 >> v2:10.20.193.153:3300/0 conn(0x7f8454074920 0x7f84540c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84537fe640 1 -- 10.20.193.10:0/1429591270 >> v1:10.20.193.10:6789/0 conn(0x7f84540c9120 legacy=0x7f8454153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:27.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84537fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:27.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84537fe640 1 monclient: found mon.noname-b 2026-02-17T11:59:27.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:27.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84537fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:27.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.892+0000 7f84537fe640 1 -- 10.20.193.10:0/1429591270 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84540c7e20 con 0x7f845415d220 2026-02-17T11:59:27.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.893+0000 7f84537fe640 1 --2- 10.20.193.10:0/1429591270 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 0x7f845415d600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84400098a0 tx=0x7f844002ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e545c5c57a62f8e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:27.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 1 -- 10.20.193.10:0/1429591270 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844003c070 con 0x7f845415d220 2026-02-17T11:59:27.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:27.908 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:27.909 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 10 monclient: dump: 2026-02-17T11:59:27.909 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:27.909 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:27.909 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:27.909 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:27.909 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:27.909 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:27.909 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:27.909 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 1 -- 10.20.193.10:0/1429591270 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f844002fae0 con 0x7f845415d220 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f8459d96640 5 monclient: authenticate success, global_id 4927 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f8459d96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 1 -- 10.20.193.10:0/1429591270 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440037440 con 0x7f845415d220 2026-02-17T11:59:27.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f84527fc640 10 monclient: dump: 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:27.911 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f8459d96640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.895+0000 7f8459d96640 4 set_mon_vals no callback set 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 10 monclient: shutdown 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 1 -- 10.20.193.10:0/1429591270 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 msgr2=0x7f845415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 1 --2- 10.20.193.10:0/1429591270 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 0x7f845415d600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84400098a0 tx=0x7f844002ee10 comp rx=0 tx=0).stop 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 1 -- 10.20.193.10:0/1429591270 shutdown_connections 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 1 --2- 10.20.193.10:0/1429591270 >> v2:10.20.193.153:3300/0 conn(0x7f8454074920 0x7f84540c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.912 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 1 --2- 10.20.193.10:0/1429591270 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 0x7f845415d600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 1 -- 10.20.193.10:0/1429591270 >> 10.20.193.10:0/1429591270 conn(0x7f84540c9d80 msgr2=0x7f84540ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 1 -- 10.20.193.10:0/1429591270 shutdown_connections 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 1 -- 10.20.193.10:0/1429591270 wait complete. 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 10 monclient: build_initial_monmap 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.896+0000 7f8459d96640 10 monclient: monmap: 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:27.913 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 librados: starting msgr at 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 librados: starting objecter 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 Processor -- start 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 -- start start 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 librados: setting wanted keys 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 librados: calling monclient init 2026-02-17T11:59:27.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient: init 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8454074920 0x7f84541f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient(hunting): picked mon.noname-a con 0x7f8454074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f84540c9120 0x7f8454141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient(hunting): picked mon.noname-c con 0x7f84540c9120 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 0x7f84541f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient(hunting): picked mon.noname-b con 0x7f845415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f84540c86c0 con 0x7f8454074920 2026-02-17T11:59:27.915 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f84540c83e0 con 0x7f845415d220 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8454074d70 con 0x7f84540c9120 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8459d96640 10 monclient(hunting): authenticate will time out at 1237.618610s 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f8453fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 0x7f84541f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.897+0000 7f84537fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8454074920 0x7f84541f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8452ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f84540c9120 0x7f8454141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8453fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 0x7f84541f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:49252/0 (socket says 10.20.193.10:49252) 2026-02-17T11:59:27.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f84537fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8454074920 0x7f84541f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:35164/0 (socket says 10.20.193.10:35164) 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8453fff640 1 -- 10.20.193.10:0/1426672381 learned_addr learned my addr 10.20.193.10:0/1426672381 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8453fff640 10 monclient(hunting): get_auth_request con 0x7f845415d220 auth_method 0 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8453fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8453fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8453fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f84537fe640 10 monclient(hunting): get_auth_request con 0x7f8454074920 auth_method 0 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f84537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f84537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f84537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8452ffd640 10 monclient(hunting): get_auth_request con 0x7f84540c9120 auth_method 0 2026-02-17T11:59:27.917 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8452ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8452ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8452ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8453fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8453fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8453fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f84537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f84537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f84537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8452ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8452ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.898+0000 7f8452ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 10 monclient(hunting): handle_auth_done global_id 4902 payload 824 2026-02-17T11:59:27.918 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 1 -- 10.20.193.10:0/1426672381 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f84540c9120 msgr2=0x7f8454141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f84540c9120 0x7f8454141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 1 -- 10.20.193.10:0/1426672381 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 msgr2=0x7f84541f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 0x7f84541f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.899+0000 7f84537fe640 1 -- 10.20.193.10:0/1426672381 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84541f2120 con 0x7f8454074920 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.900+0000 7f84537fe640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8454074920 0x7f84541f55c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8440036000 tx=0x7f84400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.900+0000 7f842ffff640 10 client.?.objecter ms_handle_connect 0x7f8454074920 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.900+0000 7f842ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:27.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 1 -- 10.20.193.10:0/1426672381 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440046020 con 0x7f8454074920 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 10 monclient: dump: 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:27.920 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 10 monclient: _finish_auth 0 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 1 -- 10.20.193.10:0/1426672381 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8440042670 con 0x7f8454074920 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8459d96640 5 monclient: authenticate success, global_id 4902 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8459d96640 10 monclient: _renew_subs 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8459d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84541f2400 con 0x7f8454074920 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:27.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 1 -- 10.20.193.10:0/1426672381 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844003c040 con 0x7f8454074920 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8451ffb640 4 set_mon_vals no callback set 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f842ffff640 10 monclient: dump: 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:27.922 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8459d96640 10 client.4902.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8459d96640 10 monclient: _renew_subs 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8459d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845414aa40 con 0x7f8454074920 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.902+0000 7f8459d96640 1 librados: init done 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.903+0000 7f8459d96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:27.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.903+0000 7f8459d96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:27.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.903+0000 7f8459d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:27.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.903+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84540c8be0 con 0x7f8454074920 2026-02-17T11:59:27.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.914+0000 7f842ffff640 1 -- 10.20.193.10:0/1426672381 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f844004a3b0 con 0x7f8454074920 2026-02-17T11:59:27.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.915+0000 7f842ffff640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8424078e80 0x7f842407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:27.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.915+0000 7f8452ffd640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8424078e80 0x7f842407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:27.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.915+0000 7f8452ffd640 10 monclient: get_auth_request con 0x7f8424078e80 auth_method 0 2026-02-17T11:59:27.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.915+0000 7f8452ffd640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8424078e80 0x7f842407b340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f845415c540 tx=0x7f8444009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:27.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.915+0000 7f842ffff640 10 client.4902.objecter ms_handle_connect 0x7f8424078e80 2026-02-17T11:59:27.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.916+0000 7f842ffff640 1 -- 10.20.193.10:0/1426672381 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f844002f9a0 con 0x7f8454074920 2026-02-17T11:59:27.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.916+0000 7f842ffff640 10 client.4902.objecter ms_dispatch2 0x7f8454000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:27.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.916+0000 7f842ffff640 3 client.4902.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:27.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.916+0000 7f842ffff640 3 client.4902.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:27.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:27.916+0000 7f842ffff640 20 client.4902.objecter dump_active .. 0 homeless 2026-02-17T11:59:28.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.017+0000 7f842ffff640 1 -- 10.20.193.10:0/1426672381 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8440050020 con 0x7f8454074920 2026-02-17T11:59:28.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.017+0000 7f842ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:28.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.017+0000 7f842ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:28.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.116+0000 7f8459d96640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:28.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.116+0000 7f8459d96640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:28.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.116+0000 7f8459d96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:28.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.116+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f84540c9b60 con 0x7f8454074920 2026-02-17T11:59:28.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.118+0000 7f842ffff640 1 -- 10.20.193.10:0/1426672381 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f84400868e0 con 0x7f8454074920 2026-02-17T11:59:28.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.118+0000 7f842ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:28.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.118+0000 7f842ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:28.120 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:28.120 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:28.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 10 librados: watch_flush enter 2026-02-17T11:59:28.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 10 librados: watch_flush exit 2026-02-17T11:59:28.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 20 client.4902.objecter shutdown clearing up homeless session... 2026-02-17T11:59:28.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 10 client.4902.objecter successfully canceled tick 2026-02-17T11:59:28.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8424078e80 msgr2=0x7f842407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:28.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8424078e80 0x7f842407b340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f845415c540 tx=0x7f8444009290 comp rx=0 tx=0).stop 2026-02-17T11:59:28.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 10 monclient: shutdown 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8454074920 msgr2=0x7f84541f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8454074920 0x7f84541f55c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8440036000 tx=0x7f84400047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 shutdown_connections 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8424078e80 0x7f842407b340 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f845415d220 0x7f84541f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f84540c9120 0x7f8454141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 --2- 10.20.193.10:0/1426672381 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8454074920 0x7f84541f55c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 >> 10.20.193.10:0/1426672381 conn(0x7f84540c9d80 msgr2=0x7f84541529b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 shutdown_connections 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 -- 10.20.193.10:0/1426672381 wait complete. 2026-02-17T11:59:28.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:28.120+0000 7f8459d96640 1 librados: shutdown 2026-02-17T11:59:31.130 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:31.197 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.196+0000 7f2fd1b61640 10 monclient: get_monmap_and_config 2026-02-17T11:59:31.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.196+0000 7f2fd1b61640 10 monclient: build_initial_monmap 2026-02-17T11:59:31.198 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.196+0000 7f2fd1b61640 10 monclient: monmap: 2026-02-17T11:59:31.198 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:31.198 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:31.198 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:31.196741+0000 2026-02-17T11:59:31.198 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:31.196741+0000 2026-02-17T11:59:31.198 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:31.198 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.196+0000 7f2fd1b61640 1 Processor -- start 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.196+0000 7f2fd1b61640 1 -- start start 2026-02-17T11:59:31.199 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.196+0000 7f2fd1b61640 10 monclient: init 2026-02-17T11:59:31.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:31.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 10 monclient: _add_conns ranks=[1,3,4,5,2,0] 2026-02-17T11:59:31.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2fcc15d220 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:31.208 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f2fcc0c92f0 0x7f2fcc15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 10 monclient(hunting): picked mon.noname-a con 0x7f2fcc0c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f2fcc074920 0x7f2fcc153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 10 monclient(hunting): picked mon.noname-b con 0x7f2fcc074920 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fcc0c58a0 con 0x7f2fcc15d220 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f2fcc0c55c0 con 0x7f2fcc0c92f0 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2fcc0c7e20 con 0x7f2fcc074920 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:31.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fd1b61640 10 monclient(hunting): authenticate will time out at 1240.918439s 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.197+0000 7f2fcaffd640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f2fcc0c92f0 0x7f2fcc15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcbfff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f2fcc074920 0x7f2fcc153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcaffd640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f2fcc0c92f0 0x7f2fcc15d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:35168/0 (socket says 10.20.193.10:35168) 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcaffd640 1 -- 10.20.193.10:0/3419086108 learned_addr learned my addr 10.20.193.10:0/3419086108 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcaffd640 10 monclient(hunting): get_auth_request con 0x7f2fcc0c92f0 auth_method 0 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:31.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcbfff640 10 monclient(hunting): get_auth_request con 0x7f2fcc074920 auth_method 0 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.198+0000 7f2fcbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcaffd640 10 monclient(hunting): handle_auth_done global_id 4905 payload 274 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcaffd640 1 -- 10.20.193.10:0/3419086108 >> v2:10.20.193.71:3300/0 conn(0x7f2fcc074920 msgr2=0x7f2fcc153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcaffd640 1 --2- 10.20.193.10:0/3419086108 >> v2:10.20.193.71:3300/0 conn(0x7f2fcc074920 0x7f2fcc153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcaffd640 1 -- 10.20.193.10:0/3419086108 >> v1:10.20.193.71:6789/0 conn(0x7f2fcc15d220 legacy=0x7f2fcc0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcaffd640 1 monclient: found mon.noname-a 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcaffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.199+0000 7f2fcaffd640 1 -- 10.20.193.10:0/3419086108 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc0c8100 con 0x7f2fcc0c92f0 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.200+0000 7f2fcaffd640 1 --2- 10.20.193.10:0/3419086108 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc0c92f0 0x7f2fcc15d600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009970 tx=0x7f2fbc02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4dc10ab8453c86 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 1 -- 10.20.193.10:0/3419086108 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc03c070 con 0x7f2fcc0c92f0 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 10 monclient: dump: 2026-02-17T11:59:31.212 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:31.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 1 -- 10.20.193.10:0/3419086108 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fbc02fbc0 con 0x7f2fcc0c92f0 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 5 monclient: authenticate success, global_id 4905 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 1 -- 10.20.193.10:0/3419086108 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc037440 con 0x7f2fcc0c92f0 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fca7fc640 10 monclient: dump: 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:31.214 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 4 set_mon_vals no callback set 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 10 monclient: shutdown 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:31.215 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 1 -- 10.20.193.10:0/3419086108 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc0c92f0 msgr2=0x7f2fcc15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 1 --2- 10.20.193.10:0/3419086108 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc0c92f0 0x7f2fcc15d600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009970 tx=0x7f2fbc02eef0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 1 -- 10.20.193.10:0/3419086108 shutdown_connections 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 1 --2- 10.20.193.10:0/3419086108 >> v2:10.20.193.71:3300/0 conn(0x7f2fcc074920 0x7f2fcc153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 1 --2- 10.20.193.10:0/3419086108 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc0c92f0 0x7f2fcc15d600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 1 -- 10.20.193.10:0/3419086108 >> 10.20.193.10:0/3419086108 conn(0x7f2fcc0c9d80 msgr2=0x7f2fcc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 1 -- 10.20.193.10:0/3419086108 shutdown_connections 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 1 -- 10.20.193.10:0/3419086108 wait complete. 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 10 monclient: build_initial_monmap 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.202+0000 7f2fd1b61640 10 monclient: monmap: 2026-02-17T11:59:31.216 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:31.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 librados: starting msgr at 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 librados: starting objecter 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 Processor -- start 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 -- start start 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 librados: setting wanted keys 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 librados: calling monclient init 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient: init 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2fcc074920 0x7f2fcc1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient(hunting): picked mon.noname-b con 0x7f2fcc074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2fcc0c92f0 0x7f2fcc15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:31.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient(hunting): picked mon.noname-c con 0x7f2fcc0c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc15d220 0x7f2fcc15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient(hunting): picked mon.noname-a con 0x7f2fcc15d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc074d70 con 0x7f2fcc15d220 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc0c86c0 con 0x7f2fcc074920 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc153b90 con 0x7f2fcc0c92f0 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fd1b61640 10 monclient(hunting): authenticate will time out at 1240.924661s 2026-02-17T11:59:31.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.203+0000 7f2fcbfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc15d220 0x7f2fcc15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcb7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2fcc074920 0x7f2fcc1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcbfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc15d220 0x7f2fcc15ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:35172/0 (socket says 10.20.193.10:35172) 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcbfff640 1 -- 10.20.193.10:0/1533883671 learned_addr learned my addr 10.20.193.10:0/1533883671 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcbfff640 10 monclient(hunting): get_auth_request con 0x7f2fcc15d220 auth_method 0 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcaffd640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2fcc0c92f0 0x7f2fcc15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcb7fe640 10 monclient(hunting): get_auth_request con 0x7f2fcc074920 auth_method 0 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:31.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcaffd640 10 monclient(hunting): get_auth_request con 0x7f2fcc0c92f0 auth_method 0 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:31.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.204+0000 7f2fcaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 10 monclient(hunting): handle_auth_done global_id 4908 payload 824 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 1 -- 10.20.193.10:0/1533883671 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2fcc0c92f0 msgr2=0x7f2fcc15b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2fcc0c92f0 0x7f2fcc15b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 1 -- 10.20.193.10:0/1533883671 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2fcc074920 msgr2=0x7f2fcc1527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2fcc074920 0x7f2fcc1527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 1 monclient: found mon.noname-a 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.205+0000 7f2fcbfff640 1 -- 10.20.193.10:0/1533883671 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc1f4130 con 0x7f2fcc15d220 2026-02-17T11:59:31.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.206+0000 7f2fcbfff640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc15d220 0x7f2fcc15ba60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000efc0 tx=0x7f2fc000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:31.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.206+0000 7f2fa7fff640 10 client.?.objecter ms_handle_connect 0x7f2fcc15d220 2026-02-17T11:59:31.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.206+0000 7f2fa7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:31.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 1 -- 10.20.193.10:0/1533883671 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0018020 con 0x7f2fcc15d220 2026-02-17T11:59:31.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:31.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:31.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 10 monclient: dump: 2026-02-17T11:59:31.226 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:31.226 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:31.226 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:31.226 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:31.226 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 10 monclient: _finish_auth 0 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 1 -- 10.20.193.10:0/1533883671 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc0014480 con 0x7f2fcc15d220 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 5 monclient: authenticate success, global_id 4908 2026-02-17T11:59:31.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 10 monclient: _renew_subs 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc1f4410 con 0x7f2fcc15d220 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 1 -- 10.20.193.10:0/1533883671 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0014870 con 0x7f2fcc15d220 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fc9ffb640 4 set_mon_vals no callback set 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fa7fff640 10 monclient: dump: 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 10 client.4908.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 10 monclient: _renew_subs 2026-02-17T11:59:31.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc1f49d0 con 0x7f2fcc15d220 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 1 librados: init done 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.208+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fcc153f70 con 0x7f2fcc15d220 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.220+0000 7f2fa7fff640 1 -- 10.20.193.10:0/1533883671 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f2fc0014a10 con 0x7f2fcc15d220 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.220+0000 7f2fa7fff640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2f9c078e50 0x7f2f9c07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.220+0000 7f2fcb7fe640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2f9c078e50 0x7f2f9c07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:31.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.220+0000 7f2fcb7fe640 10 monclient: get_auth_request con 0x7f2f9c078e50 auth_method 0 2026-02-17T11:59:31.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.221+0000 7f2fcb7fe640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2f9c078e50 0x7f2f9c07b310 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8005110 tx=0x7f2fb8007f30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:31.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.221+0000 7f2fa7fff640 10 client.4908.objecter ms_handle_connect 0x7f2f9c078e50 2026-02-17T11:59:31.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.222+0000 7f2fa7fff640 1 -- 10.20.193.10:0/1533883671 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f2fc005f210 con 0x7f2fcc15d220 2026-02-17T11:59:31.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.222+0000 7f2fa7fff640 10 client.4908.objecter ms_dispatch2 0x7f2fcc000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:31.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.222+0000 7f2fa7fff640 3 client.4908.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:31.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.222+0000 7f2fa7fff640 3 client.4908.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:31.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.222+0000 7f2fa7fff640 20 client.4908.objecter dump_active .. 0 homeless 2026-02-17T11:59:31.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.321+0000 7f2fa7fff640 1 -- 10.20.193.10:0/1533883671 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2fc0022030 con 0x7f2fcc15d220 2026-02-17T11:59:31.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.321+0000 7f2fa7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:31.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.321+0000 7f2fa7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:31.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.421+0000 7f2fd1b61640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:31.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.421+0000 7f2fd1b61640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:31.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.421+0000 7f2fd1b61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:31.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.421+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2fcc0c9b60 con 0x7f2fcc15d220 2026-02-17T11:59:31.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.424+0000 7f2fa7fff640 1 -- 10.20.193.10:0/1533883671 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f2fc0010040 con 0x7f2fcc15d220 2026-02-17T11:59:31.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.424+0000 7f2fa7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:31.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.424+0000 7f2fa7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:31.425 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:31.426 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:31.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 10 librados: watch_flush enter 2026-02-17T11:59:31.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 10 librados: watch_flush exit 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 20 client.4908.objecter shutdown clearing up homeless session... 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 10 client.4908.objecter successfully canceled tick 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2f9c078e50 msgr2=0x7f2f9c07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2f9c078e50 0x7f2f9c07b310 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8005110 tx=0x7f2fb8007f30 comp rx=0 tx=0).stop 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 10 monclient: shutdown 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc15d220 msgr2=0x7f2fcc15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc15d220 0x7f2fcc15ba60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000efc0 tx=0x7f2fc000c490 comp rx=0 tx=0).stop 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 shutdown_connections 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2f9c078e50 0x7f2f9c07b310 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2fcc15d220 0x7f2fcc15ba60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2fcc0c92f0 0x7f2fcc15b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 --2- 10.20.193.10:0/1533883671 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2fcc074920 0x7f2fcc1527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:31.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 >> 10.20.193.10:0/1533883671 conn(0x7f2fcc0c9d80 msgr2=0x7f2fcc149560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:31.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 shutdown_connections 2026-02-17T11:59:31.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 -- 10.20.193.10:0/1533883671 wait complete. 2026-02-17T11:59:31.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:31.425+0000 7f2fd1b61640 1 librados: shutdown 2026-02-17T11:59:34.435 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:34.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.502+0000 7f5ffe961640 10 monclient: get_monmap_and_config 2026-02-17T11:59:34.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.502+0000 7f5ffe961640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.502+0000 7f5ffe961640 10 monclient: monmap: 2026-02-17T11:59:34.505 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:34.505 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:34.505 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:34.504028+0000 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:34.504028+0000 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:34.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 1 Processor -- start 2026-02-17T11:59:34.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 1 -- start start 2026-02-17T11:59:34.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient: init 2026-02-17T11:59:34.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient: _add_conns ranks=[4,1,5,2,0,3] 2026-02-17T11:59:34.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5ff8152660 0x7f5ff815a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient(hunting): picked mon.noname-b con 0x7f5ff8152660 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5ff8152a40 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5ff80c94e0 0x7f5ff815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient(hunting): picked mon.noname-c con 0x7f5ff80c94e0 addr v2:10.20.193.153:3300/0 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff80c71e0 con 0x7f5ff8152a40 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff80c77a0 con 0x7f5ff8152660 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff80c74c0 con 0x7f5ff80c94e0 2026-02-17T11:59:34.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.503+0000 7f5ffe961640 10 monclient(hunting): authenticate will time out at 1244.225761s 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5ff80c94e0 0x7f5ff815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ff7fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5ff8152660 0x7f5ff815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5ff80c94e0 0x7f5ff815ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:53746/0 (socket says 10.20.193.10:53746) 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 1 -- 10.20.193.10:0/2074688055 learned_addr learned my addr 10.20.193.10:0/2074688055 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 10 monclient(hunting): get_auth_request con 0x7f5ff80c94e0 auth_method 0 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ff7fff640 10 monclient(hunting): get_auth_request con 0x7f5ff8152660 auth_method 0 2026-02-17T11:59:34.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ff7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ff7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.504+0000 7f5ffced7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ffced7640 10 monclient(hunting): handle_auth_done global_id 4976 payload 274 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ffced7640 1 -- 10.20.193.10:0/2074688055 >> v2:10.20.193.71:3300/0 conn(0x7f5ff8152660 msgr2=0x7f5ff815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ffced7640 1 --2- 10.20.193.10:0/2074688055 >> v2:10.20.193.71:3300/0 conn(0x7f5ff8152660 0x7f5ff815a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ffced7640 1 -- 10.20.193.10:0/2074688055 >> v1:10.20.193.71:6789/0 conn(0x7f5ff8152a40 legacy=0x7f5ff80c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ffced7640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ffced7640 1 monclient: found mon.noname-c 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ffced7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ffced7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.505+0000 7f5ffced7640 1 -- 10.20.193.10:0/2074688055 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff8159e40 con 0x7f5ff80c94e0 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.506+0000 7f5ffced7640 1 --2- 10.20.193.10:0/2074688055 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 0x7f5ff815ae60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8076d70 tx=0x7f5fec02f270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f588c967fc65ca server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 1 -- 10.20.193.10:0/2074688055 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec02fcd0 con 0x7f5ff80c94e0 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:34.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 10 monclient: dump: 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:34.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 1 -- 10.20.193.10:0/2074688055 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec0373f0 con 0x7f5ff80c94e0 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 5 monclient: authenticate success, global_id 4976 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 1 -- 10.20.193.10:0/2074688055 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0377c0 con 0x7f5ff80c94e0 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ff6ffd640 10 monclient: dump: 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:34.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 4 set_mon_vals no callback set 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 10 monclient: shutdown 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 1 -- 10.20.193.10:0/2074688055 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 msgr2=0x7f5ff815ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 1 --2- 10.20.193.10:0/2074688055 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 0x7f5ff815ae60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8076d70 tx=0x7f5fec02f270 comp rx=0 tx=0).stop 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 1 -- 10.20.193.10:0/2074688055 shutdown_connections 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 1 --2- 10.20.193.10:0/2074688055 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 0x7f5ff815ae60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 1 --2- 10.20.193.10:0/2074688055 >> v2:10.20.193.71:3300/0 conn(0x7f5ff8152660 0x7f5ff815a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 1 -- 10.20.193.10:0/2074688055 >> 10.20.193.10:0/2074688055 conn(0x7f5ff80c9d80 msgr2=0x7f5ff80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.508+0000 7f5ffe961640 1 -- 10.20.193.10:0/2074688055 shutdown_connections 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.509+0000 7f5ffe961640 1 -- 10.20.193.10:0/2074688055 wait complete. 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.509+0000 7f5ffe961640 10 monclient: build_initial_monmap 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.509+0000 7f5ffe961640 10 monclient: monmap: 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:34.524 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.509+0000 7f5ffe961640 1 librados: starting msgr at 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.509+0000 7f5ffe961640 1 librados: starting objecter 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.509+0000 7f5ffe961640 1 Processor -- start 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 1 -- start start 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 1 librados: setting wanted keys 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 1 librados: calling monclient init 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient: init 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:59:34.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 0x7f5ff81f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient(hunting): picked mon.noname-c con 0x7f5ff80c94e0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ff8152660 0x7f5ff81f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient(hunting): picked mon.noname-b con 0x7f5ff8152660 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ff8152a40 0x7f5ff8157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient(hunting): picked mon.noname-a con 0x7f5ff8152a40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80c5cd0 con 0x7f5ff8152a40 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff815a400 con 0x7f5ff8152660 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:34.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80c5e50 con 0x7f5ff80c94e0 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffe961640 10 monclient(hunting): authenticate will time out at 1244.232485s 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ff7fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 0x7f5ff81f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ff77fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ff8152660 0x7f5ff81f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ff77fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ff8152660 0x7f5ff81f7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:51760/0 (socket says 10.20.193.10:51760) 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ff77fe640 1 -- 10.20.193.10:0/2053155187 learned_addr learned my addr 10.20.193.10:0/2053155187 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ff77fe640 10 monclient(hunting): get_auth_request con 0x7f5ff8152660 auth_method 0 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ff77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ff77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ff77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.510+0000 7f5ffced7640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ff8152a40 0x7f5ff8157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff7fff640 10 monclient(hunting): get_auth_request con 0x7f5ff80c94e0 auth_method 0 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ffced7640 10 monclient(hunting): get_auth_request con 0x7f5ff8152a40 auth_method 0 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ffced7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ffced7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ffced7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:34.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ffced7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ffced7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.511+0000 7f5ffced7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 10 monclient(hunting): handle_auth_done global_id 4979 payload 824 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 1 -- 10.20.193.10:0/2053155187 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ff8152660 msgr2=0x7f5ff81f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ff8152660 0x7f5ff81f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 1 -- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ff8152a40 msgr2=0x7f5ff8157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ff8152a40 0x7f5ff8157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 1 monclient: found mon.noname-c 2026-02-17T11:59:34.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:34.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:59:34.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.512+0000 7f5ff7fff640 1 -- 10.20.193.10:0/2053155187 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff81f7ae0 con 0x7f5ff80c94e0 2026-02-17T11:59:34.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.513+0000 7f5ff7fff640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 0x7f5ff81f4730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400e9b0 tx=0x7f5fe400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.513+0000 7f5ff4ff9640 10 client.?.objecter ms_handle_connect 0x7f5ff80c94e0 2026-02-17T11:59:34.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.513+0000 7f5ff4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 1 -- 10.20.193.10:0/2053155187 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4017070 con 0x7f5ff80c94e0 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 10 monclient: dump: 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 1 -- 10.20.193.10:0/2053155187 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe400ca00 con 0x7f5ff80c94e0 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 1 -- 10.20.193.10:0/2053155187 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400cdf0 con 0x7f5ff80c94e0 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 5 monclient: authenticate success, global_id 4979 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 10 monclient: _renew_subs 2026-02-17T11:59:34.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff67fc640 4 set_mon_vals no callback set 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff81f7dc0 con 0x7f5ff80c94e0 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ff4ff9640 10 monclient: dump: 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:34.535 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 10 client.4979.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 10 monclient: _renew_subs 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff8156730 con 0x7f5ff80c94e0 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 1 librados: init done 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.515+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff8069900 con 0x7f5ff80c94e0 2026-02-17T11:59:34.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.527+0000 7f5ff4ff9640 1 -- 10.20.193.10:0/2053155187 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5fe4013470 con 0x7f5ff80c94e0 2026-02-17T11:59:34.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.527+0000 7f5ff4ff9640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5fc8078e50 0x7f5fc807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:34.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.528+0000 7f5ff77fe640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5fc8078e50 0x7f5fc807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:34.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.528+0000 7f5ff77fe640 10 monclient: get_auth_request con 0x7f5fc8078e50 auth_method 0 2026-02-17T11:59:34.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.528+0000 7f5ff4ff9640 10 client.4979.objecter ms_handle_connect 0x7f5fc8078e50 2026-02-17T11:59:34.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.528+0000 7f5ff77fe640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5fc8078e50 0x7f5fc807b310 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5ff81f18e0 tx=0x7f5fe80091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:34.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.630+0000 7f5ff4ff9640 1 -- 10.20.193.10:0/2053155187 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5fe405e460 con 0x7f5ff80c94e0 2026-02-17T11:59:34.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.630+0000 7f5ff4ff9640 10 client.4979.objecter ms_dispatch2 0x7f5ff8000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:34.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.630+0000 7f5ff4ff9640 3 client.4979.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:34.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.630+0000 7f5ff4ff9640 3 client.4979.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:34.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.630+0000 7f5ff4ff9640 20 client.4979.objecter dump_active .. 0 homeless 2026-02-17T11:59:34.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.636+0000 7f5ff4ff9640 1 -- 10.20.193.10:0/2053155187 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5ff8069900 con 0x7f5ff80c94e0 2026-02-17T11:59:34.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.636+0000 7f5ff4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:34.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.636+0000 7f5ff4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:34.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.734+0000 7f5ffe961640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:34.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.734+0000 7f5ffe961640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:34.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.734+0000 7f5ffe961640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:34.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.734+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5ff80c7950 con 0x7f5ff80c94e0 2026-02-17T11:59:34.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.737+0000 7f5ff4ff9640 1 -- 10.20.193.10:0/2053155187 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f5ff80c7950 con 0x7f5ff80c94e0 2026-02-17T11:59:34.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.737+0000 7f5ff4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:34.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.737+0000 7f5ff4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:34.739 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:34.739 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:34.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.737+0000 7f5ffe961640 10 librados: watch_flush enter 2026-02-17T11:59:34.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.737+0000 7f5ffe961640 10 librados: watch_flush exit 2026-02-17T11:59:34.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.737+0000 7f5ffe961640 20 client.4979.objecter shutdown clearing up homeless session... 2026-02-17T11:59:34.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.737+0000 7f5ffe961640 10 client.4979.objecter successfully canceled tick 2026-02-17T11:59:34.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5fc8078e50 msgr2=0x7f5fc807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5fc8078e50 0x7f5fc807b310 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5ff81f18e0 tx=0x7f5fe80091c0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 10 monclient: shutdown 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 msgr2=0x7f5ff81f4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 0x7f5ff81f4730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400e9b0 tx=0x7f5fe400ee80 comp rx=0 tx=0).stop 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 shutdown_connections 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5fc8078e50 0x7f5fc807b310 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ff8152a40 0x7f5ff8157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ff8152660 0x7f5ff81f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 --2- 10.20.193.10:0/2053155187 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ff80c94e0 0x7f5ff81f4730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 >> 10.20.193.10:0/2053155187 conn(0x7f5ff80c9d80 msgr2=0x7f5ff814dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:34.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 shutdown_connections 2026-02-17T11:59:34.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 -- 10.20.193.10:0/2053155187 wait complete. 2026-02-17T11:59:34.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:34.738+0000 7f5ffe961640 1 librados: shutdown 2026-02-17T11:59:35.297 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:05:52.465 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:35.324 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:05:52.492 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:35.331 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:05:52.500 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:35.351 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:05:52.514 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:35.351 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:05:52.480 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:35.352 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:05:52.515 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:35.352 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:05:52.481 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:35.360 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:05:52.488 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:35.360 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:05:52.523 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:37.749 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:37.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.815+0000 7f9a14979640 10 monclient: get_monmap_and_config 2026-02-17T11:59:37.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.815+0000 7f9a14979640 10 monclient: build_initial_monmap 2026-02-17T11:59:37.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.815+0000 7f9a14979640 10 monclient: monmap: 2026-02-17T11:59:37.818 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:37.818 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:37.818 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:37.817088+0000 2026-02-17T11:59:37.818 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:37.817088+0000 2026-02-17T11:59:37.818 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:37.818 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:37.818 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:37.819 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:37.819 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:37.819 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:37.819 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:37.819 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:37.819 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:37.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.816+0000 7f9a14979640 1 Processor -- start 2026-02-17T11:59:37.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.816+0000 7f9a14979640 1 -- start start 2026-02-17T11:59:37.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.816+0000 7f9a14979640 10 monclient: init 2026-02-17T11:59:37.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:37.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 10 monclient: _add_conns ranks=[2,4,1,3,0,5] 2026-02-17T11:59:37.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9a0c15d220 addr v1:10.20.193.153:6789/0 2026-02-17T11:59:37.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9a0c0c92f0 0x7f9a0c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:37.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 10 monclient(hunting): picked mon.noname-b con 0x7f9a0c0c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:37.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9a0c074920 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a0c0c58a0 con 0x7f9a0c074920 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a0c0c55c0 con 0x7f9a0c15d220 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9a0c0c7e20 con 0x7f9a0c0c92f0 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a14979640 10 monclient(hunting): authenticate will time out at 1247.539142s 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a11eed640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9a0c0c92f0 0x7f9a0c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a126ee640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f9a0c15d220 0x7f9a0c0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:60920/0 (socket says 10.20.193.10:60920) 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.817+0000 7f9a126ee640 1 -- 10.20.193.10:0/1236198215 learned_addr learned my addr 10.20.193.10:0/1236198215 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.818+0000 7f9a11eed640 10 monclient(hunting): get_auth_request con 0x7f9a0c0c92f0 auth_method 0 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.818+0000 7f9a11eed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:37.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.818+0000 7f9a11eed640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.818+0000 7f9a11eed640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.818+0000 7f9a11eed640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.818+0000 7f9a11eed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.818+0000 7f9a11eed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a116ec640 1 -- 10.20.193.10:0/1236198215 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107136137 0 0) 0x7f9a0c0c55c0 con 0x7f9a0c15d220 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a116ec640 10 monclient(hunting): _negotiate 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a116ec640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a116ec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a116ec640 10 monclient(hunting): my global_id is 4982 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a116ec640 1 -- 10.20.193.10:0/1236198215 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99fc003620 con 0x7f9a0c15d220 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a11eed640 10 monclient(hunting): handle_auth_done global_id 4948 payload 274 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a11eed640 1 -- 10.20.193.10:0/1236198215 >> v1:10.20.193.153:6789/0 conn(0x7f9a0c15d220 legacy=0x7f9a0c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:37.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a11eed640 1 -- 10.20.193.10:0/1236198215 >> v1:10.20.193.71:6789/0 conn(0x7f9a0c074920 legacy=0x7f9a0c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:37.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a11eed640 10 monclient: _finish_hunting 0 2026-02-17T11:59:37.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a11eed640 1 monclient: found mon.noname-b 2026-02-17T11:59:37.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a11eed640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:37.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a11eed640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:37.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.819+0000 7f9a11eed640 1 -- 10.20.193.10:0/1236198215 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c0c8100 con 0x7f9a0c0c92f0 2026-02-17T11:59:37.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.822+0000 7f9a11eed640 1 --2- 10.20.193.10:0/1236198215 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c0c92f0 0x7f9a0c15d600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f99f80098d0 tx=0x7f99f802eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=747b567748e7e4c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:37.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 1 -- 10.20.193.10:0/1236198215 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f803c070 con 0x7f9a0c0c92f0 2026-02-17T11:59:37.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:37.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:37.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 10 monclient: dump: 2026-02-17T11:59:37.830 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:37.831 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:37.831 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:37.831 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:37.831 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:37.831 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:37.831 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:37.831 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:37.831 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:37.831 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 10 monclient: _finish_auth 0 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 10 monclient: _check_auth_tickets 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 1 -- 10.20.193.10:0/1236198215 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f802fba0 con 0x7f9a0c0c92f0 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 5 monclient: authenticate success, global_id 4948 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 1 -- 10.20.193.10:0/1236198215 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8037440 con 0x7f9a0c0c92f0 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 4 set_mon_vals no callback set 2026-02-17T11:59:37.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a116ec640 10 monclient: dump: 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:37.833 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 10 monclient: shutdown 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 1 -- 10.20.193.10:0/1236198215 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c0c92f0 msgr2=0x7f9a0c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 1 --2- 10.20.193.10:0/1236198215 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c0c92f0 0x7f9a0c15d600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f99f80098d0 tx=0x7f99f802eed0 comp rx=0 tx=0).stop 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 1 -- 10.20.193.10:0/1236198215 shutdown_connections 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 1 --2- 10.20.193.10:0/1236198215 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c0c92f0 0x7f9a0c15d600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 1 -- 10.20.193.10:0/1236198215 >> 10.20.193.10:0/1236198215 conn(0x7f9a0c0c9d80 msgr2=0x7f9a0c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 1 -- 10.20.193.10:0/1236198215 shutdown_connections 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.824+0000 7f9a14979640 1 -- 10.20.193.10:0/1236198215 wait complete. 2026-02-17T11:59:37.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 10 monclient: build_initial_monmap 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 10 monclient: monmap: 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:37.835 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 1 librados: starting msgr at 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 1 librados: starting objecter 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 1 Processor -- start 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 1 -- start start 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 1 librados: setting wanted keys 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 1 librados: calling monclient init 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 10 monclient: init 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c074920 0x7f9a0c15c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.825+0000 7f9a14979640 10 monclient(hunting): picked mon.noname-b con 0x7f9a0c074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:37.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9a0c0c92f0 0x7f9a0c1f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 10 monclient(hunting): picked mon.noname-c con 0x7f9a0c0c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9a0c15d220 0x7f9a0c0724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 10 monclient(hunting): picked mon.noname-a con 0x7f9a0c15d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c074d70 con 0x7f9a0c15d220 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c0c86c0 con 0x7f9a0c074920 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c153d60 con 0x7f9a0c0c92f0 2026-02-17T11:59:37.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a14979640 10 monclient(hunting): authenticate will time out at 1247.548026s 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c074920 0x7f9a0c15c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a12eef640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9a0c15d220 0x7f9a0c0724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a11eed640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9a0c0c92f0 0x7f9a0c1f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c074920 0x7f9a0c15c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:51766/0 (socket says 10.20.193.10:51766) 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 1 -- 10.20.193.10:0/2117304506 learned_addr learned my addr 10.20.193.10:0/2117304506 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 10 monclient(hunting): get_auth_request con 0x7f9a0c074920 auth_method 0 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:37.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a12eef640 10 monclient(hunting): get_auth_request con 0x7f9a0c15d220 auth_method 0 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a12eef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a12eef640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a12eef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a11eed640 10 monclient(hunting): get_auth_request con 0x7f9a0c0c92f0 auth_method 0 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a11eed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a11eed640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a11eed640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a126ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:37.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a12eef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a12eef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.826+0000 7f9a12eef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.827+0000 7f9a11eed640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.827+0000 7f9a11eed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.827+0000 7f9a11eed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 10 monclient(hunting): handle_auth_done global_id 4954 payload 824 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 1 -- 10.20.193.10:0/2117304506 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9a0c0c92f0 msgr2=0x7f9a0c1f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9a0c0c92f0 0x7f9a0c1f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 1 -- 10.20.193.10:0/2117304506 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9a0c15d220 msgr2=0x7f9a0c0724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9a0c15d220 0x7f9a0c0724d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:37.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 10 monclient: _finish_hunting 0 2026-02-17T11:59:37.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 1 monclient: found mon.noname-b 2026-02-17T11:59:37.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:37.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:37.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.828+0000 7f9a126ee640 1 -- 10.20.193.10:0/2117304506 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c145e90 con 0x7f9a0c074920 2026-02-17T11:59:37.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.829+0000 7f9a126ee640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c074920 0x7f9a0c15c170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400c550 tx=0x7f9a0400ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:37.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.829+0000 7f99f6ffd640 10 client.?.objecter ms_handle_connect 0x7f9a0c074920 2026-02-17T11:59:37.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.829+0000 7f99f6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:37.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 1 -- 10.20.193.10:0/2117304506 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04017070 con 0x7f9a0c074920 2026-02-17T11:59:37.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 10 monclient: dump: 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:37.844 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 5 monclient: authenticate success, global_id 4954 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 10 monclient: _renew_subs 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c074190 con 0x7f9a0c074920 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 10 client.4954.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:37.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 10 monclient: _renew_subs 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c1f1ab0 con 0x7f9a0c074920 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 1 librados: init done 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0c15d600 con 0x7f9a0c074920 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 1 -- 10.20.193.10:0/2117304506 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a04002a20 con 0x7f9a0c074920 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 1 -- 10.20.193.10:0/2117304506 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04021060 con 0x7f9a0c074920 2026-02-17T11:59:37.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f99f6ffd640 10 monclient: dump: 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:37.847 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:37.848 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:37.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.830+0000 7f9a10eeb640 4 set_mon_vals no callback set 2026-02-17T11:59:37.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.937+0000 7f99f6ffd640 1 -- 10.20.193.10:0/2117304506 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f9a04024080 con 0x7f9a0c074920 2026-02-17T11:59:37.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.938+0000 7f99f6ffd640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99dc078e00 0x7f99dc07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:37.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.938+0000 7f9a11eed640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99dc078e00 0x7f99dc07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:37.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.938+0000 7f9a11eed640 10 monclient: get_auth_request con 0x7f99dc078e00 auth_method 0 2026-02-17T11:59:37.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.938+0000 7f9a11eed640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99dc078e00 0x7f99dc07b2c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f99f8039000 tx=0x7f99f8033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:37.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.938+0000 7f99f6ffd640 10 client.4954.objecter ms_handle_connect 0x7f99dc078e00 2026-02-17T11:59:37.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.939+0000 7f99f6ffd640 1 -- 10.20.193.10:0/2117304506 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f9a04007700 con 0x7f9a0c074920 2026-02-17T11:59:37.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.939+0000 7f99f6ffd640 10 client.4954.objecter ms_dispatch2 0x7f9a0c000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:37.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.939+0000 7f99f6ffd640 3 client.4954.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:37.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.939+0000 7f99f6ffd640 3 client.4954.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:37.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.940+0000 7f99f6ffd640 20 client.4954.objecter dump_active .. 0 homeless 2026-02-17T11:59:37.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.946+0000 7f99f6ffd640 1 -- 10.20.193.10:0/2117304506 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9a04096e20 con 0x7f9a0c074920 2026-02-17T11:59:37.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.946+0000 7f99f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:37.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:37.946+0000 7f99f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:38.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.049+0000 7f9a14979640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:38.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.049+0000 7f9a14979640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:38.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.049+0000 7f9a14979640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:38.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.049+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9a0c1573e0 con 0x7f9a0c074920 2026-02-17T11:59:38.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.051+0000 7f99f6ffd640 1 -- 10.20.193.10:0/2117304506 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f9a040614e0 con 0x7f9a0c074920 2026-02-17T11:59:38.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.051+0000 7f99f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:38.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.051+0000 7f99f6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:38.054 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:38.054 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:38.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 10 librados: watch_flush enter 2026-02-17T11:59:38.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 10 librados: watch_flush exit 2026-02-17T11:59:38.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 20 client.4954.objecter shutdown clearing up homeless session... 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 10 client.4954.objecter successfully canceled tick 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99dc078e00 msgr2=0x7f99dc07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99dc078e00 0x7f99dc07b2c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f99f8039000 tx=0x7f99f8033000 comp rx=0 tx=0).stop 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 10 monclient: shutdown 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c074920 msgr2=0x7f9a0c15c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c074920 0x7f9a0c15c170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400c550 tx=0x7f9a0400ca20 comp rx=0 tx=0).stop 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 shutdown_connections 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f99dc078e00 0x7f99dc07b2c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9a0c15d220 0x7f9a0c0724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:38.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9a0c0c92f0 0x7f9a0c1f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:38.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 --2- 10.20.193.10:0/2117304506 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9a0c074920 0x7f9a0c15c170 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:38.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 >> 10.20.193.10:0/2117304506 conn(0x7f9a0c0c9d80 msgr2=0x7f9a0c152470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:38.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 shutdown_connections 2026-02-17T11:59:38.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 -- 10.20.193.10:0/2117304506 wait complete. 2026-02-17T11:59:38.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:38.053+0000 7f9a14979640 1 librados: shutdown 2026-02-17T11:59:41.064 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:41.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.129+0000 7fd1397a9640 10 monclient: get_monmap_and_config 2026-02-17T11:59:41.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.129+0000 7fd1397a9640 10 monclient: build_initial_monmap 2026-02-17T11:59:41.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.129+0000 7fd1397a9640 10 monclient: monmap: 2026-02-17T11:59:41.131 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:41.131 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:41.131 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:41.130434+0000 2026-02-17T11:59:41.131 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:41.130434+0000 2026-02-17T11:59:41.131 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:41.132 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:41.132 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:41.132 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:41.132 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:41.132 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:41.132 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:41.132 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:41.132 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:41.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.129+0000 7fd1397a9640 1 Processor -- start 2026-02-17T11:59:41.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.129+0000 7fd1397a9640 1 -- start start 2026-02-17T11:59:41.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.129+0000 7fd1397a9640 10 monclient: init 2026-02-17T11:59:41.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:41.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 10 monclient: _add_conns ranks=[1,4,5,0,3,2] 2026-02-17T11:59:41.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd13415d220 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:41.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fd1340c92f0 0x7fd13415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:41.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 10 monclient(hunting): picked mon.noname-b con 0x7fd1340c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fd134074920 0x7fd134153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 10 monclient(hunting): picked mon.noname-c con 0x7fd134074920 addr v2:10.20.193.153:3300/0 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1340c58a0 con 0x7fd13415d220 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd1340c55c0 con 0x7fd1340c92f0 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd1340c7e20 con 0x7fd134074920 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1397a9640 10 monclient(hunting): authenticate will time out at 1250.852275s 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1337fe640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fd134074920 0x7fd134153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1327fc640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fd1340c92f0 0x7fd13415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:41.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1337fe640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fd134074920 0x7fd134153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:53780/0 (socket says 10.20.193.10:53780) 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1337fe640 1 -- 10.20.193.10:0/3136040750 learned_addr learned my addr 10.20.193.10:0/3136040750 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1337fe640 10 monclient(hunting): get_auth_request con 0x7fd134074920 auth_method 0 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.130+0000 7fd1337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1327fc640 10 monclient(hunting): get_auth_request con 0x7fd1340c92f0 auth_method 0 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1327fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:41.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1327fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1327fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.131+0000 7fd1327fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.132+0000 7fd1337fe640 10 monclient(hunting): handle_auth_done global_id 4988 payload 274 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.132+0000 7fd1337fe640 1 -- 10.20.193.10:0/3136040750 >> v2:10.20.193.71:3300/0 conn(0x7fd1340c92f0 msgr2=0x7fd13415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.132+0000 7fd1337fe640 1 --2- 10.20.193.10:0/3136040750 >> v2:10.20.193.71:3300/0 conn(0x7fd1340c92f0 0x7fd13415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.132+0000 7fd1337fe640 1 -- 10.20.193.10:0/3136040750 >> v1:10.20.193.71:6789/0 conn(0x7fd13415d220 legacy=0x7fd1340c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.132+0000 7fd1337fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.132+0000 7fd1337fe640 1 monclient: found mon.noname-c 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.132+0000 7fd1337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.132+0000 7fd1337fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.132+0000 7fd1337fe640 1 -- 10.20.193.10:0/3136040750 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1340c8100 con 0x7fd134074920 2026-02-17T11:59:41.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.133+0000 7fd1337fe640 1 --2- 10.20.193.10:0/3136040750 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 0x7fd134153650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd124009e50 tx=0x7fd12402f2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e6b1cc55ae2681 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 1 -- 10.20.193.10:0/3136040750 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12402fd60 con 0x7fd134074920 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 10 monclient: dump: 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:41.145 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 10 monclient: _finish_auth 0 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd1397a9640 5 monclient: authenticate success, global_id 4988 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 1 -- 10.20.193.10:0/3136040750 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1240373f0 con 0x7fd134074920 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd1397a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 1 -- 10.20.193.10:0/3136040750 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1240377c0 con 0x7fd134074920 2026-02-17T11:59:41.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd1397a9640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd1397a9640 4 set_mon_vals no callback set 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.134+0000 7fd131ffb640 10 monclient: dump: 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:41.147 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 10 monclient: shutdown 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 1 -- 10.20.193.10:0/3136040750 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 msgr2=0x7fd134153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 1 --2- 10.20.193.10:0/3136040750 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 0x7fd134153650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd124009e50 tx=0x7fd12402f2a0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 1 -- 10.20.193.10:0/3136040750 shutdown_connections 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 1 --2- 10.20.193.10:0/3136040750 >> v2:10.20.193.71:3300/0 conn(0x7fd1340c92f0 0x7fd13415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 1 --2- 10.20.193.10:0/3136040750 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 0x7fd134153650 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 1 -- 10.20.193.10:0/3136040750 >> 10.20.193.10:0/3136040750 conn(0x7fd1340c9d80 msgr2=0x7fd1340ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 1 -- 10.20.193.10:0/3136040750 shutdown_connections 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 1 -- 10.20.193.10:0/3136040750 wait complete. 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 10 monclient: build_initial_monmap 2026-02-17T11:59:41.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.135+0000 7fd1397a9640 10 monclient: monmap: 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 librados: starting msgr at 2026-02-17T11:59:41.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 librados: starting objecter 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 Processor -- start 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 -- start start 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 librados: setting wanted keys 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 librados: calling monclient init 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient: init 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 0x7fd134145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient(hunting): picked mon.noname-c con 0x7fd134074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd1340c92f0 0x7fd1340731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient(hunting): picked mon.noname-a con 0x7fd1340c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd13415d220 0x7fd1340736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:41.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient(hunting): picked mon.noname-b con 0x7fd13415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fd134074d70 con 0x7fd1340c92f0 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1340c86c0 con 0x7fd13415d220 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd134153b90 con 0x7fd134074920 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd1397a9640 10 monclient(hunting): authenticate will time out at 1250.858608s 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.136+0000 7fd132ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 0x7fd134145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1327fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd1340c92f0 0x7fd1340731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd132ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 0x7fd134145940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:53788/0 (socket says 10.20.193.10:53788) 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd132ffd640 1 -- 10.20.193.10:0/1689794151 learned_addr learned my addr 10.20.193.10:0/1689794151 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:41.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd132ffd640 10 monclient(hunting): get_auth_request con 0x7fd134074920 auth_method 0 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd132ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd132ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd132ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1327fc640 10 monclient(hunting): get_auth_request con 0x7fd1340c92f0 auth_method 0 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1327fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1337fe640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd13415d220 0x7fd1340736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd132ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd132ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd132ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1337fe640 10 monclient(hunting): get_auth_request con 0x7fd13415d220 auth_method 0 2026-02-17T11:59:41.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1327fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1327fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1327fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.137+0000 7fd1337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 10 monclient(hunting): handle_auth_done global_id 4991 payload 824 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 1 -- 10.20.193.10:0/1689794151 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd13415d220 msgr2=0x7fd1340736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd13415d220 0x7fd1340736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 1 -- 10.20.193.10:0/1689794151 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd1340c92f0 msgr2=0x7fd1340731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:41.153 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd1340c92f0 0x7fd1340731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 1 monclient: found mon.noname-c 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.138+0000 7fd132ffd640 1 -- 10.20.193.10:0/1689794151 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd134073da0 con 0x7fd134074920 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.139+0000 7fd132ffd640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 0x7fd134145940 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c700 tx=0x7fd12800cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.139+0000 7fd1137fe640 10 client.?.objecter ms_handle_connect 0x7fd134074920 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.139+0000 7fd1137fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 1 -- 10.20.193.10:0/1689794151 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1280052d0 con 0x7fd134074920 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 10 monclient: dump: 2026-02-17T11:59:41.154 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 10 monclient: _finish_auth 0 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 10 monclient: _check_auth_tickets 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:41.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 1 -- 10.20.193.10:0/1689794151 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd128005470 con 0x7fd134074920 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 5 monclient: authenticate success, global_id 4991 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 1 -- 10.20.193.10:0/1689794151 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12800a860 con 0x7fd134074920 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1137fe640 10 monclient: dump: 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:41.156 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1317fa640 4 set_mon_vals no callback set 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 10 monclient: _renew_subs 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd134074080 con 0x7fd134074920 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 10 client.4991.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 10 monclient: _renew_subs 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd134074640 con 0x7fd134074920 2026-02-17T11:59:41.157 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 1 librados: init done 2026-02-17T11:59:41.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:41.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:41.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:41.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.141+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd134153f20 con 0x7fd134074920 2026-02-17T11:59:41.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.249+0000 7fd1137fe640 1 -- 10.20.193.10:0/1689794151 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fd12800aa00 con 0x7fd134074920 2026-02-17T11:59:41.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.250+0000 7fd1137fe640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd100078e50 0x7fd10007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:41.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.250+0000 7fd1327fc640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd100078e50 0x7fd10007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:41.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.250+0000 7fd1327fc640 10 monclient: get_auth_request con 0x7fd100078e50 auth_method 0 2026-02-17T11:59:41.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.250+0000 7fd1327fc640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd100078e50 0x7fd10007b310 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1340729d0 tx=0x7fd11c009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:41.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.250+0000 7fd1137fe640 10 client.4991.objecter ms_handle_connect 0x7fd100078e50 2026-02-17T11:59:41.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.251+0000 7fd1137fe640 1 -- 10.20.193.10:0/1689794151 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fd12800ad20 con 0x7fd134074920 2026-02-17T11:59:41.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.251+0000 7fd1137fe640 10 client.4991.objecter ms_dispatch2 0x7fd134000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:41.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.251+0000 7fd1137fe640 3 client.4991.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:41.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.251+0000 7fd1137fe640 3 client.4991.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:41.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.251+0000 7fd1137fe640 20 client.4991.objecter dump_active .. 0 homeless 2026-02-17T11:59:41.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.257+0000 7fd1137fe640 1 -- 10.20.193.10:0/1689794151 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd128061fc0 con 0x7fd134074920 2026-02-17T11:59:41.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.257+0000 7fd1137fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:41.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.257+0000 7fd1137fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:41.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.360+0000 7fd1397a9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:41.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.360+0000 7fd1397a9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:41.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.360+0000 7fd1397a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:41.363 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.360+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd1341573e0 con 0x7fd134074920 2026-02-17T11:59:41.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.363+0000 7fd1137fe640 1 -- 10.20.193.10:0/1689794151 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fd1280662c0 con 0x7fd134074920 2026-02-17T11:59:41.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.363+0000 7fd1137fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:41.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.363+0000 7fd1137fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:41.365 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:41.365 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:41.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 10 librados: watch_flush enter 2026-02-17T11:59:41.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 10 librados: watch_flush exit 2026-02-17T11:59:41.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 20 client.4991.objecter shutdown clearing up homeless session... 2026-02-17T11:59:41.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 10 client.4991.objecter successfully canceled tick 2026-02-17T11:59:41.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd100078e50 msgr2=0x7fd10007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:41.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd100078e50 0x7fd10007b310 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1340729d0 tx=0x7fd11c009290 comp rx=0 tx=0).stop 2026-02-17T11:59:41.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 10 monclient: shutdown 2026-02-17T11:59:41.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:41.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 msgr2=0x7fd134145940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 0x7fd134145940 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c700 tx=0x7fd12800cbd0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 shutdown_connections 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fd100078e50 0x7fd10007b310 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fd13415d220 0x7fd1340736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fd1340c92f0 0x7fd1340731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 --2- 10.20.193.10:0/1689794151 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fd134074920 0x7fd134145940 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 >> 10.20.193.10:0/1689794151 conn(0x7fd1340c9d80 msgr2=0x7fd134153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 shutdown_connections 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 -- 10.20.193.10:0/1689794151 wait complete. 2026-02-17T11:59:41.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:41.364+0000 7fd1397a9640 1 librados: shutdown 2026-02-17T11:59:44.375 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.440+0000 7f14366c7640 10 monclient: get_monmap_and_config 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.440+0000 7f14366c7640 10 monclient: build_initial_monmap 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.440+0000 7f14366c7640 10 monclient: monmap: 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:44.441780+0000 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:44.441780+0000 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:44.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.440+0000 7f14366c7640 1 Processor -- start 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 1 -- start start 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient: init 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient: _add_conns ranks=[0,3,5,2,4,1] 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1430152660 addr v1:10.20.193.10:6789/0 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f143015b030 0x7f14300c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient(hunting): picked mon.noname-a con 0x7f143015b030 addr v2:10.20.193.10:3300/0 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1430152a40 0x7f14300c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient(hunting): picked mon.noname-c con 0x7f1430152a40 addr v2:10.20.193.153:3300/0 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14300c71e0 con 0x7f1430152660 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f14300c77a0 con 0x7f143015b030 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f14300c74c0 con 0x7f1430152a40 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:44.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.441+0000 7f14366c7640 10 monclient(hunting): authenticate will time out at 1254.163802s 2026-02-17T11:59:44.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.442+0000 7f142ffff640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f1430152660 0x7f143015a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:45552/0 (socket says 10.20.193.10:45552) 2026-02-17T11:59:44.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.442+0000 7f142ffff640 1 -- 10.20.193.10:0/2660150132 learned_addr learned my addr 10.20.193.10:0/2660150132 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:59:44.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.442+0000 7f142f7fe640 1 --2- 10.20.193.10:0/2660150132 >> v2:10.20.193.10:3300/0 conn(0x7f143015b030 0x7f14300c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:44.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.442+0000 7f142f7fe640 10 monclient(hunting): get_auth_request con 0x7f143015b030 auth_method 0 2026-02-17T11:59:44.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.442+0000 7f142f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:44.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.442+0000 7f142f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:44.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.442+0000 7f142f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:44.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.443+0000 7f142f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:44.444 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.443+0000 7f142f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:44.445 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.443+0000 7f142f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:44.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.444+0000 7f142f7fe640 10 monclient(hunting): handle_auth_done global_id 4920 payload 274 2026-02-17T11:59:44.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.444+0000 7f142f7fe640 1 -- 10.20.193.10:0/2660150132 >> v2:10.20.193.153:3300/0 conn(0x7f1430152a40 msgr2=0x7f14300c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:44.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.444+0000 7f142f7fe640 1 --2- 10.20.193.10:0/2660150132 >> v2:10.20.193.153:3300/0 conn(0x7f1430152a40 0x7f14300c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.444+0000 7f142f7fe640 1 -- 10.20.193.10:0/2660150132 >> v1:10.20.193.10:6789/0 conn(0x7f1430152660 legacy=0x7f143015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:44.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.444+0000 7f142f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:44.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.444+0000 7f142f7fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:44.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.444+0000 7f142f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:44.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.444+0000 7f142f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:44.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.444+0000 7f142f7fe640 1 -- 10.20.193.10:0/2660150132 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1430159e40 con 0x7f143015b030 2026-02-17T11:59:44.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.446+0000 7f142f7fe640 1 --2- 10.20.193.10:0/2660150132 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f143015b030 0x7f14300c8dd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1430072150 tx=0x7f142002ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f424bb89de99a075 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:44.449 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.447+0000 7f142effd640 1 -- 10.20.193.10:0/2660150132 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142003c070 con 0x7f143015b030 2026-02-17T11:59:44.449 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.447+0000 7f142effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:44.449 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.447+0000 7f142effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:44.449 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.447+0000 7f142effd640 10 monclient: dump: 2026-02-17T11:59:44.449 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:44.449 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:44.449 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:44.449 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.447+0000 7f142effd640 10 monclient: _finish_auth 0 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.447+0000 7f142effd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.447+0000 7f142effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 5 monclient: authenticate success, global_id 4920 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f142effd640 1 -- 10.20.193.10:0/2660150132 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f142002faf0 con 0x7f143015b030 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f142effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f142effd640 1 -- 10.20.193.10:0/2660150132 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420037440 con 0x7f143015b030 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f142effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f142effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f142effd640 10 monclient: dump: 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:44.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 4 set_mon_vals no callback set 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 10 monclient: shutdown 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 1 -- 10.20.193.10:0/2660150132 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f143015b030 msgr2=0x7f14300c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 1 --2- 10.20.193.10:0/2660150132 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f143015b030 0x7f14300c8dd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1430072150 tx=0x7f142002ede0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 1 -- 10.20.193.10:0/2660150132 shutdown_connections 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 1 --2- 10.20.193.10:0/2660150132 >> v2:10.20.193.153:3300/0 conn(0x7f1430152a40 0x7f14300c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 1 --2- 10.20.193.10:0/2660150132 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f143015b030 0x7f14300c8dd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 1 -- 10.20.193.10:0/2660150132 >> 10.20.193.10:0/2660150132 conn(0x7f14300c9d80 msgr2=0x7f14300ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 1 -- 10.20.193.10:0/2660150132 shutdown_connections 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 1 -- 10.20.193.10:0/2660150132 wait complete. 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 10 monclient: build_initial_monmap 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.448+0000 7f14366c7640 10 monclient: monmap: 2026-02-17T11:59:44.451 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 librados: starting msgr at 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 librados: starting objecter 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 Processor -- start 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 -- start start 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 librados: setting wanted keys 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 librados: calling monclient init 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient: init 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1430152660 0x7f14301f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient(hunting): picked mon.noname-a con 0x7f1430152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1430152a40 0x7f14300c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient(hunting): picked mon.noname-c con 0x7f1430152a40 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f143015b030 0x7f14301582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient(hunting): picked mon.noname-b con 0x7f143015b030 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f14300c7c80 con 0x7f1430152660 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f143015a400 con 0x7f143015b030 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f14300c7e00 con 0x7f1430152a40 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.449+0000 7f14366c7640 10 monclient(hunting): authenticate will time out at 1254.171804s 2026-02-17T11:59:44.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1430152660 0x7f14301f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1430152660 0x7f14301f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57756/0 (socket says 10.20.193.10:57756) 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 1 -- 10.20.193.10:0/3290326338 learned_addr learned my addr 10.20.193.10:0/3290326338 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 10 monclient(hunting): get_auth_request con 0x7f1430152660 auth_method 0 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.450+0000 7f142ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 10 monclient(hunting): handle_auth_done global_id 4926 payload 824 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 1 -- 10.20.193.10:0/3290326338 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1430152a40 msgr2=0x7f14300c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1430152a40 0x7f14300c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 1 -- 10.20.193.10:0/3290326338 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f143015b030 msgr2=0x7f14301582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f143015b030 0x7f14301582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 1 monclient: found mon.noname-a 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:44.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.451+0000 7f142ffff640 1 -- 10.20.193.10:0/3290326338 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14301f7940 con 0x7f1430152660 2026-02-17T11:59:44.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.452+0000 7f142ffff640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1430152660 0x7f14301f4380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f141c00c520 tx=0x7f141c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:44.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.452+0000 7f142cff9640 10 client.?.objecter ms_handle_connect 0x7f1430152660 2026-02-17T11:59:44.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.452+0000 7f142cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 1 -- 10.20.193.10:0/3290326338 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c017070 con 0x7f1430152660 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 10 monclient: dump: 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 10 monclient: _finish_auth 0 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 1 -- 10.20.193.10:0/3290326338 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c005e00 con 0x7f1430152660 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 1 -- 10.20.193.10:0/3290326338 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c0072b0 con 0x7f1430152660 2026-02-17T11:59:44.456 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f14366c7640 5 monclient: authenticate success, global_id 4926 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142e7fc640 4 set_mon_vals no callback set 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f14366c7640 10 monclient: _renew_subs 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f14366c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14301f7c20 con 0x7f1430152660 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f142cff9640 10 monclient: dump: 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f14366c7640 10 client.4926.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f14366c7640 10 monclient: _renew_subs 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f14366c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1430157ac0 con 0x7f1430152660 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.454+0000 7f14366c7640 1 librados: init done 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.455+0000 7f14366c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.455+0000 7f14366c7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.455+0000 7f14366c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:44.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.455+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14301575d0 con 0x7f1430152660 2026-02-17T11:59:44.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.465+0000 7f142cff9640 1 -- 10.20.193.10:0/3290326338 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f141c007450 con 0x7f1430152660 2026-02-17T11:59:44.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.466+0000 7f142cff9640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1400078e00 0x7f140007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:44.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.466+0000 7f142f7fe640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1400078e00 0x7f140007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:44.467 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.466+0000 7f142f7fe640 10 monclient: get_auth_request con 0x7f1400078e00 auth_method 0 2026-02-17T11:59:44.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.466+0000 7f142f7fe640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1400078e00 0x7f140007b2c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1420039000 tx=0x7f1420031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:44.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.466+0000 7f142cff9640 10 client.4926.objecter ms_handle_connect 0x7f1400078e00 2026-02-17T11:59:44.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.467+0000 7f142cff9640 1 -- 10.20.193.10:0/3290326338 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f141c007770 con 0x7f1430152660 2026-02-17T11:59:44.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.467+0000 7f142cff9640 10 client.4926.objecter ms_dispatch2 0x7f1430000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:44.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.467+0000 7f142cff9640 3 client.4926.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:44.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.467+0000 7f142cff9640 3 client.4926.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:44.469 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.467+0000 7f142cff9640 20 client.4926.objecter dump_active .. 0 homeless 2026-02-17T11:59:44.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.569+0000 7f142cff9640 1 -- 10.20.193.10:0/3290326338 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f141c021070 con 0x7f1430152660 2026-02-17T11:59:44.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.569+0000 7f142cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:44.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.569+0000 7f142cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:44.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.667+0000 7f14366c7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:44.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.667+0000 7f14366c7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:44.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.667+0000 7f14366c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:44.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.667+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f143015a920 con 0x7f1430152660 2026-02-17T11:59:44.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.669+0000 7f142cff9640 1 -- 10.20.193.10:0/3290326338 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f141c061e40 con 0x7f1430152660 2026-02-17T11:59:44.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.669+0000 7f142cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:44.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.669+0000 7f142cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:44.672 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:44.672 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:44.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 10 librados: watch_flush enter 2026-02-17T11:59:44.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 10 librados: watch_flush exit 2026-02-17T11:59:44.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 20 client.4926.objecter shutdown clearing up homeless session... 2026-02-17T11:59:44.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 10 client.4926.objecter successfully canceled tick 2026-02-17T11:59:44.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1400078e00 msgr2=0x7f140007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1400078e00 0x7f140007b2c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1420039000 tx=0x7f1420031000 comp rx=0 tx=0).stop 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 10 monclient: shutdown 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1430152660 msgr2=0x7f14301f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1430152660 0x7f14301f4380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f141c00c520 tx=0x7f141c00c9f0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 shutdown_connections 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1400078e00 0x7f140007b2c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f143015b030 0x7f14301582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1430152a40 0x7f14300c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 --2- 10.20.193.10:0/3290326338 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1430152660 0x7f14301f4380 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:44.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 >> 10.20.193.10:0/3290326338 conn(0x7f14300c9d80 msgr2=0x7f143014afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:44.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 shutdown_connections 2026-02-17T11:59:44.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 -- 10.20.193.10:0/3290326338 wait complete. 2026-02-17T11:59:44.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:44.670+0000 7f14366c7640 1 librados: shutdown 2026-02-17T11:59:47.681 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:47.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.750+0000 7f8aa3185640 10 monclient: get_monmap_and_config 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.750+0000 7f8aa3185640 10 monclient: build_initial_monmap 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.750+0000 7f8aa3185640 10 monclient: monmap: 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:47.752218+0000 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:47.752218+0000 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:47.753 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.751+0000 7f8aa3185640 1 Processor -- start 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.751+0000 7f8aa3185640 1 -- start start 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.751+0000 7f8aa3185640 10 monclient: init 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 10 monclient: _add_conns ranks=[3,4,1,0,2,5] 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f8a9c155e80 0x7f8a9c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 10 monclient(hunting): picked mon.noname-a con 0x7f8a9c155e80 addr v2:10.20.193.10:3300/0 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8a9c156260 0x7f8a9c074b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 10 monclient(hunting): picked mon.noname-b con 0x7f8a9c156260 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f8a9c0ccbc0 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9c073520 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f8a9c0cd840 con 0x7f8a9c155e80 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8a9c073800 con 0x7f8a9c156260 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:47.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8aa3185640 10 monclient(hunting): authenticate will time out at 1257.474276s 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.752+0000 7f8a93fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8a9c156260 0x7f8a9c074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.753+0000 7f8a93fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f8a9c156260 0x7f8a9c074b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:38922/0 (socket says 10.20.193.10:38922) 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.753+0000 7f8a93fff640 1 -- 10.20.193.10:0/2742642424 learned_addr learned my addr 10.20.193.10:0/2742642424 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.753+0000 7f8a93fff640 10 monclient(hunting): get_auth_request con 0x7f8a9c156260 auth_method 0 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.753+0000 7f8a93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.753+0000 7f8a93fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.753+0000 7f8a93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.753+0000 7f8a93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.753+0000 7f8a93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:47.755 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.753+0000 7f8a93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:47.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.754+0000 7f8a93fff640 10 monclient(hunting): handle_auth_done global_id 4963 payload 274 2026-02-17T11:59:47.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.754+0000 7f8a93fff640 1 -- 10.20.193.10:0/2742642424 >> v2:10.20.193.10:3300/0 conn(0x7f8a9c155e80 msgr2=0x7f8a9c0745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:47.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.754+0000 7f8a93fff640 1 --2- 10.20.193.10:0/2742642424 >> v2:10.20.193.10:3300/0 conn(0x7f8a9c155e80 0x7f8a9c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.754+0000 7f8a93fff640 1 -- 10.20.193.10:0/2742642424 >> v1:10.20.193.71:6789/0 conn(0x7f8a9c0ccbc0 legacy=0x7f8a9c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:47.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.754+0000 7f8a93fff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:47.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.754+0000 7f8a93fff640 1 monclient: found mon.noname-b 2026-02-17T11:59:47.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.754+0000 7f8a93fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:47.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.754+0000 7f8a93fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:47.756 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.754+0000 7f8a93fff640 1 -- 10.20.193.10:0/2742642424 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c073ae0 con 0x7f8a9c156260 2026-02-17T11:59:47.757 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.756+0000 7f8a93fff640 1 --2- 10.20.193.10:0/2742642424 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c156260 0x7f8a9c074b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c08f5e0 tx=0x7f8a8402eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55db7864200d5792 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:47.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 1 -- 10.20.193.10:0/2742642424 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8403c070 con 0x7f8a9c156260 2026-02-17T11:59:47.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:47.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:47.766 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 10 monclient: dump: 2026-02-17T11:59:47.766 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:47.766 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:47.766 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:47.766 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:47.766 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:47.766 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 10 monclient: _finish_auth 0 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 10 monclient: _check_auth_tickets 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 1 -- 10.20.193.10:0/2742642424 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8402fb40 con 0x7f8a9c156260 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 1 -- 10.20.193.10:0/2742642424 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84037440 con 0x7f8a9c156260 2026-02-17T11:59:47.767 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8aa3185640 5 monclient: authenticate success, global_id 4963 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8aa3185640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8aa3185640 4 set_mon_vals no callback set 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.758+0000 7f8a937fe640 10 monclient: dump: 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:47.768 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 10 monclient: shutdown 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 1 -- 10.20.193.10:0/2742642424 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c156260 msgr2=0x7f8a9c074b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 1 --2- 10.20.193.10:0/2742642424 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c156260 0x7f8a9c074b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c08f5e0 tx=0x7f8a8402eed0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 1 -- 10.20.193.10:0/2742642424 shutdown_connections 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 1 --2- 10.20.193.10:0/2742642424 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c156260 0x7f8a9c074b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 1 --2- 10.20.193.10:0/2742642424 >> v2:10.20.193.10:3300/0 conn(0x7f8a9c155e80 0x7f8a9c0745c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 1 -- 10.20.193.10:0/2742642424 >> 10.20.193.10:0/2742642424 conn(0x7f8a9c0ce2b0 msgr2=0x7f8a9c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 1 -- 10.20.193.10:0/2742642424 shutdown_connections 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 1 -- 10.20.193.10:0/2742642424 wait complete. 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 10 monclient: build_initial_monmap 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.759+0000 7f8aa3185640 10 monclient: monmap: 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:47.770 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 librados: starting msgr at 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 librados: starting objecter 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 Processor -- start 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 -- start start 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 librados: setting wanted keys 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 librados: calling monclient init 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient: init 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c0ccbc0 0x7f8a9c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:47.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient(hunting): picked mon.noname-b con 0x7f8a9c0ccbc0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8a9c155e80 0x7f8a9c1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient(hunting): picked mon.noname-a con 0x7f8a9c155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8a9c156260 0x7f8a9c0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient(hunting): picked mon.noname-c con 0x7f8a9c156260 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0c4870 con 0x7f8a9c155e80 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0740a0 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0c49f0 con 0x7f8a9c156260 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa3185640 10 monclient(hunting): authenticate will time out at 1257.482611s 2026-02-17T11:59:47.772 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8a93fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8a9c155e80 0x7f8a9c1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8aa0efa640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c0ccbc0 0x7f8a9c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8a93fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8a9c155e80 0x7f8a9c1504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57762/0 (socket says 10.20.193.10:57762) 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8a93fff640 1 -- 10.20.193.10:0/2497630174 learned_addr learned my addr 10.20.193.10:0/2497630174 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8a93fff640 10 monclient(hunting): get_auth_request con 0x7f8a9c155e80 auth_method 0 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.760+0000 7f8a93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8a93fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8a93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa0efa640 10 monclient(hunting): get_auth_request con 0x7f8a9c0ccbc0 auth_method 0 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa0efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa0efa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:47.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa0efa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8a93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8a93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8a93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa0efa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa0efa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa0efa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa16fb640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8a9c156260 0x7f8a9c0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa16fb640 10 monclient(hunting): get_auth_request con 0x7f8a9c156260 auth_method 0 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa16fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa16fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa16fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa16fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:47.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa16fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.761+0000 7f8aa16fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 10 monclient(hunting): handle_auth_done global_id 4966 payload 824 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 1 -- 10.20.193.10:0/2497630174 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8a9c156260 msgr2=0x7f8a9c0c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8a9c156260 0x7f8a9c0c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 1 -- 10.20.193.10:0/2497630174 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8a9c155e80 msgr2=0x7f8a9c1504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8a9c155e80 0x7f8a9c1504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 10 monclient: _finish_hunting 0 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 1 monclient: found mon.noname-b 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.762+0000 7f8aa0efa640 1 -- 10.20.193.10:0/2497630174 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c0c7150 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.763+0000 7f8aa0efa640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c0ccbc0 0x7f8a9c0c8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00b550 tx=0x7f8a8c00ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:47.775 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.763+0000 7f8a917fa640 10 client.?.objecter ms_handle_connect 0x7f8a9c0ccbc0 2026-02-17T11:59:47.776 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.763+0000 7f8a917fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:47.777 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8a917fa640 1 -- 10.20.193.10:0/2497630174 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c013020 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8a917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8a917fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8a917fa640 10 monclient: dump: 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:47.778 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8a917fa640 10 monclient: _finish_auth 0 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8a917fa640 10 monclient: _check_auth_tickets 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8a917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8aa3185640 5 monclient: authenticate success, global_id 4966 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8aa3185640 10 monclient: _renew_subs 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8aa3185640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c0c9070 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8aa3185640 10 client.4966.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8aa3185640 10 monclient: _renew_subs 2026-02-17T11:59:47.779 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8aa3185640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c0c9620 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.764+0000 7f8aa3185640 1 librados: init done 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8aa3185640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8aa3185640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8aa3185640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9c074e30 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8a917fa640 1 -- 10.20.193.10:0/2497630174 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8c004480 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8a917fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8a917fa640 1 -- 10.20.193.10:0/2497630174 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c002900 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8a917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8a917fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8a92ffd640 4 set_mon_vals no callback set 2026-02-17T11:59:47.780 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.765+0000 7f8a917fa640 10 monclient: dump: 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:47.781 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:47.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.872+0000 7f8a917fa640 1 -- 10.20.193.10:0/2497630174 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f8a8c018400 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.872+0000 7f8a917fa640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8a6c078e30 0x7f8a6c07b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:47.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.872+0000 7f8a93fff640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8a6c078e30 0x7f8a6c07b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:47.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.872+0000 7f8a93fff640 10 monclient: get_auth_request con 0x7f8a6c078e30 auth_method 0 2026-02-17T11:59:47.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.873+0000 7f8a93fff640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8a6c078e30 0x7f8a6c07b2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c1537e0 tx=0x7f8a84033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:47.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.873+0000 7f8a917fa640 10 client.4966.objecter ms_handle_connect 0x7f8a6c078e30 2026-02-17T11:59:47.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.873+0000 7f8a917fa640 1 -- 10.20.193.10:0/2497630174 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f8a8c05dcf0 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.873+0000 7f8a917fa640 10 client.4966.objecter ms_dispatch2 0x7f8a9c000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:47.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.873+0000 7f8a917fa640 3 client.4966.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:47.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.873+0000 7f8a917fa640 3 client.4966.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:47.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.873+0000 7f8a917fa640 20 client.4966.objecter dump_active .. 0 homeless 2026-02-17T11:59:47.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.879+0000 7f8a917fa640 1 -- 10.20.193.10:0/2497630174 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8a9c074e30 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.879+0000 7f8a917fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:47.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.879+0000 7f8a917fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:47.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.978+0000 7f8aa3185640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:47.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.978+0000 7f8aa3185640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:47.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.978+0000 7f8aa3185640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T11:59:47.981 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.978+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8a9c0c6f40 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8a917fa640 1 -- 10.20.193.10:0/2497630174 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f8a8c01d020 con 0x7f8a9c0ccbc0 2026-02-17T11:59:47.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8a917fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:47.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8a917fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:47.984 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:47.984 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:47.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 10 librados: watch_flush enter 2026-02-17T11:59:47.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 10 librados: watch_flush exit 2026-02-17T11:59:47.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 20 client.4966.objecter shutdown clearing up homeless session... 2026-02-17T11:59:47.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 10 client.4966.objecter successfully canceled tick 2026-02-17T11:59:47.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8a6c078e30 msgr2=0x7f8a6c07b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:47.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8a6c078e30 0x7f8a6c07b2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c1537e0 tx=0x7f8a84033000 comp rx=0 tx=0).stop 2026-02-17T11:59:47.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 10 monclient: shutdown 2026-02-17T11:59:47.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:47.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c0ccbc0 msgr2=0x7f8a9c0c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:47.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c0ccbc0 0x7f8a9c0c8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00b550 tx=0x7f8a8c00ba20 comp rx=0 tx=0).stop 2026-02-17T11:59:47.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 shutdown_connections 2026-02-17T11:59:47.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8a6c078e30 0x7f8a6c07b2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8a9c156260 0x7f8a9c0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f8a9c155e80 0x7f8a9c1504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 --2- 10.20.193.10:0/2497630174 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f8a9c0ccbc0 0x7f8a9c0c8b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:47.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 >> 10.20.193.10:0/2497630174 conn(0x7f8a9c0ce2b0 msgr2=0x7f8a9c1e7330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:47.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 shutdown_connections 2026-02-17T11:59:47.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.982+0000 7f8aa3185640 1 -- 10.20.193.10:0/2497630174 wait complete. 2026-02-17T11:59:47.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:47.983+0000 7f8aa3185640 1 librados: shutdown 2026-02-17T11:59:50.994 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.060+0000 7fc587fd3640 10 monclient: get_monmap_and_config 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.060+0000 7fc587fd3640 10 monclient: build_initial_monmap 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.060+0000 7fc587fd3640 10 monclient: monmap: 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:51.061863+0000 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:51.061863+0000 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:51.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 1 Processor -- start 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 1 -- start start 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient: init 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient: _add_conns ranks=[5,4,3,0,2,1] 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc58015d220 0x7fc58015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient(hunting): picked mon.noname-c con 0x7fc58015d220 addr v2:10.20.193.153:3300/0 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fc580074920 0x7fc5800c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient(hunting): picked mon.noname-b con 0x7fc580074920 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc5800c9120 0x7fc580153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient(hunting): picked mon.noname-a con 0x7fc5800c9120 addr v2:10.20.193.10:3300/0 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fc5800c95b0 con 0x7fc5800c9120 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc5800c58a0 con 0x7fc580074920 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc5800c55c0 con 0x7fc58015d220 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.061+0000 7fc587fd3640 10 monclient(hunting): authenticate will time out at 1260.783591s 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc5800c9120 0x7fc580153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:51.063 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585547640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fc580074920 0x7fc5800c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc5800c9120 0x7fc580153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57766/0 (socket says 10.20.193.10:57766) 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 1 -- 10.20.193.10:0/494691893 learned_addr learned my addr 10.20.193.10:0/494691893 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 10 monclient(hunting): get_auth_request con 0x7fc5800c9120 auth_method 0 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585d48640 1 --2- 10.20.193.10:0/494691893 >> v2:10.20.193.153:3300/0 conn(0x7fc58015d220 0x7fc58015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585547640 10 monclient(hunting): get_auth_request con 0x7fc580074920 auth_method 0 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585547640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585547640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585d48640 10 monclient(hunting): get_auth_request con 0x7fc58015d220 auth_method 0 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585d48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585d48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585d48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc586549640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585547640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585d48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.062+0000 7fc585d48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:51.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc585d48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 10 monclient(hunting): handle_auth_done global_id 4932 payload 274 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 1 -- 10.20.193.10:0/494691893 >> v2:10.20.193.153:3300/0 conn(0x7fc58015d220 msgr2=0x7fc58015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 1 --2- 10.20.193.10:0/494691893 >> v2:10.20.193.153:3300/0 conn(0x7fc58015d220 0x7fc58015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 1 -- 10.20.193.10:0/494691893 >> v2:10.20.193.71:3300/0 conn(0x7fc580074920 msgr2=0x7fc5800c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 1 --2- 10.20.193.10:0/494691893 >> v2:10.20.193.71:3300/0 conn(0x7fc580074920 0x7fc5800c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 10 monclient: _finish_hunting 0 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 1 monclient: found mon.noname-a 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.063+0000 7fc586549640 1 -- 10.20.193.10:0/494691893 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5800c7e20 con 0x7fc5800c9120 2026-02-17T11:59:51.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.064+0000 7fc586549640 1 --2- 10.20.193.10:0/494691893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 0x7fc580153650 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc580076d10 tx=0x7fc57c02f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d7b93c6a26de9d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 1 -- 10.20.193.10:0/494691893 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c02fce0 con 0x7fc5800c9120 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 10 monclient: dump: 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 10 monclient: _finish_auth 0 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 10 monclient: _check_auth_tickets 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 5 monclient: authenticate success, global_id 4932 2026-02-17T11:59:51.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 1 -- 10.20.193.10:0/494691893 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57c0373f0 con 0x7fc5800c9120 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 1 -- 10.20.193.10:0/494691893 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0377c0 con 0x7fc5800c9120 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 4 set_mon_vals no callback set 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc584d46640 10 monclient: dump: 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 10 monclient: shutdown 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 1 -- 10.20.193.10:0/494691893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 msgr2=0x7fc580153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 1 --2- 10.20.193.10:0/494691893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 0x7fc580153650 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc580076d10 tx=0x7fc57c02f270 comp rx=0 tx=0).stop 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 1 -- 10.20.193.10:0/494691893 shutdown_connections 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 1 --2- 10.20.193.10:0/494691893 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 0x7fc580153650 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 1 --2- 10.20.193.10:0/494691893 >> v2:10.20.193.71:3300/0 conn(0x7fc580074920 0x7fc5800c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 1 --2- 10.20.193.10:0/494691893 >> v2:10.20.193.153:3300/0 conn(0x7fc58015d220 0x7fc58015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 1 -- 10.20.193.10:0/494691893 >> 10.20.193.10:0/494691893 conn(0x7fc5800c9d80 msgr2=0x7fc5800ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 1 -- 10.20.193.10:0/494691893 shutdown_connections 2026-02-17T11:59:51.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.066+0000 7fc587fd3640 1 -- 10.20.193.10:0/494691893 wait complete. 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.067+0000 7fc587fd3640 10 monclient: build_initial_monmap 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.067+0000 7fc587fd3640 10 monclient: monmap: 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.067+0000 7fc587fd3640 1 librados: starting msgr at 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.067+0000 7fc587fd3640 1 librados: starting objecter 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.067+0000 7fc587fd3640 1 Processor -- start 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.067+0000 7fc587fd3640 1 -- start start 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.067+0000 7fc587fd3640 1 librados: setting wanted keys 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.067+0000 7fc587fd3640 1 librados: calling monclient init 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.067+0000 7fc587fd3640 10 monclient: init 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc580074920 0x7fc5801f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient(hunting): picked mon.noname-b con 0x7fc580074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 0x7fc580152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient(hunting): picked mon.noname-a con 0x7fc5800c9120 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc58015d220 0x7fc5801f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient(hunting): picked mon.noname-c con 0x7fc58015d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc5800c86c0 con 0x7fc5800c9120 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5800c83e0 con 0x7fc580074920 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc580074d70 con 0x7fc58015d220 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc587fd3640 10 monclient(hunting): authenticate will time out at 1260.790180s 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 0x7fc580152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:51.070 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585d48640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc580074920 0x7fc5801f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc586549640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc58015d220 0x7fc5801f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 0x7fc580152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:57778/0 (socket says 10.20.193.10:57778) 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 1 -- 10.20.193.10:0/1377573576 learned_addr learned my addr 10.20.193.10:0/1377573576 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 10 monclient(hunting): get_auth_request con 0x7fc5800c9120 auth_method 0 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585d48640 10 monclient(hunting): get_auth_request con 0x7fc580074920 auth_method 0 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585d48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585d48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585d48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc586549640 10 monclient(hunting): get_auth_request con 0x7fc58015d220 auth_method 0 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc586549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc586549640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc586549640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.068+0000 7fc585547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.069+0000 7fc585d48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.069+0000 7fc585d48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.069+0000 7fc585d48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.069+0000 7fc586549640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.069+0000 7fc586549640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:51.071 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.069+0000 7fc586549640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 10 monclient(hunting): handle_auth_done global_id 5000 payload 824 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 1 -- 10.20.193.10:0/1377573576 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc580074920 msgr2=0x7fc5801f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc580074920 0x7fc5801f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 1 -- 10.20.193.10:0/1377573576 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 msgr2=0x7fc580152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 0x7fc580152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 10 monclient: _finish_hunting 0 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 1 monclient: found mon.noname-c 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T11:59:51.072 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.070+0000 7fc586549640 1 -- 10.20.193.10:0/1377573576 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5801f75f0 con 0x7fc58015d220 2026-02-17T11:59:51.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.071+0000 7fc586549640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc58015d220 0x7fc5801f49a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc57c035000 tx=0x7fc57c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:51.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.071+0000 7fc56e7fc640 10 client.?.objecter ms_handle_connect 0x7fc58015d220 2026-02-17T11:59:51.073 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.071+0000 7fc56e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.072+0000 7fc56e7fc640 1 -- 10.20.193.10:0/1377573576 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c046020 con 0x7fc58015d220 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 10 monclient: dump: 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:51.074 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 5 monclient: authenticate success, global_id 5000 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 10 monclient: _renew_subs 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5800739a0 con 0x7fc58015d220 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 10 client.5000.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 10 monclient: _renew_subs 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc580073f60 con 0x7fc58015d220 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 1 librados: init done 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 1 -- 10.20.193.10:0/1377573576 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57c0373f0 con 0x7fc58015d220 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 1 -- 10.20.193.10:0/1377573576 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c009510 con 0x7fc58015d220 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56ffff640 4 set_mon_vals no callback set 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc56e7fc640 10 monclient: dump: 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:51.075 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:51.076 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:51.076 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.073+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5800c8be0 con 0x7fc58015d220 2026-02-17T11:59:51.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.181+0000 7fc56e7fc640 1 -- 10.20.193.10:0/1377573576 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc57c041450 con 0x7fc58015d220 2026-02-17T11:59:51.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.182+0000 7fc56e7fc640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc550078e30 0x7fc55007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:51.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.182+0000 7fc585d48640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc550078e30 0x7fc55007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:51.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.182+0000 7fc585d48640 10 monclient: get_auth_request con 0x7fc550078e30 auth_method 0 2026-02-17T11:59:51.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.182+0000 7fc585d48640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc550078e30 0x7fc55007b2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc570009b20 tx=0x7fc570009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:51.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.182+0000 7fc56e7fc640 10 client.5000.objecter ms_handle_connect 0x7fc550078e30 2026-02-17T11:59:51.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.182+0000 7fc56e7fc640 1 -- 10.20.193.10:0/1377573576 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc57c0836c0 con 0x7fc58015d220 2026-02-17T11:59:51.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.182+0000 7fc56e7fc640 10 client.5000.objecter ms_dispatch2 0x7fc580000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:51.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.182+0000 7fc56e7fc640 3 client.5000.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:51.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.182+0000 7fc56e7fc640 3 client.5000.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:51.184 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.183+0000 7fc56e7fc640 20 client.5000.objecter dump_active .. 0 homeless 2026-02-17T11:59:51.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.189+0000 7fc56e7fc640 1 -- 10.20.193.10:0/1377573576 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc57c050030 con 0x7fc58015d220 2026-02-17T11:59:51.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.189+0000 7fc56e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:51.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.189+0000 7fc56e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:51.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.287+0000 7fc587fd3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:51.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.287+0000 7fc587fd3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:51.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.287+0000 7fc587fd3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T11:59:51.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.287+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc5800ca3d0 con 0x7fc58015d220 2026-02-17T11:59:51.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc56e7fc640 1 -- 10.20.193.10:0/1377573576 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fc5801f75f0 con 0x7fc58015d220 2026-02-17T11:59:51.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc56e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:51.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc56e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:51.292 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:51.293 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:51.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 10 librados: watch_flush enter 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 10 librados: watch_flush exit 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 20 client.5000.objecter shutdown clearing up homeless session... 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 10 client.5000.objecter successfully canceled tick 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc550078e30 msgr2=0x7fc55007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc550078e30 0x7fc55007b2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc570009b20 tx=0x7fc570009290 comp rx=0 tx=0).stop 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 10 monclient: shutdown 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc58015d220 msgr2=0x7fc5801f49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc58015d220 0x7fc5801f49a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc57c035000 tx=0x7fc57c004b40 comp rx=0 tx=0).stop 2026-02-17T11:59:51.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 shutdown_connections 2026-02-17T11:59:51.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc550078e30 0x7fc55007b2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc58015d220 0x7fc5801f49a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc5800c9120 0x7fc580152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 --2- 10.20.193.10:0/1377573576 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc580074920 0x7fc5801f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:51.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.290+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 >> 10.20.193.10:0/1377573576 conn(0x7fc5800c9d80 msgr2=0x7fc5801510e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:51.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.291+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 shutdown_connections 2026-02-17T11:59:51.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.291+0000 7fc587fd3640 1 -- 10.20.193.10:0/1377573576 wait complete. 2026-02-17T11:59:51.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:51.291+0000 7fc587fd3640 1 librados: shutdown 2026-02-17T11:59:54.301 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.370+0000 7fcffa81a640 10 monclient: get_monmap_and_config 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.370+0000 7fcffa81a640 10 monclient: build_initial_monmap 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.370+0000 7fcffa81a640 10 monclient: monmap: 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:54.371728+0000 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:54.371728+0000 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:54.372 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.370+0000 7fcffa81a640 1 Processor -- start 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.370+0000 7fcffa81a640 1 -- start start 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.370+0000 7fcffa81a640 10 monclient: init 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 10 monclient: _add_conns ranks=[4,2,0,1,3,5] 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fcff415d220 0x7fcff415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 10 monclient(hunting): picked mon.noname-b con 0x7fcff415d220 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcff4074920 addr v1:10.20.193.153:6789/0 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcff40c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff40c58a0 con 0x7fcff40c92f0 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff40c55c0 con 0x7fcff4074920 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcff40c7e20 con 0x7fcff415d220 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcffa81a640 10 monclient(hunting): authenticate will time out at 1264.093446s 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcff8d90640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fcff40c92f0 0x7fcff4153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:57940/0 (socket says 10.20.193.10:57940) 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcff8d90640 1 -- 10.20.193.10:0/496501751 learned_addr learned my addr 10.20.193.10:0/496501751 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.371+0000 7fcff3fff640 1 --2- 10.20.193.10:0/496501751 >> v2:10.20.193.71:3300/0 conn(0x7fcff415d220 0x7fcff415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff3fff640 10 monclient(hunting): get_auth_request con 0x7fcff415d220 auth_method 0 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:54.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff2ffd640 1 -- 10.20.193.10:0/496501751 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700311371 0 0) 0x7fcff40c58a0 con 0x7fcff40c92f0 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff2ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff2ffd640 10 monclient(hunting): my global_id is 4938 2026-02-17T11:59:54.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.372+0000 7fcff2ffd640 1 -- 10.20.193.10:0/496501751 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfd8003620 con 0x7fcff40c92f0 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff2ffd640 1 -- 10.20.193.10:0/496501751 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178448500 0 0) 0x7fcff40c55c0 con 0x7fcff4074920 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff2ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff2ffd640 10 monclient(hunting): my global_id is 5003 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff2ffd640 1 -- 10.20.193.10:0/496501751 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcff40c58a0 con 0x7fcff4074920 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff3fff640 10 monclient(hunting): handle_auth_done global_id 4975 payload 274 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff3fff640 1 -- 10.20.193.10:0/496501751 >> v1:10.20.193.153:6789/0 conn(0x7fcff4074920 legacy=0x7fcff40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff3fff640 1 -- 10.20.193.10:0/496501751 >> v1:10.20.193.10:6789/0 conn(0x7fcff40c92f0 legacy=0x7fcff4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff3fff640 1 monclient: found mon.noname-b 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T11:59:54.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.373+0000 7fcff3fff640 1 -- 10.20.193.10:0/496501751 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff40c8100 con 0x7fcff415d220 2026-02-17T11:59:54.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.374+0000 7fcff3fff640 1 --2- 10.20.193.10:0/496501751 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcff415d220 0x7fcff415d600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00098d0 tx=0x7fcfe002eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be21bc8cb93f77fa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:54.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 1 -- 10.20.193.10:0/496501751 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe003c070 con 0x7fcff415d220 2026-02-17T11:59:54.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:54.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 10 monclient: dump: 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcffa81a640 5 monclient: authenticate success, global_id 4975 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 1 -- 10.20.193.10:0/496501751 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe002fba0 con 0x7fcff415d220 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcffa81a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcffa81a640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 1 -- 10.20.193.10:0/496501751 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0037440 con 0x7fcff415d220 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcffa81a640 4 set_mon_vals no callback set 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.376+0000 7fcff2ffd640 10 monclient: dump: 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:54.379 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:54.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 10 monclient: shutdown 2026-02-17T11:59:54.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:54.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 -- 10.20.193.10:0/496501751 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcff415d220 msgr2=0x7fcff415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:54.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 --2- 10.20.193.10:0/496501751 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcff415d220 0x7fcff415d600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00098d0 tx=0x7fcfe002eed0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 -- 10.20.193.10:0/496501751 shutdown_connections 2026-02-17T11:59:54.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 --2- 10.20.193.10:0/496501751 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcff415d220 0x7fcff415d600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 -- 10.20.193.10:0/496501751 >> 10.20.193.10:0/496501751 conn(0x7fcff40c9d80 msgr2=0x7fcff40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:54.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 -- 10.20.193.10:0/496501751 shutdown_connections 2026-02-17T11:59:54.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 -- 10.20.193.10:0/496501751 wait complete. 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 10 monclient: build_initial_monmap 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 10 monclient: monmap: 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 librados: starting msgr at 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 librados: starting objecter 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 Processor -- start 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 -- start start 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 librados: setting wanted keys 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 1 librados: calling monclient init 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.377+0000 7fcffa81a640 10 monclient: init 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:54.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcff4074920 0x7fcff41487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient(hunting): picked mon.noname-a con 0x7fcff4074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcff40c92f0 0x7fcff41f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient(hunting): picked mon.noname-c con 0x7fcff40c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcff415d220 0x7fcff41f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient(hunting): picked mon.noname-b con 0x7fcff415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fcff4074d70 con 0x7fcff4074920 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcff40c86c0 con 0x7fcff415d220 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcff4153d60 con 0x7fcff40c92f0 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcffa81a640 10 monclient(hunting): authenticate will time out at 1264.100320s 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcff4074920 0x7fcff41487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcff4074920 0x7fcff41487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44830/0 (socket says 10.20.193.10:44830) 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 1 -- 10.20.193.10:0/2198040827 learned_addr learned my addr 10.20.193.10:0/2198040827 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 10 monclient(hunting): get_auth_request con 0x7fcff4074920 auth_method 0 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff37fe640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcff40c92f0 0x7fcff41f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff8d90640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcff415d220 0x7fcff41f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff37fe640 10 monclient(hunting): get_auth_request con 0x7fcff40c92f0 auth_method 0 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff8d90640 10 monclient(hunting): get_auth_request con 0x7fcff415d220 auth_method 0 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff8d90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff8d90640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.378+0000 7fcff8d90640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.379+0000 7fcff8d90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.379+0000 7fcff8d90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.379+0000 7fcff8d90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.379+0000 7fcff37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:54.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.379+0000 7fcff37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.379+0000 7fcff37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 10 monclient(hunting): handle_auth_done global_id 4941 payload 824 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 1 -- 10.20.193.10:0/2198040827 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcff40c92f0 msgr2=0x7fcff41f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcff40c92f0 0x7fcff41f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 1 -- 10.20.193.10:0/2198040827 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcff415d220 msgr2=0x7fcff41f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcff415d220 0x7fcff41f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 1 monclient: found mon.noname-a 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.380+0000 7fcff3fff640 1 -- 10.20.193.10:0/2198040827 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff414c9c0 con 0x7fcff4074920 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.381+0000 7fcff3fff640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcff4074920 0x7fcff41487c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcfe003a040 tx=0x7fcfe00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.381+0000 7fcff0ff9640 10 client.?.objecter ms_handle_connect 0x7fcff4074920 2026-02-17T11:59:54.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.381+0000 7fcff0ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:54.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 1 -- 10.20.193.10:0/2198040827 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe003c040 con 0x7fcff4074920 2026-02-17T11:59:54.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:54.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:54.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 10 monclient: dump: 2026-02-17T11:59:54.384 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:54.384 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:54.384 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 10 monclient: _finish_auth 0 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 1 -- 10.20.193.10:0/2198040827 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe002f9a0 con 0x7fcff4074920 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcffa81a640 5 monclient: authenticate success, global_id 4941 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcffa81a640 10 monclient: _renew_subs 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcffa81a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff414cca0 con 0x7fcff4074920 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 1 -- 10.20.193.10:0/2198040827 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0042670 con 0x7fcff4074920 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff27fc640 4 set_mon_vals no callback set 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcff0ff9640 10 monclient: dump: 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcffa81a640 10 client.4941.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcffa81a640 10 monclient: _renew_subs 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcffa81a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff414d260 con 0x7fcff4074920 2026-02-17T11:59:54.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.382+0000 7fcffa81a640 1 librados: init done 2026-02-17T11:59:54.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.383+0000 7fcffa81a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:54.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.383+0000 7fcffa81a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:54.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.383+0000 7fcffa81a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:54.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.383+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff415d600 con 0x7fcff4074920 2026-02-17T11:59:54.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.395+0000 7fcff0ff9640 1 -- 10.20.193.10:0/2198040827 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fcfe0042810 con 0x7fcff4074920 2026-02-17T11:59:54.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.395+0000 7fcff0ff9640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcfc4078e50 0x7fcfc407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:54.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.395+0000 7fcff37fe640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcfc4078e50 0x7fcfc407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:54.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.395+0000 7fcff37fe640 10 monclient: get_auth_request con 0x7fcfc4078e50 auth_method 0 2026-02-17T11:59:54.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.395+0000 7fcff37fe640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcfc4078e50 0x7fcfc407b310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcff41535f0 tx=0x7fcfe4003db0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:54.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.395+0000 7fcff0ff9640 10 client.4941.objecter ms_handle_connect 0x7fcfc4078e50 2026-02-17T11:59:54.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.396+0000 7fcff0ff9640 1 -- 10.20.193.10:0/2198040827 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fcfe002fb50 con 0x7fcff4074920 2026-02-17T11:59:54.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.396+0000 7fcff0ff9640 10 client.4941.objecter ms_dispatch2 0x7fcff4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:54.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.396+0000 7fcff0ff9640 3 client.4941.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:54.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.396+0000 7fcff0ff9640 3 client.4941.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:54.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.397+0000 7fcff0ff9640 20 client.4941.objecter dump_active .. 0 homeless 2026-02-17T11:59:54.500 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.498+0000 7fcff0ff9640 1 -- 10.20.193.10:0/2198040827 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcfe0087410 con 0x7fcff4074920 2026-02-17T11:59:54.500 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.500+0000 7fcff0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:54.500 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.500+0000 7fcff0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:54.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.599+0000 7fcffa81a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:54.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.599+0000 7fcffa81a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:54.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.599+0000 7fcffa81a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:54.601 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.599+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcff40c6050 con 0x7fcff4074920 2026-02-17T11:59:54.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.601+0000 7fcff0ff9640 1 -- 10.20.193.10:0/2198040827 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fcfe008b710 con 0x7fcff4074920 2026-02-17T11:59:54.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.602+0000 7fcff0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:54.603 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.602+0000 7fcff0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:54.603 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:54.603 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 10 librados: watch_flush enter 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 10 librados: watch_flush exit 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 20 client.4941.objecter shutdown clearing up homeless session... 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 10 client.4941.objecter successfully canceled tick 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcfc4078e50 msgr2=0x7fcfc407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcfc4078e50 0x7fcfc407b310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcff41535f0 tx=0x7fcfe4003db0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 10 monclient: shutdown 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcff4074920 msgr2=0x7fcff41487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcff4074920 0x7fcff41487c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcfe003a040 tx=0x7fcfe00047c0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 shutdown_connections 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcfc4078e50 0x7fcfc407b310 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcff415d220 0x7fcff41f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcff40c92f0 0x7fcff41f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 --2- 10.20.193.10:0/2198040827 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcff4074920 0x7fcff41487c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 >> 10.20.193.10:0/2198040827 conn(0x7fcff40c9d80 msgr2=0x7fcff414ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 shutdown_connections 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 -- 10.20.193.10:0/2198040827 wait complete. 2026-02-17T11:59:54.605 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:54.603+0000 7fcffa81a640 1 librados: shutdown 2026-02-17T11:59:55.349 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:06:12.517 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:55.351 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:06:12.519 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:55.358 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:06:12.527 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:55.379 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:06:12.542 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:55.379 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:06:12.508 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:55.381 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:06:12.510 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:55.382 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:06:12.545 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:55.389 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:06:12.518 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:55.389 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:06:12.553 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T11:59:57.614 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:59:57.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.681+0000 7fa6a9ad3640 10 monclient: get_monmap_and_config 2026-02-17T11:59:57.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.681+0000 7fa6a9ad3640 10 monclient: build_initial_monmap 2026-02-17T11:59:57.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.681+0000 7fa6a9ad3640 10 monclient: monmap: 2026-02-17T11:59:57.682 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:57.682 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:57.682 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:59:57.681959+0000 2026-02-17T11:59:57.682 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:59:57.681959+0000 2026-02-17T11:59:57.682 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:57.682 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 1 Processor -- start 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 1 -- start start 2026-02-17T11:59:57.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient: init 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient: _add_conns ranks=[1,4,3,2,5,0] 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa6a415d220 addr v1:10.20.193.71:6789/0 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa6a40c92f0 0x7fa6a415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient(hunting): picked mon.noname-b con 0x7fa6a40c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa6a4074920 0x7fa6a4153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient(hunting): picked mon.noname-a con 0x7fa6a4074920 addr v2:10.20.193.10:3300/0 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a40c58a0 con 0x7fa6a415d220 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a40c55c0 con 0x7fa6a4074920 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a40c7e20 con 0x7fa6a40c92f0 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.682+0000 7fa6a9ad3640 10 monclient(hunting): authenticate will time out at 1267.403786s 2026-02-17T11:59:57.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa6a4074920 0x7fa6a4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a2ffd640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa6a40c92f0 0x7fa6a415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa6a4074920 0x7fa6a4153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44840/0 (socket says 10.20.193.10:44840) 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 1 -- 10.20.193.10:0/1953603526 learned_addr learned my addr 10.20.193.10:0/1953603526 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 10 monclient(hunting): get_auth_request con 0x7fa6a4074920 auth_method 0 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a2ffd640 10 monclient(hunting): get_auth_request con 0x7fa6a40c92f0 auth_method 0 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.683+0000 7fa6a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.684+0000 7fa6a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.684+0000 7fa6a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:57.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.684+0000 7fa6a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.685+0000 7fa6a3fff640 10 monclient(hunting): handle_auth_done global_id 4944 payload 274 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.685+0000 7fa6a3fff640 1 -- 10.20.193.10:0/1953603526 >> v2:10.20.193.71:3300/0 conn(0x7fa6a40c92f0 msgr2=0x7fa6a415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.685+0000 7fa6a3fff640 1 --2- 10.20.193.10:0/1953603526 >> v2:10.20.193.71:3300/0 conn(0x7fa6a40c92f0 0x7fa6a415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.685+0000 7fa6a3fff640 1 -- 10.20.193.10:0/1953603526 >> v1:10.20.193.71:6789/0 conn(0x7fa6a415d220 legacy=0x7fa6a40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.685+0000 7fa6a3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.685+0000 7fa6a3fff640 1 monclient: found mon.noname-a 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.685+0000 7fa6a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.685+0000 7fa6a3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.685+0000 7fa6a3fff640 1 -- 10.20.193.10:0/1953603526 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a40c8100 con 0x7fa6a4074920 2026-02-17T11:59:57.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.686+0000 7fa6a3fff640 1 --2- 10.20.193.10:0/1953603526 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 0x7fa6a4153650 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa698009e50 tx=0x7fa69802f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5804702d36b11689 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 1 -- 10.20.193.10:0/1953603526 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69802fd60 con 0x7fa6a4074920 2026-02-17T11:59:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:57.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 10 monclient: dump: 2026-02-17T11:59:57.690 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:57.690 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:57.690 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:57.690 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 10 monclient: _finish_auth 0 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 5 monclient: authenticate success, global_id 4944 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 1 -- 10.20.193.10:0/1953603526 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6980373f0 con 0x7fa6a4074920 2026-02-17T11:59:57.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 1 -- 10.20.193.10:0/1953603526 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6980377c0 con 0x7fa6a4074920 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a27fc640 10 monclient: dump: 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:57.692 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 10 monclient: get_monmap_and_config success 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 4 set_mon_vals no callback set 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 10 monclient: shutdown 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/1953603526 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 msgr2=0x7fa6a4153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 1 --2- 10.20.193.10:0/1953603526 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 0x7fa6a4153650 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa698009e50 tx=0x7fa69802f2a0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/1953603526 shutdown_connections 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 1 --2- 10.20.193.10:0/1953603526 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 0x7fa6a4153650 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 1 --2- 10.20.193.10:0/1953603526 >> v2:10.20.193.71:3300/0 conn(0x7fa6a40c92f0 0x7fa6a415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/1953603526 >> 10.20.193.10:0/1953603526 conn(0x7fa6a40c9d80 msgr2=0x7fa6a40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/1953603526 shutdown_connections 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.688+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/1953603526 wait complete. 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient: build_initial_monmap 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient: monmap: 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T11:59:57.694 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T11:59:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T11:59:57.695 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 librados: starting msgr at 2026-02-17T11:59:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 librados: starting objecter 2026-02-17T11:59:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 Processor -- start 2026-02-17T11:59:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 -- start start 2026-02-17T11:59:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 librados: setting wanted keys 2026-02-17T11:59:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 librados: calling monclient init 2026-02-17T11:59:57.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient: init 2026-02-17T11:59:57.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient: _reopen_session rank -1 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 0x7fa6a41f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient(hunting): picked mon.noname-a con 0x7fa6a4074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa6a40c92f0 0x7fa6a41f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient(hunting): picked mon.noname-c con 0x7fa6a40c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa6a415d220 0x7fa6a41f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient(hunting): picked mon.noname-b con 0x7fa6a415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a4074d70 con 0x7fa6a4074920 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:57.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a40c86c0 con 0x7fa6a415d220 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a4153b90 con 0x7fa6a40c92f0 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient(hunting): _renew_subs 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.689+0000 7fa6a9ad3640 10 monclient(hunting): authenticate will time out at 1267.410878s 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 0x7fa6a41f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a3fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa6a415d220 0x7fa6a41f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 0x7fa6a41f4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44852/0 (socket says 10.20.193.10:44852) 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 1 -- 10.20.193.10:0/2466448860 learned_addr learned my addr 10.20.193.10:0/2466448860 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 10 monclient(hunting): get_auth_request con 0x7fa6a4074920 auth_method 0 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:57.701 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a2ffd640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa6a40c92f0 0x7fa6a41f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a3fff640 10 monclient(hunting): get_auth_request con 0x7fa6a415d220 auth_method 0 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a2ffd640 10 monclient(hunting): get_auth_request con 0x7fa6a40c92f0 auth_method 0 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:57.702 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.690+0000 7fa6a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.691+0000 7fa6a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.691+0000 7fa6a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.691+0000 7fa6a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 10 monclient(hunting): handle_auth_done global_id 4947 payload 824 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 1 -- 10.20.193.10:0/2466448860 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa6a40c92f0 msgr2=0x7fa6a41f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa6a40c92f0 0x7fa6a41f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 1 -- 10.20.193.10:0/2466448860 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa6a415d220 msgr2=0x7fa6a41f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa6a415d220 0x7fa6a41f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 1 monclient: found mon.noname-a 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.692+0000 7fa6a37fe640 1 -- 10.20.193.10:0/2466448860 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a414c1b0 con 0x7fa6a4074920 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.693+0000 7fa6a37fe640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 0x7fa6a41f4e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa69000c480 tx=0x7fa69000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.693+0000 7fa67ffff640 10 client.?.objecter ms_handle_connect 0x7fa6a4074920 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.693+0000 7fa67ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 1 -- 10.20.193.10:0/2466448860 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa690017070 con 0x7fa6a4074920 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 10 monclient: dump: 2026-02-17T11:59:57.704 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 10 monclient: _finish_auth 0 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:59:57.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 1 -- 10.20.193.10:0/2466448860 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6900052f0 con 0x7fa6a4074920 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 5 monclient: authenticate success, global_id 4947 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 10 monclient: _renew_subs 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a414c490 con 0x7fa6a4074920 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 1 -- 10.20.193.10:0/2466448860 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6900036f0 con 0x7fa6a4074920 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa67ffff640 10 monclient: dump: 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T11:59:57.706 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a1ffb640 4 set_mon_vals no callback set 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 10 client.4947.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 10 monclient: _renew_subs 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:57.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a414ca50 con 0x7fa6a4074920 2026-02-17T11:59:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 1 librados: init done 2026-02-17T11:59:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:57.708 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.695+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a4153f20 con 0x7fa6a4074920 2026-02-17T11:59:57.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.803+0000 7fa67ffff640 1 -- 10.20.193.10:0/2466448860 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fa690003890 con 0x7fa6a4074920 2026-02-17T11:59:57.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.804+0000 7fa67ffff640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa674078e50 0x7fa67407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:59:57.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.804+0000 7fa6a2ffd640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa674078e50 0x7fa67407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:59:57.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.804+0000 7fa6a2ffd640 10 monclient: get_auth_request con 0x7fa674078e50 auth_method 0 2026-02-17T11:59:57.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.804+0000 7fa67ffff640 10 client.4947.objecter ms_handle_connect 0x7fa674078e50 2026-02-17T11:59:57.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.804+0000 7fa6a2ffd640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa674078e50 0x7fa67407b310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa6a41f6e30 tx=0x7fa694009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:59:57.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.811+0000 7fa67ffff640 1 -- 10.20.193.10:0/2466448860 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fa69005d410 con 0x7fa6a4074920 2026-02-17T11:59:57.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.811+0000 7fa67ffff640 10 client.4947.objecter ms_dispatch2 0x7fa6a4000b90 osd_map(35..35 src has 1..35) 2026-02-17T11:59:57.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.811+0000 7fa67ffff640 3 client.4947.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T11:59:57.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.811+0000 7fa67ffff640 3 client.4947.objecter handle_osd_map decoding full epoch 35 2026-02-17T11:59:57.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.811+0000 7fa67ffff640 20 client.4947.objecter dump_active .. 0 homeless 2026-02-17T11:59:57.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.811+0000 7fa67ffff640 1 -- 10.20.193.10:0/2466448860 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa690021020 con 0x7fa6a4074920 2026-02-17T11:59:57.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.811+0000 7fa67ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:59:57.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.811+0000 7fa67ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:59:57.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.909+0000 7fa6a9ad3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:59:57.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.909+0000 7fa6a9ad3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:57.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.909+0000 7fa6a9ad3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T11:59:57.910 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.909+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa6a40c9b60 con 0x7fa6a4074920 2026-02-17T11:59:57.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.918+0000 7fa67ffff640 1 -- 10.20.193.10:0/2466448860 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fa6900613d0 con 0x7fa6a4074920 2026-02-17T11:59:57.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.918+0000 7fa67ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:59:57.919 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.918+0000 7fa67ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:59:57.919 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T11:59:57.919 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T11:59:57.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 10 librados: watch_flush enter 2026-02-17T11:59:57.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 10 librados: watch_flush exit 2026-02-17T11:59:57.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 20 client.4947.objecter shutdown clearing up homeless session... 2026-02-17T11:59:57.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 10 client.4947.objecter successfully canceled tick 2026-02-17T11:59:57.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa674078e50 msgr2=0x7fa67407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:57.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa674078e50 0x7fa67407b310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa6a41f6e30 tx=0x7fa694009290 comp rx=0 tx=0).stop 2026-02-17T11:59:57.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 10 monclient: shutdown 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 msgr2=0x7fa6a41f4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 0x7fa6a41f4e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa69000c480 tx=0x7fa69000c950 comp rx=0 tx=0).stop 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 shutdown_connections 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa674078e50 0x7fa67407b310 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa6a415d220 0x7fa6a41f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa6a40c92f0 0x7fa6a41f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 --2- 10.20.193.10:0/2466448860 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa6a4074920 0x7fa6a41f4e60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 >> 10.20.193.10:0/2466448860 conn(0x7fa6a40c9d80 msgr2=0x7fa6a4152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 shutdown_connections 2026-02-17T11:59:57.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 -- 10.20.193.10:0/2466448860 wait complete. 2026-02-17T11:59:57.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T11:59:57.919+0000 7fa6a9ad3640 1 librados: shutdown 2026-02-17T12:00:00.930 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.996+0000 7fa8ef64d640 10 monclient: get_monmap_and_config 2026-02-17T12:00:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.996+0000 7fa8ef64d640 10 monclient: build_initial_monmap 2026-02-17T12:00:00.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.996+0000 7fa8ef64d640 10 monclient: monmap: 2026-02-17T12:00:00.998 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:00.998 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:00.998 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:00.997096+0000 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:00.997096+0000 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 1 Processor -- start 2026-02-17T12:00:00.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 1 -- start start 2026-02-17T12:00:01.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient: init 2026-02-17T12:00:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient: _add_conns ranks=[0,4,3,1,5,2] 2026-02-17T12:00:01.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa8e815d220 addr v1:10.20.193.10:6789/0 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa8e80c92f0 0x7fa8e815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient(hunting): picked mon.noname-b con 0x7fa8e80c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa8e8074920 0x7fa8e8153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient(hunting): picked mon.noname-a con 0x7fa8e8074920 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e80c58a0 con 0x7fa8e815d220 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e80c55c0 con 0x7fa8e8074920 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e80c7e20 con 0x7fa8e80c92f0 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:01.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.997+0000 7fa8ef64d640 10 monclient(hunting): authenticate will time out at 1270.718844s 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa8e80c92f0 0x7fa8e815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8edbc3640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fa8e8074920 0x7fa8e8153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa8e80c92f0 0x7fa8e815d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:39646/0 (socket says 10.20.193.10:39646) 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 1 -- 10.20.193.10:0/720806168 learned_addr learned my addr 10.20.193.10:0/720806168 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 10 monclient(hunting): get_auth_request con 0x7fa8e80c92f0 auth_method 0 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8edbc3640 10 monclient(hunting): get_auth_request con 0x7fa8e8074920 auth_method 0 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8edbc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8edbc3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:01.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8edbc3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.998+0000 7fa8ecbc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8edbc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8edbc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8edbc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8ecbc1640 10 monclient(hunting): handle_auth_done global_id 4990 payload 274 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8ecbc1640 1 -- 10.20.193.10:0/720806168 >> v2:10.20.193.10:3300/0 conn(0x7fa8e8074920 msgr2=0x7fa8e8153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8ecbc1640 1 --2- 10.20.193.10:0/720806168 >> v2:10.20.193.10:3300/0 conn(0x7fa8e8074920 0x7fa8e8153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8ecbc1640 1 -- 10.20.193.10:0/720806168 >> v1:10.20.193.10:6789/0 conn(0x7fa8e815d220 legacy=0x7fa8e80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8ecbc1640 10 monclient: _finish_hunting 0 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8ecbc1640 1 monclient: found mon.noname-b 2026-02-17T12:00:01.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8ecbc1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8ecbc1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:00:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:00.999+0000 7fa8ecbc1640 1 -- 10.20.193.10:0/720806168 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e80c8100 con 0x7fa8e80c92f0 2026-02-17T12:00:01.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.000+0000 7fa8ecbc1640 1 --2- 10.20.193.10:0/720806168 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e80c92f0 0x7fa8e815d600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009970 tx=0x7fa8dc02eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3753be6858a53fc2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:01.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 1 -- 10.20.193.10:0/720806168 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc03c070 con 0x7fa8e80c92f0 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 10 monclient: dump: 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:01.012 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 10 monclient: _finish_auth 0 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 1 -- 10.20.193.10:0/720806168 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc02fbc0 con 0x7fa8e80c92f0 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 5 monclient: authenticate success, global_id 4990 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 1 -- 10.20.193.10:0/720806168 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc037440 con 0x7fa8e80c92f0 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 4 set_mon_vals no callback set 2026-02-17T12:00:01.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8d7fff640 10 monclient: dump: 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:01.014 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 10 monclient: shutdown 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 1 -- 10.20.193.10:0/720806168 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e80c92f0 msgr2=0x7fa8e815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 1 --2- 10.20.193.10:0/720806168 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e80c92f0 0x7fa8e815d600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009970 tx=0x7fa8dc02eef0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 1 -- 10.20.193.10:0/720806168 shutdown_connections 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 1 --2- 10.20.193.10:0/720806168 >> v2:10.20.193.10:3300/0 conn(0x7fa8e8074920 0x7fa8e8153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 1 --2- 10.20.193.10:0/720806168 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e80c92f0 0x7fa8e815d600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 1 -- 10.20.193.10:0/720806168 >> 10.20.193.10:0/720806168 conn(0x7fa8e80c9d80 msgr2=0x7fa8e80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 1 -- 10.20.193.10:0/720806168 shutdown_connections 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.002+0000 7fa8ef64d640 1 -- 10.20.193.10:0/720806168 wait complete. 2026-02-17T12:00:01.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient: build_initial_monmap 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient: monmap: 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:01.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 librados: starting msgr at 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 librados: starting objecter 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 Processor -- start 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 -- start start 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 librados: setting wanted keys 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 librados: calling monclient init 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient: init 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa8e8074920 0x7fa8e81f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient(hunting): picked mon.noname-a con 0x7fa8e8074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8e80c92f0 0x7fa8e8073b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient(hunting): picked mon.noname-c con 0x7fa8e80c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:01.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e815d220 0x7fa8e8070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient(hunting): picked mon.noname-b con 0x7fa8e815d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8074d70 con 0x7fa8e8074920 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e80c86c0 con 0x7fa8e815d220 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8153b90 con 0x7fa8e80c92f0 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.003+0000 7fa8ef64d640 10 monclient(hunting): authenticate will time out at 1270.724947s 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ed3c2640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa8e8074920 0x7fa8e81f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e815d220 0x7fa8e8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:01.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ecbc1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8e80c92f0 0x7fa8e8073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e815d220 0x7fa8e8070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:39660/0 (socket says 10.20.193.10:39660) 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ed3c2640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa8e8074920 0x7fa8e81f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44870/0 (socket says 10.20.193.10:44870) 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 1 -- 10.20.193.10:0/3173395476 learned_addr learned my addr 10.20.193.10:0/3173395476 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 10 monclient(hunting): get_auth_request con 0x7fa8e815d220 auth_method 0 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ed3c2640 10 monclient(hunting): get_auth_request con 0x7fa8e8074920 auth_method 0 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ed3c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ed3c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ed3c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:01.019 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ecbc1640 10 monclient(hunting): get_auth_request con 0x7fa8e80c92f0 auth_method 0 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ecbc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ecbc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ecbc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8edbc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ed3c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ed3c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ed3c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ecbc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ecbc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.004+0000 7fa8ecbc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:01.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 10 monclient(hunting): handle_auth_done global_id 4956 payload 824 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 1 -- 10.20.193.10:0/3173395476 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8e80c92f0 msgr2=0x7fa8e8073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8e80c92f0 0x7fa8e8073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 1 -- 10.20.193.10:0/3173395476 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e815d220 msgr2=0x7fa8e8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e815d220 0x7fa8e8070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 10 monclient: _finish_hunting 0 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 1 monclient: found mon.noname-a 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.006+0000 7fa8ed3c2640 1 -- 10.20.193.10:0/3173395476 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e8072a70 con 0x7fa8e8074920 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.007+0000 7fa8ed3c2640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa8e8074920 0x7fa8e81f5270 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800c430 tx=0x7fa8d800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.007+0000 7fa8d5ffb640 10 client.?.objecter ms_handle_connect 0x7fa8e8074920 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.007+0000 7fa8d5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:01.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 1 -- 10.20.193.10:0/3173395476 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80052d0 con 0x7fa8e8074920 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 10 monclient: dump: 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:01.022 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 1 -- 10.20.193.10:0/3173395476 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d8005470 con 0x7fa8e8074920 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8ef64d640 5 monclient: authenticate success, global_id 4956 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 1 -- 10.20.193.10:0/3173395476 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80038c0 con 0x7fa8e8074920 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d77fe640 4 set_mon_vals no callback set 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8d5ffb640 10 monclient: dump: 2026-02-17T12:00:01.023 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8ef64d640 10 monclient: _renew_subs 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8ef64d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:01.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.008+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e8072d50 con 0x7fa8e8074920 2026-02-17T12:00:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.009+0000 7fa8ef64d640 10 client.4956.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.009+0000 7fa8ef64d640 10 monclient: _renew_subs 2026-02-17T12:00:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.009+0000 7fa8ef64d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.009+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e8073310 con 0x7fa8e8074920 2026-02-17T12:00:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.009+0000 7fa8ef64d640 1 librados: init done 2026-02-17T12:00:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.009+0000 7fa8ef64d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.009+0000 7fa8ef64d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.009+0000 7fa8ef64d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:01.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.009+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e80c5330 con 0x7fa8e8074920 2026-02-17T12:00:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.020+0000 7fa8d5ffb640 1 -- 10.20.193.10:0/3173395476 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fa8d8003a60 con 0x7fa8e8074920 2026-02-17T12:00:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.021+0000 7fa8d5ffb640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa8b8078e50 0x7fa8b807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.021+0000 7fa8ecbc1640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa8b8078e50 0x7fa8b807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.021+0000 7fa8ecbc1640 10 monclient: get_auth_request con 0x7fa8b8078e50 auth_method 0 2026-02-17T12:00:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.021+0000 7fa8ecbc1640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa8b8078e50 0x7fa8b807b310 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8076d10 tx=0x7fa8dc039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.021+0000 7fa8d5ffb640 10 client.4956.objecter ms_handle_connect 0x7fa8b8078e50 2026-02-17T12:00:01.027 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.021+0000 7fa8d5ffb640 1 -- 10.20.193.10:0/3173395476 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fa8d805df30 con 0x7fa8e8074920 2026-02-17T12:00:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.021+0000 7fa8d5ffb640 10 client.4956.objecter ms_dispatch2 0x7fa8e8000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.021+0000 7fa8d5ffb640 3 client.4956.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.021+0000 7fa8d5ffb640 3 client.4956.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:01.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.022+0000 7fa8d5ffb640 20 client.4956.objecter dump_active .. 0 homeless 2026-02-17T12:00:01.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.120+0000 7fa8d5ffb640 1 -- 10.20.193.10:0/3173395476 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa8d8061ef0 con 0x7fa8e8074920 2026-02-17T12:00:01.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.120+0000 7fa8d5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:01.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.120+0000 7fa8d5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:01.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.218+0000 7fa8ef64d640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:01.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.218+0000 7fa8ef64d640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:01.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.218+0000 7fa8ef64d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:01.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.218+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa8e8153f70 con 0x7fa8e8074920 2026-02-17T12:00:01.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.221+0000 7fa8d5ffb640 1 -- 10.20.193.10:0/3173395476 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fa8d80661f0 con 0x7fa8e8074920 2026-02-17T12:00:01.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.221+0000 7fa8d5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:01.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.221+0000 7fa8d5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:01.223 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:01.223 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 10 librados: watch_flush enter 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 10 librados: watch_flush exit 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 20 client.4956.objecter shutdown clearing up homeless session... 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 10 client.4956.objecter successfully canceled tick 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa8b8078e50 msgr2=0x7fa8b807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa8b8078e50 0x7fa8b807b310 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8076d10 tx=0x7fa8dc039040 comp rx=0 tx=0).stop 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 10 monclient: shutdown 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa8e8074920 msgr2=0x7fa8e81f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:01.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa8e8074920 0x7fa8e81f5270 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800c430 tx=0x7fa8d800c900 comp rx=0 tx=0).stop 2026-02-17T12:00:01.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 shutdown_connections 2026-02-17T12:00:01.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa8b8078e50 0x7fa8b807b310 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa8e815d220 0x7fa8e8070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa8e80c92f0 0x7fa8e8073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 --2- 10.20.193.10:0/3173395476 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa8e8074920 0x7fa8e81f5270 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:01.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 >> 10.20.193.10:0/3173395476 conn(0x7fa8e80c9d80 msgr2=0x7fa8e806b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:01.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 shutdown_connections 2026-02-17T12:00:01.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 -- 10.20.193.10:0/3173395476 wait complete. 2026-02-17T12:00:01.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:01.222+0000 7fa8ef64d640 1 librados: shutdown 2026-02-17T12:00:04.233 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:04.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.301+0000 7f2685a0c640 10 monclient: get_monmap_and_config 2026-02-17T12:00:04.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.301+0000 7f2685a0c640 10 monclient: build_initial_monmap 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.301+0000 7f2685a0c640 10 monclient: monmap: 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:04.302570+0000 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:04.302570+0000 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:04.306 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.301+0000 7f2685a0c640 1 Processor -- start 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.301+0000 7f2685a0c640 1 -- start start 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.301+0000 7f2685a0c640 10 monclient: init 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 10 monclient: _add_conns ranks=[3,2,1,5,0,4] 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f2680155d30 0x7f26800cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 10 monclient(hunting): picked mon.noname-a con 0x7f2680155d30 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2680156110 addr v1:10.20.193.153:6789/0 2026-02-17T12:00:04.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f26800c8e60 addr v1:10.20.193.71:6789/0 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268006e770 con 0x7f26800c8e60 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268006ea50 con 0x7f2680156110 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f268006ed30 con 0x7f2680155d30 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f2685a0c640 10 monclient(hunting): authenticate will time out at 1274.024375s 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f267effd640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f2680155d30 0x7f26800cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f267f7fe640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f26800c8e60 0x7f26800c9280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:55166/0 (socket says 10.20.193.10:55166) 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f267f7fe640 1 -- 10.20.193.10:0/3443643941 learned_addr learned my addr 10.20.193.10:0/3443643941 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f267effd640 10 monclient(hunting): get_auth_request con 0x7f2680155d30 auth_method 0 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f267effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:04.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f267effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:04.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.302+0000 7f267effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:04.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.303+0000 7f267effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:04.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.303+0000 7f267effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:04.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.303+0000 7f267effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:04.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267dffb640 1 -- 10.20.193.10:0/3443643941 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400325641 0 0) 0x7f268006e770 con 0x7f26800c8e60 2026-02-17T12:00:04.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267dffb640 10 monclient(hunting): _negotiate 2026-02-17T12:00:04.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:04.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:04.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267dffb640 10 monclient(hunting): my global_id is 4996 2026-02-17T12:00:04.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267dffb640 1 -- 10.20.193.10:0/3443643941 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f266c003620 con 0x7f26800c8e60 2026-02-17T12:00:04.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267effd640 10 monclient(hunting): handle_auth_done global_id 4959 payload 274 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267effd640 1 -- 10.20.193.10:0/3443643941 >> v1:10.20.193.153:6789/0 conn(0x7f2680156110 legacy=0x7f2680076270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267effd640 1 -- 10.20.193.10:0/3443643941 >> v1:10.20.193.71:6789/0 conn(0x7f26800c8e60 legacy=0x7f26800c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267effd640 10 monclient: _finish_hunting 0 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267effd640 1 monclient: found mon.noname-a 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267effd640 1 -- 10.20.193.10:0/3443643941 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26800c8660 con 0x7f2680155d30 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.304+0000 7f267effd640 1 --2- 10.20.193.10:0/3443643941 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680155d30 0x7f26800cb100 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f26740098a0 tx=0x7f267402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68e10685778ae18 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.305+0000 7f267dffb640 1 -- 10.20.193.10:0/3443643941 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267403c070 con 0x7f2680155d30 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.305+0000 7f267dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:04.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.305+0000 7f267dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.305+0000 7f267dffb640 10 monclient: dump: 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:04.318 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.305+0000 7f267dffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.305+0000 7f267dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.305+0000 7f267dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.305+0000 7f2685a0c640 5 monclient: authenticate success, global_id 4959 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.305+0000 7f2685a0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f267dffb640 1 -- 10.20.193.10:0/3443643941 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267402fb70 con 0x7f2680155d30 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f267dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f267dffb640 1 -- 10.20.193.10:0/3443643941 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674037440 con 0x7f2680155d30 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f267dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f267dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f267dffb640 10 monclient: dump: 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:04.319 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f2685a0c640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f2685a0c640 4 set_mon_vals no callback set 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f2685a0c640 10 monclient: shutdown 2026-02-17T12:00:04.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f2685a0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f2685a0c640 1 -- 10.20.193.10:0/3443643941 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680155d30 msgr2=0x7f26800cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.306+0000 7f2685a0c640 1 --2- 10.20.193.10:0/3443643941 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680155d30 0x7f26800cb100 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f26740098a0 tx=0x7f267402ee60 comp rx=0 tx=0).stop 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 -- 10.20.193.10:0/3443643941 shutdown_connections 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 --2- 10.20.193.10:0/3443643941 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680155d30 0x7f26800cb100 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 -- 10.20.193.10:0/3443643941 >> 10.20.193.10:0/3443643941 conn(0x7f26800ca5e0 msgr2=0x7f26800ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 -- 10.20.193.10:0/3443643941 shutdown_connections 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 -- 10.20.193.10:0/3443643941 wait complete. 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 10 monclient: build_initial_monmap 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 10 monclient: monmap: 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:04.321 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 librados: starting msgr at 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 librados: starting objecter 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 Processor -- start 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 -- start start 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 librados: setting wanted keys 2026-02-17T12:00:04.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 1 librados: calling monclient init 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.307+0000 7f2685a0c640 10 monclient: init 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26800c8e60 0x7f26801f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient(hunting): picked mon.noname-b con 0x7f26800c8e60 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2680155d30 0x7f26801f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient(hunting): picked mon.noname-c con 0x7f2680155d30 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680156110 0x7f268014bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient(hunting): picked mon.noname-a con 0x7f2680156110 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:04.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f2680166810 con 0x7f2680156110 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2680166690 con 0x7f26800c8e60 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2680166990 con 0x7f2680155d30 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f2685a0c640 10 monclient(hunting): authenticate will time out at 1274.030380s 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267f7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680156110 0x7f268014bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267effd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26800c8e60 0x7f26801f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267e7fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2680155d30 0x7f26801f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267f7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680156110 0x7f268014bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:46150/0 (socket says 10.20.193.10:46150) 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267f7fe640 1 -- 10.20.193.10:0/590647640 learned_addr learned my addr 10.20.193.10:0/590647640 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:04.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267f7fe640 10 monclient(hunting): get_auth_request con 0x7f2680156110 auth_method 0 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267effd640 10 monclient(hunting): get_auth_request con 0x7f26800c8e60 auth_method 0 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267e7fc640 10 monclient(hunting): get_auth_request con 0x7f2680155d30 auth_method 0 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.308+0000 7f267e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.309+0000 7f267f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:04.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.309+0000 7f267f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.309+0000 7f267f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.309+0000 7f267effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.309+0000 7f267effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.309+0000 7f267effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.309+0000 7f267e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.309+0000 7f267e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.309+0000 7f267e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 10 monclient(hunting): handle_auth_done global_id 4962 payload 824 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 1 -- 10.20.193.10:0/590647640 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2680155d30 msgr2=0x7f26801f3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2680155d30 0x7f26801f3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 1 -- 10.20.193.10:0/590647640 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26800c8e60 msgr2=0x7f26801f7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26800c8e60 0x7f26801f7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:04.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 1 monclient: found mon.noname-a 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.310+0000 7f267f7fe640 1 -- 10.20.193.10:0/590647640 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26801f4a00 con 0x7f2680156110 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.311+0000 7f267f7fe640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680156110 0x7f268014bd00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f267000cad0 tx=0x7f267000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.311+0000 7f2657fff640 10 client.?.objecter ms_handle_connect 0x7f2680156110 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.311+0000 7f2657fff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 1 -- 10.20.193.10:0/590647640 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267000ac50 con 0x7f2680156110 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 10 monclient: dump: 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:04.327 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 10 monclient: _finish_auth 0 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 1 -- 10.20.193.10:0/590647640 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267000adf0 con 0x7f2680156110 2026-02-17T12:00:04.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2685a0c640 5 monclient: authenticate success, global_id 4962 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 1 -- 10.20.193.10:0/590647640 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2670012600 con 0x7f2680156110 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2657fff640 10 monclient: dump: 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:04.329 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f267d7fa640 4 set_mon_vals no callback set 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2685a0c640 10 monclient: _renew_subs 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2685a0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.312+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26801f4440 con 0x7f2680156110 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.313+0000 7f2685a0c640 10 client.4962.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.313+0000 7f2685a0c640 10 monclient: _renew_subs 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.313+0000 7f2685a0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.313+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26801566a0 con 0x7f2680156110 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.313+0000 7f2685a0c640 1 librados: init done 2026-02-17T12:00:04.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.313+0000 7f2685a0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:04.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.313+0000 7f2685a0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:04.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.313+0000 7f2685a0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:04.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.313+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2680159730 con 0x7f2680156110 2026-02-17T12:00:04.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.325+0000 7f2657fff640 1 -- 10.20.193.10:0/590647640 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f26700127a0 con 0x7f2680156110 2026-02-17T12:00:04.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.325+0000 7f2657fff640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2650078e50 0x7f265007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:04.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.325+0000 7f267effd640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2650078e50 0x7f265007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:04.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.325+0000 7f267effd640 10 monclient: get_auth_request con 0x7f2650078e50 auth_method 0 2026-02-17T12:00:04.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.325+0000 7f267effd640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2650078e50 0x7f265007b310 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2674039000 tx=0x7f2674033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:04.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.325+0000 7f2657fff640 10 client.4962.objecter ms_handle_connect 0x7f2650078e50 2026-02-17T12:00:04.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.429+0000 7f2657fff640 1 -- 10.20.193.10:0/590647640 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f267005e7e0 con 0x7f2680156110 2026-02-17T12:00:04.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.429+0000 7f2657fff640 10 client.4962.objecter ms_dispatch2 0x7f2680000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:04.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.429+0000 7f2657fff640 3 client.4962.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:04.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.429+0000 7f2657fff640 3 client.4962.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:04.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.429+0000 7f2657fff640 20 client.4962.objecter dump_active .. 0 homeless 2026-02-17T12:00:04.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.429+0000 7f2657fff640 1 -- 10.20.193.10:0/590647640 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f26700627a0 con 0x7f2680156110 2026-02-17T12:00:04.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.429+0000 7f2657fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:04.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.429+0000 7f2657fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:04.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.530+0000 7f2685a0c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:04.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.530+0000 7f2685a0c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:04.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.530+0000 7f2685a0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.530+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26800742a0 con 0x7f2680156110 2026-02-17T12:00:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.532+0000 7f2657fff640 1 -- 10.20.193.10:0/590647640 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f2670066aa0 con 0x7f2680156110 2026-02-17T12:00:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.532+0000 7f2657fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.532+0000 7f2657fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:04.535 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:04.535 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:04.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 10 librados: watch_flush enter 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 10 librados: watch_flush exit 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 20 client.4962.objecter shutdown clearing up homeless session... 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 10 client.4962.objecter successfully canceled tick 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2650078e50 msgr2=0x7f265007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2650078e50 0x7f265007b310 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2674039000 tx=0x7f2674033000 comp rx=0 tx=0).stop 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 10 monclient: shutdown 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680156110 msgr2=0x7f268014bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680156110 0x7f268014bd00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f267000cad0 tx=0x7f267000a060 comp rx=0 tx=0).stop 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 shutdown_connections 2026-02-17T12:00:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2650078e50 0x7f265007b310 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f2680156110 0x7f268014bd00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2680155d30 0x7f26801f3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 --2- 10.20.193.10:0/590647640 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f26800c8e60 0x7f26801f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 >> 10.20.193.10:0/590647640 conn(0x7f26800ca5e0 msgr2=0x7f268006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 shutdown_connections 2026-02-17T12:00:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 -- 10.20.193.10:0/590647640 wait complete. 2026-02-17T12:00:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:04.533+0000 7f2685a0c640 1 librados: shutdown 2026-02-17T12:00:07.545 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:07.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.612+0000 7f7a8ce32640 10 monclient: get_monmap_and_config 2026-02-17T12:00:07.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.612+0000 7f7a8ce32640 10 monclient: build_initial_monmap 2026-02-17T12:00:07.615 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.612+0000 7f7a8ce32640 10 monclient: monmap: 2026-02-17T12:00:07.615 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:07.615 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:07.615 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:07.614018+0000 2026-02-17T12:00:07.615 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:07.614018+0000 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 1 Processor -- start 2026-02-17T12:00:07.616 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 1 -- start start 2026-02-17T12:00:07.617 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient: init 2026-02-17T12:00:07.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:07.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient: _add_conns ranks=[3,4,0,1,2,5] 2026-02-17T12:00:07.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f7a88152660 0x7f7a8815a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:07.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient(hunting): picked mon.noname-a con 0x7f7a88152660 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:07.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f7a88152a40 0x7f7a8815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:07.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient(hunting): picked mon.noname-b con 0x7f7a88152a40 addr v2:10.20.193.71:3300/0 2026-02-17T12:00:07.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7a880c8dd0 addr v1:10.20.193.10:6789/0 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a880c71e0 con 0x7f7a880c8dd0 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f7a880c77a0 con 0x7f7a88152660 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7a880c74c0 con 0x7f7a88152a40 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.613+0000 7f7a8ce32640 10 monclient(hunting): authenticate will time out at 1277.335727s 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a86575640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f7a88152660 0x7f7a8815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a85d74640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f7a88152a40 0x7f7a8815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a86575640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f7a88152660 0x7f7a8815a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:46164/0 (socket says 10.20.193.10:46164) 2026-02-17T12:00:07.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a86575640 1 -- 10.20.193.10:0/2437306521 learned_addr learned my addr 10.20.193.10:0/2437306521 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a86575640 10 monclient(hunting): get_auth_request con 0x7f7a88152660 auth_method 0 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a86575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a86575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a86575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a85d74640 10 monclient(hunting): get_auth_request con 0x7f7a88152a40 auth_method 0 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a85d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a85d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a85d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a85d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a85d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.614+0000 7f7a85d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.615+0000 7f7a86575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:07.621 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.615+0000 7f7a86575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.615+0000 7f7a86575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.616+0000 7f7a85d74640 10 monclient(hunting): handle_auth_done global_id 5002 payload 274 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.616+0000 7f7a85d74640 1 -- 10.20.193.10:0/2437306521 >> v2:10.20.193.10:3300/0 conn(0x7f7a88152660 msgr2=0x7f7a8815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.616+0000 7f7a85d74640 1 --2- 10.20.193.10:0/2437306521 >> v2:10.20.193.10:3300/0 conn(0x7f7a88152660 0x7f7a8815a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.616+0000 7f7a85d74640 1 -- 10.20.193.10:0/2437306521 >> v1:10.20.193.10:6789/0 conn(0x7f7a880c8dd0 legacy=0x7f7a880c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.616+0000 7f7a85d74640 10 monclient: _finish_hunting 0 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.616+0000 7f7a85d74640 1 monclient: found mon.noname-b 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.616+0000 7f7a85d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.616+0000 7f7a85d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.616+0000 7f7a85d74640 1 -- 10.20.193.10:0/2437306521 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a88159e40 con 0x7f7a88152a40 2026-02-17T12:00:07.622 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.617+0000 7f7a85d74640 1 --2- 10.20.193.10:0/2437306521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7a88152a40 0x7f7a8815ae60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7a881563f0 tx=0x7f7a7002ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155a232c4c0e47eb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 1 -- 10.20.193.10:0/2437306521 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7003c070 con 0x7f7a88152a40 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 10 monclient: dump: 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 10 monclient: _finish_auth 0 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 10 monclient: _check_auth_tickets 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 1 -- 10.20.193.10:0/2437306521 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7002faf0 con 0x7f7a88152a40 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 1 -- 10.20.193.10:0/2437306521 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70037440 con 0x7f7a88152a40 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 5 monclient: authenticate success, global_id 5002 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 4 set_mon_vals no callback set 2026-02-17T12:00:07.629 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a85573640 10 monclient: dump: 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 10 monclient: shutdown 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 1 -- 10.20.193.10:0/2437306521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7a88152a40 msgr2=0x7f7a8815ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 1 --2- 10.20.193.10:0/2437306521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7a88152a40 0x7f7a8815ae60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7a881563f0 tx=0x7f7a7002ede0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 1 -- 10.20.193.10:0/2437306521 shutdown_connections 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 1 --2- 10.20.193.10:0/2437306521 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7a88152a40 0x7f7a8815ae60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 1 --2- 10.20.193.10:0/2437306521 >> v2:10.20.193.10:3300/0 conn(0x7f7a88152660 0x7f7a8815a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 1 -- 10.20.193.10:0/2437306521 >> 10.20.193.10:0/2437306521 conn(0x7f7a880c9d80 msgr2=0x7f7a880ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 1 -- 10.20.193.10:0/2437306521 shutdown_connections 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.619+0000 7f7a8ce32640 1 -- 10.20.193.10:0/2437306521 wait complete. 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.620+0000 7f7a8ce32640 10 monclient: build_initial_monmap 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.620+0000 7f7a8ce32640 10 monclient: monmap: 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.620+0000 7f7a8ce32640 1 librados: starting msgr at 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.620+0000 7f7a8ce32640 1 librados: starting objecter 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.620+0000 7f7a8ce32640 1 Processor -- start 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.620+0000 7f7a8ce32640 1 -- start start 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.620+0000 7f7a8ce32640 1 librados: setting wanted keys 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.620+0000 7f7a8ce32640 1 librados: calling monclient init 2026-02-17T12:00:07.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.620+0000 7f7a8ce32640 10 monclient: init 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7a880c8dd0 0x7f7a880cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient(hunting): picked mon.noname-c con 0x7f7a880c8dd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7a88152660 0x7f7a881f7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient(hunting): picked mon.noname-b con 0x7f7a88152660 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7a88152a40 0x7f7a88151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient(hunting): picked mon.noname-a con 0x7f7a88152a40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f7a880c7c80 con 0x7f7a88152a40 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8815a400 con 0x7f7a88152660 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a880c7e00 con 0x7f7a880c8dd0 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a8ce32640 10 monclient(hunting): authenticate will time out at 1277.343218s 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7a88152a40 0x7f7a88151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a85d74640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7a88152660 0x7f7a881f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7a88152a40 0x7f7a88151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:46178/0 (socket says 10.20.193.10:46178) 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 1 -- 10.20.193.10:0/3767074343 learned_addr learned my addr 10.20.193.10:0/3767074343 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 10 monclient(hunting): get_auth_request con 0x7f7a88152a40 auth_method 0 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86575640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7a880c8dd0 0x7f7a880cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a85d74640 10 monclient(hunting): get_auth_request con 0x7f7a88152660 auth_method 0 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a85d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a85d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a85d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86575640 10 monclient(hunting): get_auth_request con 0x7f7a880c8dd0 auth_method 0 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.621+0000 7f7a86d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.622+0000 7f7a85d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.622+0000 7f7a85d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.622+0000 7f7a85d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.622+0000 7f7a86575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.622+0000 7f7a86575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.622+0000 7f7a86575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:07.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 10 monclient(hunting): handle_auth_done global_id 4971 payload 824 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 1 -- 10.20.193.10:0/3767074343 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7a880c8dd0 msgr2=0x7f7a880cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7a880c8dd0 0x7f7a880cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 1 -- 10.20.193.10:0/3767074343 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7a88152660 msgr2=0x7f7a881f7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7a88152660 0x7f7a881f7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 10 monclient: _finish_hunting 0 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 1 monclient: found mon.noname-a 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.623+0000 7f7a86d76640 1 -- 10.20.193.10:0/3767074343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a881f3790 con 0x7f7a88152a40 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.624+0000 7f7a86d76640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7a88152a40 0x7f7a88151550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800cc50 tx=0x7f7a7800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.624+0000 7f7a6effd640 10 client.?.objecter ms_handle_connect 0x7f7a88152a40 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.624+0000 7f7a6effd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 1 -- 10.20.193.10:0/3767074343 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78017070 con 0x7f7a88152a40 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 10 monclient: dump: 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 10 monclient: _finish_auth 0 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 1 -- 10.20.193.10:0/3767074343 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78003a40 con 0x7f7a88152a40 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 1 -- 10.20.193.10:0/3767074343 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78003e30 con 0x7f7a88152a40 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a6effd640 10 monclient: dump: 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:07.632 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a84d72640 4 set_mon_vals no callback set 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 5 monclient: authenticate success, global_id 4971 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 10 monclient: _renew_subs 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a881f3a70 con 0x7f7a88152a40 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 10 client.4971.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 10 monclient: _renew_subs 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a881f4030 con 0x7f7a88152a40 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 1 librados: init done 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:07.633 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.626+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a880c91b0 con 0x7f7a88152a40 2026-02-17T12:00:07.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.638+0000 7f7a6effd640 1 -- 10.20.193.10:0/3767074343 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f7a78005030 con 0x7f7a88152a40 2026-02-17T12:00:07.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.638+0000 7f7a6effd640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7a54078e80 0x7f7a5407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:07.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.638+0000 7f7a86575640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7a54078e80 0x7f7a5407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:07.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.638+0000 7f7a86575640 10 monclient: get_auth_request con 0x7f7a54078e80 auth_method 0 2026-02-17T12:00:07.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.638+0000 7f7a6effd640 10 client.4971.objecter ms_handle_connect 0x7f7a54078e80 2026-02-17T12:00:07.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.638+0000 7f7a86575640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7a54078e80 0x7f7a5407b340 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c006dc0 tx=0x7f7a7c009340 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:07.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.640+0000 7f7a6effd640 1 -- 10.20.193.10:0/3767074343 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f7a7805db00 con 0x7f7a88152a40 2026-02-17T12:00:07.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.640+0000 7f7a6effd640 10 client.4971.objecter ms_dispatch2 0x7f7a88000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:07.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.640+0000 7f7a6effd640 3 client.4971.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:07.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.640+0000 7f7a6effd640 3 client.4971.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:07.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.640+0000 7f7a6effd640 20 client.4971.objecter dump_active .. 0 homeless 2026-02-17T12:00:07.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.738+0000 7f7a6effd640 1 -- 10.20.193.10:0/3767074343 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7a78021020 con 0x7f7a88152a40 2026-02-17T12:00:07.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.738+0000 7f7a6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:07.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.738+0000 7f7a6effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.837+0000 7f7a8ce32640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.837+0000 7f7a8ce32640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.837+0000 7f7a8ce32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.837+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7a8815cb70 con 0x7f7a88152a40 2026-02-17T12:00:07.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.839+0000 7f7a6effd640 1 -- 10.20.193.10:0/3767074343 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f7a78061ac0 con 0x7f7a88152a40 2026-02-17T12:00:07.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.839+0000 7f7a6effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:07.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.839+0000 7f7a6effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:07.841 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:07.841 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:07.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 10 librados: watch_flush enter 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 10 librados: watch_flush exit 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 20 client.4971.objecter shutdown clearing up homeless session... 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 10 client.4971.objecter successfully canceled tick 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7a54078e80 msgr2=0x7f7a5407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7a54078e80 0x7f7a5407b340 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c006dc0 tx=0x7f7a7c009340 comp rx=0 tx=0).stop 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 10 monclient: shutdown 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7a88152a40 msgr2=0x7f7a88151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7a88152a40 0x7f7a88151550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800cc50 tx=0x7f7a7800a430 comp rx=0 tx=0).stop 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 shutdown_connections 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7a54078e80 0x7f7a5407b340 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f7a88152a40 0x7f7a88151550 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7a88152660 0x7f7a881f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 --2- 10.20.193.10:0/3767074343 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7a880c8dd0 0x7f7a880cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 >> 10.20.193.10:0/3767074343 conn(0x7f7a880c9d80 msgr2=0x7f7a8814a390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 shutdown_connections 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 -- 10.20.193.10:0/3767074343 wait complete. 2026-02-17T12:00:07.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:07.840+0000 7f7a8ce32640 1 librados: shutdown 2026-02-17T12:00:10.851 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.919+0000 7f23d0b85640 10 monclient: get_monmap_and_config 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.919+0000 7f23d0b85640 10 monclient: build_initial_monmap 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.919+0000 7f23d0b85640 10 monclient: monmap: 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:10.920758+0000 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:10.920758+0000 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:10.921 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:10.922 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:10.922 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:10.922 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:10.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.919+0000 7f23d0b85640 1 Processor -- start 2026-02-17T12:00:10.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.919+0000 7f23d0b85640 1 -- start start 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.919+0000 7f23d0b85640 10 monclient: init 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 10 monclient: _add_conns ranks=[5,1,3,2,4,0] 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f23cc15d220 0x7f23cc15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 10 monclient(hunting): picked mon.noname-c con 0x7f23cc15d220 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f23cc074920 addr v1:10.20.193.71:6789/0 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f23cc0c92f0 0x7f23cc153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 10 monclient(hunting): picked mon.noname-a con 0x7f23cc0c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23cc0c58a0 con 0x7f23cc074920 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f23cc0c55c0 con 0x7f23cc0c92f0 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f23cc0c7e20 con 0x7f23cc15d220 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23d0b85640 10 monclient(hunting): authenticate will time out at 1280.642457s 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.920+0000 7f23cad76640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f23cc0c92f0 0x7f23cc153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23ca575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f23cc15d220 0x7f23cc15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23c9d74640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f23cc074920 0x7f23cc0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:55176/0 (socket says 10.20.193.10:55176) 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23c9d74640 1 -- 10.20.193.10:0/1533360083 learned_addr learned my addr 10.20.193.10:0/1533360083 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23cad76640 10 monclient(hunting): get_auth_request con 0x7f23cc0c92f0 auth_method 0 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23cad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23cad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23ca575640 10 monclient(hunting): get_auth_request con 0x7f23cc15d220 auth_method 0 2026-02-17T12:00:10.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23ca575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23cad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23cad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23cad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23ca575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23ca575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.921+0000 7f23ca575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.922+0000 7f23cad76640 10 monclient(hunting): handle_auth_done global_id 4974 payload 274 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.922+0000 7f23cad76640 1 -- 10.20.193.10:0/1533360083 >> v2:10.20.193.153:3300/0 conn(0x7f23cc15d220 msgr2=0x7f23cc15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.922+0000 7f23cad76640 1 --2- 10.20.193.10:0/1533360083 >> v2:10.20.193.153:3300/0 conn(0x7f23cc15d220 0x7f23cc15d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.922+0000 7f23cad76640 1 -- 10.20.193.10:0/1533360083 >> v1:10.20.193.71:6789/0 conn(0x7f23cc074920 legacy=0x7f23cc0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:10.924 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.922+0000 7f23cad76640 10 monclient: _finish_hunting 0 2026-02-17T12:00:10.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.922+0000 7f23cad76640 1 monclient: found mon.noname-a 2026-02-17T12:00:10.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.922+0000 7f23cad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:10.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.922+0000 7f23cad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:10.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.922+0000 7f23cad76640 1 -- 10.20.193.10:0/1533360083 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc0c8100 con 0x7f23cc0c92f0 2026-02-17T12:00:10.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.923+0000 7f23cad76640 1 --2- 10.20.193.10:0/1533360083 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 0x7f23cc153650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009d90 tx=0x7f23bc02f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663e47776c94802a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 1 -- 10.20.193.10:0/1533360083 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc03c070 con 0x7f23cc0c92f0 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 10 monclient: dump: 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:10.927 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 10 monclient: _finish_auth 0 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 10 monclient: _check_auth_tickets 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 1 -- 10.20.193.10:0/1533360083 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc037440 con 0x7f23cc0c92f0 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 5 monclient: authenticate success, global_id 4974 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 1 -- 10.20.193.10:0/1533360083 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc037810 con 0x7f23cc0c92f0 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23c9573640 10 monclient: dump: 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 4 set_mon_vals no callback set 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 10 monclient: shutdown 2026-02-17T12:00:10.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:10.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 1 -- 10.20.193.10:0/1533360083 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 msgr2=0x7f23cc153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:10.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 1 --2- 10.20.193.10:0/1533360083 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 0x7f23cc153650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009d90 tx=0x7f23bc02f1e0 comp rx=0 tx=0).stop 2026-02-17T12:00:10.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 1 -- 10.20.193.10:0/1533360083 shutdown_connections 2026-02-17T12:00:10.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 1 --2- 10.20.193.10:0/1533360083 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 0x7f23cc153650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:10.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 1 --2- 10.20.193.10:0/1533360083 >> v2:10.20.193.153:3300/0 conn(0x7f23cc15d220 0x7f23cc15d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:10.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 1 -- 10.20.193.10:0/1533360083 >> 10.20.193.10:0/1533360083 conn(0x7f23cc0c9d80 msgr2=0x7f23cc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:10.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 1 -- 10.20.193.10:0/1533360083 shutdown_connections 2026-02-17T12:00:10.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.925+0000 7f23d0b85640 1 -- 10.20.193.10:0/1533360083 wait complete. 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient: build_initial_monmap 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient: monmap: 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 librados: starting msgr at 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 librados: starting objecter 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 Processor -- start 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 -- start start 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 librados: setting wanted keys 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 librados: calling monclient init 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient: init 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f23cc074920 0x7f23cc145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient(hunting): picked mon.noname-c con 0x7f23cc074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:10.931 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 0x7f23cc1f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient(hunting): picked mon.noname-a con 0x7f23cc0c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f23cc15d220 0x7f23cc1f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient(hunting): picked mon.noname-b con 0x7f23cc15d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc074d70 con 0x7f23cc0c92f0 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc0c86c0 con 0x7f23cc15d220 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc153b90 con 0x7f23cc074920 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.926+0000 7f23d0b85640 10 monclient(hunting): authenticate will time out at 1280.648796s 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 0x7f23cc1f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23ca575640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f23cc074920 0x7f23cc145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23cad76640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f23cc15d220 0x7f23cc1f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 0x7f23cc1f3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:46190/0 (socket says 10.20.193.10:46190) 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 1 -- 10.20.193.10:0/48502989 learned_addr learned my addr 10.20.193.10:0/48502989 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 10 monclient(hunting): get_auth_request con 0x7f23cc0c92f0 auth_method 0 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23ca575640 10 monclient(hunting): get_auth_request con 0x7f23cc074920 auth_method 0 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23ca575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:10.932 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23c9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23cad76640 10 monclient(hunting): get_auth_request con 0x7f23cc15d220 auth_method 0 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23cad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23cad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23ca575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23ca575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23ca575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23cad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23cad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.927+0000 7f23cad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 10 monclient(hunting): handle_auth_done global_id 4977 payload 824 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 1 -- 10.20.193.10:0/48502989 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f23cc074920 msgr2=0x7f23cc145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f23cc074920 0x7f23cc145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 1 -- 10.20.193.10:0/48502989 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f23cc15d220 msgr2=0x7f23cc1f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f23cc15d220 0x7f23cc1f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 10 monclient: _finish_hunting 0 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 1 monclient: found mon.noname-a 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:10.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.928+0000 7f23c9d74640 1 -- 10.20.193.10:0/48502989 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc0734a0 con 0x7f23cc0c92f0 2026-02-17T12:00:10.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.929+0000 7f23c9d74640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 0x7f23cc1f3e30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f23b400c760 tx=0x7f23b400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:10.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.929+0000 7f23b2ffd640 10 client.?.objecter ms_handle_connect 0x7f23cc0c92f0 2026-02-17T12:00:10.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.929+0000 7f23b2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:10.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 1 -- 10.20.193.10:0/48502989 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4017070 con 0x7f23cc0c92f0 2026-02-17T12:00:10.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:10.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 10 monclient: dump: 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 1 -- 10.20.193.10:0/48502989 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b4005b90 con 0x7f23cc0c92f0 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 1 -- 10.20.193.10:0/48502989 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4007070 con 0x7f23cc0c92f0 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23b2ffd640 10 monclient: dump: 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:10.935 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23c8d72640 4 set_mon_vals no callback set 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23d0b85640 5 monclient: authenticate success, global_id 4977 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23d0b85640 10 monclient: _renew_subs 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23d0b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23cc073780 con 0x7f23cc0c92f0 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23d0b85640 10 client.4977.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23d0b85640 10 monclient: _renew_subs 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23d0b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23cc073d40 con 0x7f23cc0c92f0 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.931+0000 7f23d0b85640 1 librados: init done 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.932+0000 7f23d0b85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.932+0000 7f23d0b85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.932+0000 7f23d0b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:10.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.932+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23cc14fba0 con 0x7f23cc0c92f0 2026-02-17T12:00:10.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.943+0000 7f23b2ffd640 1 -- 10.20.193.10:0/48502989 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f23b4007210 con 0x7f23cc0c92f0 2026-02-17T12:00:10.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.944+0000 7f23b2ffd640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2398078e00 0x7f239807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:10.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.944+0000 7f23ca575640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2398078e00 0x7f239807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:10.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.944+0000 7f23ca575640 10 monclient: get_auth_request con 0x7f2398078e00 auth_method 0 2026-02-17T12:00:10.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.944+0000 7f23ca575640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2398078e00 0x7f239807b2c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009ba0 tx=0x7f23c0009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:10.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:10.944+0000 7f23b2ffd640 10 client.4977.objecter ms_handle_connect 0x7f2398078e00 2026-02-17T12:00:11.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.043+0000 7f23b2ffd640 1 -- 10.20.193.10:0/48502989 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f23b405d470 con 0x7f23cc0c92f0 2026-02-17T12:00:11.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.043+0000 7f23b2ffd640 10 client.4977.objecter ms_dispatch2 0x7f23cc000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:11.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.043+0000 7f23b2ffd640 3 client.4977.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:11.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.043+0000 7f23b2ffd640 3 client.4977.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:11.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.043+0000 7f23b2ffd640 20 client.4977.objecter dump_active .. 0 homeless 2026-02-17T12:00:11.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.043+0000 7f23b2ffd640 1 -- 10.20.193.10:0/48502989 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f23cc14fba0 con 0x7f23cc0c92f0 2026-02-17T12:00:11.045 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.044+0000 7f23b2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:11.046 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.044+0000 7f23b2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:11.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.146+0000 7f23d0b85640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:11.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.147+0000 7f23d0b85640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:11.148 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.147+0000 7f23d0b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:11.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.147+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f23cc153f70 con 0x7f23cc0c92f0 2026-02-17T12:00:11.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.149+0000 7f23b2ffd640 1 -- 10.20.193.10:0/48502989 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f23b4021020 con 0x7f23cc0c92f0 2026-02-17T12:00:11.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.149+0000 7f23b2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:11.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.149+0000 7f23b2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:11.151 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:11.151 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 10 librados: watch_flush enter 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 10 librados: watch_flush exit 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 20 client.4977.objecter shutdown clearing up homeless session... 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 10 client.4977.objecter successfully canceled tick 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2398078e00 msgr2=0x7f239807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2398078e00 0x7f239807b2c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009ba0 tx=0x7f23c0009290 comp rx=0 tx=0).stop 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 10 monclient: shutdown 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 msgr2=0x7f23cc1f3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 0x7f23cc1f3e30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f23b400c760 tx=0x7f23b400cc30 comp rx=0 tx=0).stop 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 shutdown_connections 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2398078e00 0x7f239807b2c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f23cc15d220 0x7f23cc1f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23cc0c92f0 0x7f23cc1f3e30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 --2- 10.20.193.10:0/48502989 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f23cc074920 0x7f23cc145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 >> 10.20.193.10:0/48502989 conn(0x7f23cc0c9d80 msgr2=0x7f23cc1e81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 shutdown_connections 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 -- 10.20.193.10:0/48502989 wait complete. 2026-02-17T12:00:11.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:11.150+0000 7f23d0b85640 1 librados: shutdown 2026-02-17T12:00:14.161 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:14.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.228+0000 7f81f8691640 10 monclient: get_monmap_and_config 2026-02-17T12:00:14.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.228+0000 7f81f8691640 10 monclient: build_initial_monmap 2026-02-17T12:00:14.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.228+0000 7f81f8691640 10 monclient: monmap: 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:14.229395+0000 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:14.229395+0000 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:14.231 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:14.232 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:14.232 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:14.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.228+0000 7f81f8691640 1 Processor -- start 2026-02-17T12:00:14.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.228+0000 7f81f8691640 1 -- start start 2026-02-17T12:00:14.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.228+0000 7f81f8691640 10 monclient: init 2026-02-17T12:00:14.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:14.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 10 monclient: _add_conns ranks=[1,5,4,2,0,3] 2026-02-17T12:00:14.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f81f015d220 addr v1:10.20.193.71:6789/0 2026-02-17T12:00:14.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f81f00c92f0 0x7f81f015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 10 monclient(hunting): picked mon.noname-c con 0x7f81f00c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:14.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f81f0074920 0x7f81f0153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 10 monclient(hunting): picked mon.noname-b con 0x7f81f0074920 addr v2:10.20.193.71:3300/0 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f00c58a0 con 0x7f81f015d220 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f81f00c55c0 con 0x7f81f0074920 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f81f00c7e20 con 0x7f81f00c92f0 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f8691640 10 monclient(hunting): authenticate will time out at 1283.951133s 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f5c05640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f81f00c92f0 0x7f81f015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f6c07640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f81f0074920 0x7f81f0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f5c05640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f81f00c92f0 0x7f81f015d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:47226/0 (socket says 10.20.193.10:47226) 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f5c05640 1 -- 10.20.193.10:0/3213126256 learned_addr learned my addr 10.20.193.10:0/3213126256 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f5c05640 10 monclient(hunting): get_auth_request con 0x7f81f00c92f0 auth_method 0 2026-02-17T12:00:14.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f5c05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f5c05640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.229+0000 7f81f5c05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f6c07640 10 monclient(hunting): get_auth_request con 0x7f81f0074920 auth_method 0 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f6c07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f6c07640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f6c07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f5c05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f5c05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f5c05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f6c07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f6c07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.230+0000 7f81f6c07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 10 monclient(hunting): handle_auth_done global_id 5030 payload 274 2026-02-17T12:00:14.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 1 -- 10.20.193.10:0/3213126256 >> v2:10.20.193.71:3300/0 conn(0x7f81f0074920 msgr2=0x7f81f0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:14.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 1 --2- 10.20.193.10:0/3213126256 >> v2:10.20.193.71:3300/0 conn(0x7f81f0074920 0x7f81f0153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 1 -- 10.20.193.10:0/3213126256 >> v1:10.20.193.71:6789/0 conn(0x7f81f015d220 legacy=0x7f81f00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 10 monclient: _finish_hunting 0 2026-02-17T12:00:14.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 1 monclient: found mon.noname-c 2026-02-17T12:00:14.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:14.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:00:14.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 1 -- 10.20.193.10:0/3213126256 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f00c8100 con 0x7f81f00c92f0 2026-02-17T12:00:14.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.231+0000 7f81f5c05640 1 --2- 10.20.193.10:0/3213126256 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 0x7f81f015d600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009970 tx=0x7f81e402eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=263c6fa27a9916fe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:14.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 1 -- 10.20.193.10:0/3213126256 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e403c070 con 0x7f81f00c92f0 2026-02-17T12:00:14.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:14.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:14.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 10 monclient: dump: 2026-02-17T12:00:14.244 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:14.244 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:14.244 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 10 monclient: _finish_auth 0 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 10 monclient: _check_auth_tickets 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 1 -- 10.20.193.10:0/3213126256 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e402fbc0 con 0x7f81f00c92f0 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:14.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 1 -- 10.20.193.10:0/3213126256 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4037440 con 0x7f81f00c92f0 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f5404640 10 monclient: dump: 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:14.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f8691640 5 monclient: authenticate success, global_id 5030 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f8691640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.233+0000 7f81f8691640 4 set_mon_vals no callback set 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 10 monclient: shutdown 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 1 -- 10.20.193.10:0/3213126256 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 msgr2=0x7f81f015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 1 --2- 10.20.193.10:0/3213126256 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 0x7f81f015d600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009970 tx=0x7f81e402eef0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 1 -- 10.20.193.10:0/3213126256 shutdown_connections 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 1 --2- 10.20.193.10:0/3213126256 >> v2:10.20.193.71:3300/0 conn(0x7f81f0074920 0x7f81f0153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 1 --2- 10.20.193.10:0/3213126256 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 0x7f81f015d600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 1 -- 10.20.193.10:0/3213126256 >> 10.20.193.10:0/3213126256 conn(0x7f81f00c9d80 msgr2=0x7f81f00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 1 -- 10.20.193.10:0/3213126256 shutdown_connections 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 1 -- 10.20.193.10:0/3213126256 wait complete. 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 10 monclient: build_initial_monmap 2026-02-17T12:00:14.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 10 monclient: monmap: 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.234+0000 7f81f8691640 1 librados: starting msgr at 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 librados: starting objecter 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 Processor -- start 2026-02-17T12:00:14.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 -- start start 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 librados: setting wanted keys 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 librados: calling monclient init 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient: init 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f81f0074920 0x7f81f00cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient(hunting): picked mon.noname-a con 0x7f81f0074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 0x7f81f00cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient(hunting): picked mon.noname-c con 0x7f81f00c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f81f015d220 0x7f81f006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient(hunting): picked mon.noname-b con 0x7f81f015d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f81f0074d70 con 0x7f81f0074920 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81f00c86c0 con 0x7f81f015d220 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81f0153b90 con 0x7f81f00c92f0 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f8691640 10 monclient(hunting): authenticate will time out at 1283.957541s 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f6406640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f81f0074920 0x7f81f00cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f5c05640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 0x7f81f00cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.235+0000 7f81f6c07640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f81f015d220 0x7f81f006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f5c05640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 0x7f81f00cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:47230/0 (socket says 10.20.193.10:47230) 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f5c05640 1 -- 10.20.193.10:0/3498172613 learned_addr learned my addr 10.20.193.10:0/3498172613 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6c07640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f81f015d220 0x7f81f006e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:50218/0 (socket says 10.20.193.10:50218) 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f5c05640 10 monclient(hunting): get_auth_request con 0x7f81f00c92f0 auth_method 0 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f5c05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f5c05640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f5c05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6c07640 10 monclient(hunting): get_auth_request con 0x7f81f015d220 auth_method 0 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6c07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6c07640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6c07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6406640 10 monclient(hunting): get_auth_request con 0x7f81f0074920 auth_method 0 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6406640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6406640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6406640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6c07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6c07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6c07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f5c05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f5c05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:14.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f5c05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6406640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6406640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.236+0000 7f81f6406640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 10 monclient(hunting): handle_auth_done global_id 5020 payload 824 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 1 -- 10.20.193.10:0/3498172613 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 msgr2=0x7f81f00cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 0x7f81f00cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 1 -- 10.20.193.10:0/3498172613 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f81f0074920 msgr2=0x7f81f00cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f81f0074920 0x7f81f00cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 10 monclient: _finish_hunting 0 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 1 monclient: found mon.noname-b 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.237+0000 7f81f6c07640 1 -- 10.20.193.10:0/3498172613 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f00cba20 con 0x7f81f015d220 2026-02-17T12:00:14.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.238+0000 7f81f6c07640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f81f015d220 0x7f81f006e4f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00efc0 tx=0x7f81ec00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.238+0000 7f81d6ffd640 10 client.?.objecter ms_handle_connect 0x7f81f015d220 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.238+0000 7f81d6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81d6ffd640 1 -- 10.20.193.10:0/3498172613 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec018020 con 0x7f81f015d220 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81d6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81d6ffd640 10 monclient: dump: 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:14.253 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81d6ffd640 10 monclient: _finish_auth 0 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81d6ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81f8691640 5 monclient: authenticate success, global_id 5020 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81f8691640 10 monclient: _renew_subs 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81f8691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.239+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f00cbd60 con 0x7f81f015d220 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f8691640 10 client.5020.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f8691640 10 monclient: _renew_subs 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f8691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f0072850 con 0x7f81f015d220 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f8691640 1 librados: init done 2026-02-17T12:00:14.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81d6ffd640 1 -- 10.20.193.10:0/3498172613 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec014480 con 0x7f81f015d220 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81d6ffd640 1 -- 10.20.193.10:0/3498172613 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec014830 con 0x7f81f015d220 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81d6ffd640 10 monclient: dump: 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:14.255 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:14.256 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:14.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f4c03640 4 set_mon_vals no callback set 2026-02-17T12:00:14.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f8691640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:14.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f8691640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:14.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f8691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:00:14.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.240+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f0153f70 con 0x7f81f015d220 2026-02-17T12:00:14.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.348+0000 7f81d6ffd640 1 -- 10.20.193.10:0/3498172613 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f81ec0149d0 con 0x7f81f015d220 2026-02-17T12:00:14.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.349+0000 7f81d6ffd640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f81c0078e00 0x7f81c007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:14.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.349+0000 7f81f6406640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f81c0078e00 0x7f81c007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:14.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.349+0000 7f81f6406640 10 monclient: get_auth_request con 0x7f81c0078e00 auth_method 0 2026-02-17T12:00:14.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.349+0000 7f81f6406640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f81c0078e00 0x7f81c007b2c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f81e0005110 tx=0x7f81e0007f30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:14.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.349+0000 7f81d6ffd640 10 client.5020.objecter ms_handle_connect 0x7f81c0078e00 2026-02-17T12:00:14.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.350+0000 7f81d6ffd640 1 -- 10.20.193.10:0/3498172613 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f81ec098890 con 0x7f81f015d220 2026-02-17T12:00:14.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.350+0000 7f81d6ffd640 10 client.5020.objecter ms_dispatch2 0x7f81f0000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:14.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.350+0000 7f81d6ffd640 3 client.5020.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:14.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.350+0000 7f81d6ffd640 3 client.5020.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:14.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.350+0000 7f81d6ffd640 20 client.5020.objecter dump_active .. 0 homeless 2026-02-17T12:00:14.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.356+0000 7f81d6ffd640 1 -- 10.20.193.10:0/3498172613 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f81ec022030 con 0x7f81f015d220 2026-02-17T12:00:14.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.356+0000 7f81d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:14.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.356+0000 7f81d6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:14.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.454+0000 7f81f8691640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:14.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.454+0000 7f81f8691640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:14.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.454+0000 7f81f8691640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:00:14.457 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.454+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f81f01573e0 con 0x7f81f015d220 2026-02-17T12:00:14.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81d6ffd640 1 -- 10.20.193.10:0/3498172613 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f81f00cbd60 con 0x7f81f015d220 2026-02-17T12:00:14.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81d6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:14.459 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81d6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:14.459 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:14.459 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:14.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 10 librados: watch_flush enter 2026-02-17T12:00:14.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 10 librados: watch_flush exit 2026-02-17T12:00:14.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 20 client.5020.objecter shutdown clearing up homeless session... 2026-02-17T12:00:14.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 10 client.5020.objecter successfully canceled tick 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f81c0078e00 msgr2=0x7f81c007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f81c0078e00 0x7f81c007b2c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f81e0005110 tx=0x7f81e0007f30 comp rx=0 tx=0).stop 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 10 monclient: shutdown 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f81f015d220 msgr2=0x7f81f006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f81f015d220 0x7f81f006e4f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00efc0 tx=0x7f81ec00c490 comp rx=0 tx=0).stop 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 shutdown_connections 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f81c0078e00 0x7f81c007b2c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f81f015d220 0x7f81f006e4f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f81f00c92f0 0x7f81f00cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 --2- 10.20.193.10:0/3498172613 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f81f0074920 0x7f81f00cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:14.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 >> 10.20.193.10:0/3498172613 conn(0x7f81f00c9d80 msgr2=0x7f81f0151600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:14.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 shutdown_connections 2026-02-17T12:00:14.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 -- 10.20.193.10:0/3498172613 wait complete. 2026-02-17T12:00:14.463 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:14.458+0000 7f81f8691640 1 librados: shutdown 2026-02-17T12:00:15.372 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:06:32.540 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:15.374 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:06:32.542 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:15.375 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:06:32.538 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:15.376 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:06:32.539 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:15.382 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:06:32.550 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:15.384 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:06:32.547 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:15.400 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:06:32.529 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:15.401 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:06:32.530 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:15.408 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:06:32.537 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:17.469 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:17.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.533+0000 7ff3ea185640 10 monclient: get_monmap_and_config 2026-02-17T12:00:17.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.533+0000 7ff3ea185640 10 monclient: build_initial_monmap 2026-02-17T12:00:17.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.534+0000 7ff3ea185640 10 monclient: monmap: 2026-02-17T12:00:17.536 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:17.536 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:17.536 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:17.535251+0000 2026-02-17T12:00:17.536 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:17.535251+0000 2026-02-17T12:00:17.536 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:17.536 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:17.537 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:17.537 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:17.537 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:17.537 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:17.537 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:17.537 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:17.537 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.534+0000 7ff3ea185640 1 Processor -- start 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.534+0000 7ff3ea185640 1 -- start start 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.534+0000 7ff3ea185640 10 monclient: init 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient: _add_conns ranks=[3,5,4,0,2,1] 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff3e415d220 0x7ff3e415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient(hunting): picked mon.noname-a con 0x7ff3e415d220 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff3e4074920 0x7ff3e40c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient(hunting): picked mon.noname-c con 0x7ff3e4074920 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:17.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff3e40c9120 0x7ff3e4153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient(hunting): picked mon.noname-b con 0x7ff3e40c9120 addr v2:10.20.193.71:3300/0 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e40c95b0 con 0x7ff3e415d220 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e40c58a0 con 0x7ff3e40c9120 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e40c55c0 con 0x7ff3e4074920 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3ea185640 10 monclient(hunting): authenticate will time out at 1287.257073s 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e37fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff3e415d220 0x7ff3e415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e2ffd640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7ff3e4074920 0x7ff3e40c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e3fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7ff3e40c9120 0x7ff3e4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e37fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7ff3e415d220 0x7ff3e415d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:51984/0 (socket says 10.20.193.10:51984) 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e37fe640 1 -- 10.20.193.10:0/958898987 learned_addr learned my addr 10.20.193.10:0/958898987 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e37fe640 10 monclient(hunting): get_auth_request con 0x7ff3e415d220 auth_method 0 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e2ffd640 10 monclient(hunting): get_auth_request con 0x7ff3e4074920 auth_method 0 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e3fff640 10 monclient(hunting): get_auth_request con 0x7ff3e40c9120 auth_method 0 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.535+0000 7ff3e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e37fe640 10 monclient(hunting): handle_auth_done global_id 4983 payload 274 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e37fe640 1 -- 10.20.193.10:0/958898987 >> v2:10.20.193.153:3300/0 conn(0x7ff3e4074920 msgr2=0x7ff3e40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:17.544 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e37fe640 1 --2- 10.20.193.10:0/958898987 >> v2:10.20.193.153:3300/0 conn(0x7ff3e4074920 0x7ff3e40c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.536+0000 7ff3e37fe640 1 -- 10.20.193.10:0/958898987 >> v2:10.20.193.71:3300/0 conn(0x7ff3e40c9120 msgr2=0x7ff3e4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:17.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.537+0000 7ff3e37fe640 1 --2- 10.20.193.10:0/958898987 >> v2:10.20.193.71:3300/0 conn(0x7ff3e40c9120 0x7ff3e4153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.537+0000 7ff3e37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:17.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.537+0000 7ff3e37fe640 1 monclient: found mon.noname-a 2026-02-17T12:00:17.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.537+0000 7ff3e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:17.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.537+0000 7ff3e37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:17.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.537+0000 7ff3e37fe640 1 -- 10.20.193.10:0/958898987 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e40c7e20 con 0x7ff3e415d220 2026-02-17T12:00:17.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.537+0000 7ff3e37fe640 1 --2- 10.20.193.10:0/958898987 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e415d220 0x7ff3e415d600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40c6b30 tx=0x7ff3d002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dec43f20d132922 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 1 -- 10.20.193.10:0/958898987 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d003c070 con 0x7ff3e415d220 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 10 monclient: dump: 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:17.552 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 10 monclient: _finish_auth 0 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3ea185640 5 monclient: authenticate success, global_id 4983 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 1 -- 10.20.193.10:0/958898987 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d002fb50 con 0x7ff3e415d220 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 1 -- 10.20.193.10:0/958898987 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0037440 con 0x7ff3e415d220 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.539+0000 7ff3e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3e27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:17.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3e27fc640 10 monclient: dump: 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:17.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 4 set_mon_vals no callback set 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 10 monclient: shutdown 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 1 -- 10.20.193.10:0/958898987 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e415d220 msgr2=0x7ff3e415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 1 --2- 10.20.193.10:0/958898987 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e415d220 0x7ff3e415d600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40c6b30 tx=0x7ff3d002eed0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 1 -- 10.20.193.10:0/958898987 shutdown_connections 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 1 --2- 10.20.193.10:0/958898987 >> v2:10.20.193.71:3300/0 conn(0x7ff3e40c9120 0x7ff3e4153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 1 --2- 10.20.193.10:0/958898987 >> v2:10.20.193.153:3300/0 conn(0x7ff3e4074920 0x7ff3e40c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 1 --2- 10.20.193.10:0/958898987 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e415d220 0x7ff3e415d600 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 1 -- 10.20.193.10:0/958898987 >> 10.20.193.10:0/958898987 conn(0x7ff3e40c9d80 msgr2=0x7ff3e40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 1 -- 10.20.193.10:0/958898987 shutdown_connections 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 1 -- 10.20.193.10:0/958898987 wait complete. 2026-02-17T12:00:17.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 10 monclient: build_initial_monmap 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.540+0000 7ff3ea185640 10 monclient: monmap: 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:17.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 librados: starting msgr at 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 librados: starting objecter 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 Processor -- start 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 -- start start 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 librados: setting wanted keys 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 librados: calling monclient init 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient: init 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3e4074920 0x7ff3e40cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient(hunting): picked mon.noname-c con 0x7ff3e4074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e40c9120 0x7ff3e41f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient(hunting): picked mon.noname-a con 0x7ff3e40c9120 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:17.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3e415d220 0x7ff3e415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient(hunting): picked mon.noname-b con 0x7ff3e415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40c86c0 con 0x7ff3e40c9120 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40c83e0 con 0x7ff3e415d220 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e4074d70 con 0x7ff3e4074920 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3ea185640 10 monclient(hunting): authenticate will time out at 1287.263526s 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3e2ffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e40c9120 0x7ff3e41f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3e3fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3e415d220 0x7ff3e415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3e2ffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e40c9120 0x7ff3e41f3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:51994/0 (socket says 10.20.193.10:51994) 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.541+0000 7ff3e2ffd640 1 -- 10.20.193.10:0/481418762 learned_addr learned my addr 10.20.193.10:0/481418762 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e2ffd640 10 monclient(hunting): get_auth_request con 0x7ff3e40c9120 auth_method 0 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e37fe640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3e4074920 0x7ff3e40cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e3fff640 10 monclient(hunting): get_auth_request con 0x7ff3e415d220 auth_method 0 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e37fe640 10 monclient(hunting): get_auth_request con 0x7ff3e4074920 auth_method 0 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.542+0000 7ff3e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 10 monclient(hunting): handle_auth_done global_id 4986 payload 824 2026-02-17T12:00:17.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 1 -- 10.20.193.10:0/481418762 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3e4074920 msgr2=0x7ff3e40cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3e4074920 0x7ff3e40cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 1 -- 10.20.193.10:0/481418762 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3e415d220 msgr2=0x7ff3e415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3e415d220 0x7ff3e415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 1 monclient: found mon.noname-a 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.543+0000 7ff3e2ffd640 1 -- 10.20.193.10:0/481418762 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e41f22e0 con 0x7ff3e40c9120 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.544+0000 7ff3e2ffd640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e40c9120 0x7ff3e41f3f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400ec10 tx=0x7ff3d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.544+0000 7ff3bffff640 10 client.?.objecter ms_handle_connect 0x7ff3e40c9120 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.544+0000 7ff3bffff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 1 -- 10.20.193.10:0/481418762 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4017070 con 0x7ff3e40c9120 2026-02-17T12:00:17.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 10 monclient: dump: 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:17.562 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 10 monclient: _finish_auth 0 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 5 monclient: authenticate success, global_id 4986 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 1 -- 10.20.193.10:0/481418762 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d400cc40 con 0x7ff3e40c9120 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 1 -- 10.20.193.10:0/481418762 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4013470 con 0x7ff3e40c9120 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 10 monclient: _renew_subs 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3e1ffb640 4 set_mon_vals no callback set 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e40cb210 con 0x7ff3e40c9120 2026-02-17T12:00:17.563 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3bffff640 10 monclient: dump: 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:17.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 10 client.4986.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:17.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 10 monclient: _renew_subs 2026-02-17T12:00:17.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:17.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e40cb4b0 con 0x7ff3e40c9120 2026-02-17T12:00:17.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 1 librados: init done 2026-02-17T12:00:17.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:17.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:17.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:17.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.546+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e40c8be0 con 0x7ff3e40c9120 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.558+0000 7ff3bffff640 1 -- 10.20.193.10:0/481418762 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7ff3d4024060 con 0x7ff3e40c9120 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.559+0000 7ff3bffff640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3b4078e00 0x7ff3b407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.559+0000 7ff3e37fe640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3b4078e00 0x7ff3b407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.559+0000 7ff3e37fe640 10 monclient: get_auth_request con 0x7ff3b4078e00 auth_method 0 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.559+0000 7ff3bffff640 10 client.4986.objecter ms_handle_connect 0x7ff3b4078e00 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.559+0000 7ff3e37fe640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3b4078e00 0x7ff3b407b2c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4076d10 tx=0x7ff3d0039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.561+0000 7ff3bffff640 1 -- 10.20.193.10:0/481418762 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff3d405e2c0 con 0x7ff3e40c9120 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.561+0000 7ff3bffff640 10 client.4986.objecter ms_dispatch2 0x7ff3e4000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.561+0000 7ff3bffff640 3 client.4986.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:17.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.561+0000 7ff3bffff640 3 client.4986.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:17.568 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.561+0000 7ff3bffff640 20 client.4986.objecter dump_active .. 0 homeless 2026-02-17T12:00:17.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.663+0000 7ff3bffff640 1 -- 10.20.193.10:0/481418762 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff3d4062280 con 0x7ff3e40c9120 2026-02-17T12:00:17.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.663+0000 7ff3bffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:17.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.663+0000 7ff3bffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:17.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.762+0000 7ff3ea185640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:17.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.762+0000 7ff3ea185640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:17.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.762+0000 7ff3ea185640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:17.764 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.762+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff3e41573e0 con 0x7ff3e40c9120 2026-02-17T12:00:17.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.769+0000 7ff3bffff640 1 -- 10.20.193.10:0/481418762 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7ff3d4066580 con 0x7ff3e40c9120 2026-02-17T12:00:17.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.769+0000 7ff3bffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:17.771 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.769+0000 7ff3bffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:17.771 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:17.771 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:17.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 10 librados: watch_flush enter 2026-02-17T12:00:17.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 10 librados: watch_flush exit 2026-02-17T12:00:17.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 20 client.4986.objecter shutdown clearing up homeless session... 2026-02-17T12:00:17.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 10 client.4986.objecter successfully canceled tick 2026-02-17T12:00:17.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3b4078e00 msgr2=0x7ff3b407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3b4078e00 0x7ff3b407b2c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4076d10 tx=0x7ff3d0039040 comp rx=0 tx=0).stop 2026-02-17T12:00:17.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 10 monclient: shutdown 2026-02-17T12:00:17.773 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e40c9120 msgr2=0x7ff3e41f3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e40c9120 0x7ff3e41f3f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400ec10 tx=0x7ff3d400c520 comp rx=0 tx=0).stop 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 shutdown_connections 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7ff3b4078e00 0x7ff3b407b2c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7ff3e415d220 0x7ff3e415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7ff3e40c9120 0x7ff3e41f3f70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 --2- 10.20.193.10:0/481418762 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff3e4074920 0x7ff3e40cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 >> 10.20.193.10:0/481418762 conn(0x7ff3e40c9d80 msgr2=0x7ff3e406f490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 shutdown_connections 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 -- 10.20.193.10:0/481418762 wait complete. 2026-02-17T12:00:17.774 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:17.770+0000 7ff3ea185640 1 librados: shutdown 2026-02-17T12:00:20.782 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:20.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.851+0000 7faca94de640 10 monclient: get_monmap_and_config 2026-02-17T12:00:20.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.851+0000 7faca94de640 10 monclient: build_initial_monmap 2026-02-17T12:00:20.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.851+0000 7faca94de640 10 monclient: monmap: 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:20.852622+0000 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:20.852622+0000 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:20.854 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:20.855 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:20.855 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:20.855 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:20.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.851+0000 7faca94de640 1 Processor -- start 2026-02-17T12:00:20.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.851+0000 7faca94de640 1 -- start start 2026-02-17T12:00:20.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.851+0000 7faca94de640 10 monclient: init 2026-02-17T12:00:20.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:20.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 10 monclient: _add_conns ranks=[5,0,3,4,1,2] 2026-02-17T12:00:20.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7faca4155fd0 0x7faca40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:20.859 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 10 monclient(hunting): picked mon.noname-c con 0x7faca4155fd0 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faca4073b90 addr v1:10.20.193.10:6789/0 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7faca40cd9c0 0x7faca40ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 10 monclient(hunting): picked mon.noname-a con 0x7faca40cd9c0 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca40cd240 con 0x7faca4073b90 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7faca4160260 con 0x7faca40cd9c0 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7faca40cbb80 con 0x7faca4155fd0 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca94de640 10 monclient(hunting): authenticate will time out at 1290.574434s 2026-02-17T12:00:20.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.852+0000 7faca37fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7faca40cd9c0 0x7faca40ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca37fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7faca40cd9c0 0x7faca40ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:52002/0 (socket says 10.20.193.10:52002) 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca37fe640 1 -- 10.20.193.10:0/2590396469 learned_addr learned my addr 10.20.193.10:0/2590396469 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca37fe640 10 monclient(hunting): get_auth_request con 0x7faca40cd9c0 auth_method 0 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca2ffd640 1 --2- 10.20.193.10:0/2590396469 >> v2:10.20.193.153:3300/0 conn(0x7faca4155fd0 0x7faca40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca2ffd640 10 monclient(hunting): get_auth_request con 0x7faca4155fd0 auth_method 0 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:20.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.853+0000 7faca2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.854+0000 7faca37fe640 10 monclient(hunting): handle_auth_done global_id 4989 payload 274 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.854+0000 7faca37fe640 1 -- 10.20.193.10:0/2590396469 >> v2:10.20.193.153:3300/0 conn(0x7faca4155fd0 msgr2=0x7faca40ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.854+0000 7faca37fe640 1 --2- 10.20.193.10:0/2590396469 >> v2:10.20.193.153:3300/0 conn(0x7faca4155fd0 0x7faca40ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:20.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.854+0000 7faca37fe640 1 -- 10.20.193.10:0/2590396469 >> v1:10.20.193.10:6789/0 conn(0x7faca4073b90 legacy=0x7faca415f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:20.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.854+0000 7faca37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:20.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.854+0000 7faca37fe640 1 monclient: found mon.noname-a 2026-02-17T12:00:20.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.854+0000 7faca37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:20.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.854+0000 7faca37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:20.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.854+0000 7faca37fe640 1 -- 10.20.193.10:0/2590396469 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca40ccc80 con 0x7faca40cd9c0 2026-02-17T12:00:20.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.855+0000 7faca37fe640 1 --2- 10.20.193.10:0/2590396469 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 0x7faca40ced80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faca408f610 tx=0x7fac9402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbc685cadde8275 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:20.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 1 -- 10.20.193.10:0/2590396469 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9402fc50 con 0x7faca40cd9c0 2026-02-17T12:00:20.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:20.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:20.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 10 monclient: dump: 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:20.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 1 -- 10.20.193.10:0/2590396469 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac9402fdf0 con 0x7faca40cd9c0 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca94de640 5 monclient: authenticate success, global_id 4989 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca94de640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 1 -- 10.20.193.10:0/2590396469 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94037610 con 0x7faca40cd9c0 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca1ffb640 10 monclient: dump: 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:20.872 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca94de640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.857+0000 7faca94de640 4 set_mon_vals no callback set 2026-02-17T12:00:20.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 10 monclient: shutdown 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 1 -- 10.20.193.10:0/2590396469 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 msgr2=0x7faca40ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 1 --2- 10.20.193.10:0/2590396469 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 0x7faca40ced80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faca408f610 tx=0x7fac9402f230 comp rx=0 tx=0).stop 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 1 -- 10.20.193.10:0/2590396469 shutdown_connections 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 1 --2- 10.20.193.10:0/2590396469 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 0x7faca40ced80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 1 --2- 10.20.193.10:0/2590396469 >> v2:10.20.193.153:3300/0 conn(0x7faca4155fd0 0x7faca40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 1 -- 10.20.193.10:0/2590396469 >> 10.20.193.10:0/2590396469 conn(0x7faca4073070 msgr2=0x7faca4073480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 1 -- 10.20.193.10:0/2590396469 shutdown_connections 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 1 -- 10.20.193.10:0/2590396469 wait complete. 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 10 monclient: build_initial_monmap 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.858+0000 7faca94de640 10 monclient: monmap: 2026-02-17T12:00:20.874 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 librados: starting msgr at 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 librados: starting objecter 2026-02-17T12:00:20.875 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 Processor -- start 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 -- start start 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 librados: setting wanted keys 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 librados: calling monclient init 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient: init 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faca4073b90 0x7faca4153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient(hunting): picked mon.noname-c con 0x7faca4073b90 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 0x7faca41f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient(hunting): picked mon.noname-a con 0x7faca40cd9c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faca4155fd0 0x7faca414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:20.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient(hunting): picked mon.noname-b con 0x7faca4155fd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7faca40ce320 con 0x7faca40cd9c0 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7faca40ce040 con 0x7faca4155fd0 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7faca40cd470 con 0x7faca4073b90 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca94de640 10 monclient(hunting): authenticate will time out at 1290.581494s 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca27fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 0x7faca41f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca2ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faca4073b90 0x7faca4153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca27fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 0x7faca41f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:52004/0 (socket says 10.20.193.10:52004) 2026-02-17T12:00:20.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca27fc640 1 -- 10.20.193.10:0/606415336 learned_addr learned my addr 10.20.193.10:0/606415336 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca27fc640 10 monclient(hunting): get_auth_request con 0x7faca40cd9c0 auth_method 0 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.859+0000 7faca27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca2ffd640 10 monclient(hunting): get_auth_request con 0x7faca4073b90 auth_method 0 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca37fe640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faca4155fd0 0x7faca414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:20.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca37fe640 10 monclient(hunting): get_auth_request con 0x7faca4155fd0 auth_method 0 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.860+0000 7faca37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 10 monclient(hunting): handle_auth_done global_id 4992 payload 824 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 1 -- 10.20.193.10:0/606415336 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faca4073b90 msgr2=0x7faca4153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:20.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faca4073b90 0x7faca4153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 1 -- 10.20.193.10:0/606415336 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faca4155fd0 msgr2=0x7faca414b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faca4155fd0 0x7faca414b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 10 monclient: _finish_hunting 0 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 1 monclient: found mon.noname-a 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.861+0000 7faca27fc640 1 -- 10.20.193.10:0/606415336 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca4154220 con 0x7faca40cd9c0 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.862+0000 7faca27fc640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 0x7faca41f1af0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00b750 tx=0x7fac8c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.862+0000 7fac837fe640 10 client.?.objecter ms_handle_connect 0x7faca40cd9c0 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.862+0000 7fac837fe640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:20.880 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 1 -- 10.20.193.10:0/606415336 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c004480 con 0x7faca40cd9c0 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 10 monclient: dump: 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:20.881 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 10 monclient: _finish_auth 0 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 10 monclient: _check_auth_tickets 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 1 -- 10.20.193.10:0/606415336 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c010070 con 0x7faca40cd9c0 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7faca94de640 5 monclient: authenticate success, global_id 4992 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:20.882 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 1 -- 10.20.193.10:0/606415336 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c002a10 con 0x7faca40cd9c0 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7faca17fa640 4 set_mon_vals no callback set 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7fac837fe640 10 monclient: dump: 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:20.883 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7faca94de640 10 monclient: _renew_subs 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7faca94de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.863+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca4154500 con 0x7faca40cd9c0 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.864+0000 7faca94de640 10 client.4992.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.864+0000 7faca94de640 10 monclient: _renew_subs 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.864+0000 7faca94de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:20.884 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.864+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca4154ac0 con 0x7faca40cd9c0 2026-02-17T12:00:20.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.864+0000 7faca94de640 1 librados: init done 2026-02-17T12:00:20.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.864+0000 7faca94de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:20.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.864+0000 7faca94de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:20.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.864+0000 7faca94de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:20.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.864+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca40cd710 con 0x7faca40cd9c0 2026-02-17T12:00:20.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.876+0000 7fac837fe640 1 -- 10.20.193.10:0/606415336 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fac8c005ac0 con 0x7faca40cd9c0 2026-02-17T12:00:20.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.876+0000 7fac837fe640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac70078e50 0x7fac7007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:20.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.876+0000 7faca2ffd640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac70078e50 0x7fac7007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:20.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.876+0000 7faca2ffd640 10 monclient: get_auth_request con 0x7fac70078e50 auth_method 0 2026-02-17T12:00:20.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.877+0000 7faca2ffd640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac70078e50 0x7fac7007b310 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fac98009ba0 tx=0x7fac98009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:20.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.877+0000 7fac837fe640 10 client.4992.objecter ms_handle_connect 0x7fac70078e50 2026-02-17T12:00:20.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.878+0000 7fac837fe640 1 -- 10.20.193.10:0/606415336 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fac8c005de0 con 0x7faca40cd9c0 2026-02-17T12:00:20.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.878+0000 7fac837fe640 10 client.4992.objecter ms_dispatch2 0x7faca4000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:20.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.878+0000 7fac837fe640 3 client.4992.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:20.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.878+0000 7fac837fe640 3 client.4992.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:20.888 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.878+0000 7fac837fe640 20 client.4992.objecter dump_active .. 0 homeless 2026-02-17T12:00:20.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.976+0000 7fac837fe640 1 -- 10.20.193.10:0/606415336 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fac8c061460 con 0x7faca40cd9c0 2026-02-17T12:00:20.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.976+0000 7fac837fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:20.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:20.976+0000 7fac837fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:21.077 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.076+0000 7faca94de640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:21.078 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.076+0000 7faca94de640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:21.078 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.076+0000 7faca94de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:21.078 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.076+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faca4069b50 con 0x7faca40cd9c0 2026-02-17T12:00:21.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.078+0000 7fac837fe640 1 -- 10.20.193.10:0/606415336 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fac8c065760 con 0x7faca40cd9c0 2026-02-17T12:00:21.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.078+0000 7fac837fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:21.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.078+0000 7fac837fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:21.080 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:21.080 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 10 librados: watch_flush enter 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 10 librados: watch_flush exit 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 20 client.4992.objecter shutdown clearing up homeless session... 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 10 client.4992.objecter successfully canceled tick 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac70078e50 msgr2=0x7fac7007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac70078e50 0x7fac7007b310 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fac98009ba0 tx=0x7fac98009290 comp rx=0 tx=0).stop 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 10 monclient: shutdown 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 msgr2=0x7faca41f1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 0x7faca41f1af0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00b750 tx=0x7fac8c00bc20 comp rx=0 tx=0).stop 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 shutdown_connections 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fac70078e50 0x7fac7007b310 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faca4155fd0 0x7faca414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.081 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faca40cd9c0 0x7faca41f1af0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.082 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 --2- 10.20.193.10:0/606415336 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faca4073b90 0x7faca4153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:21.082 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 >> 10.20.193.10:0/606415336 conn(0x7faca4073070 msgr2=0x7faca4151820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:21.082 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 shutdown_connections 2026-02-17T12:00:21.082 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 -- 10.20.193.10:0/606415336 wait complete. 2026-02-17T12:00:21.082 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:21.079+0000 7faca94de640 1 librados: shutdown 2026-02-17T12:00:24.090 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:24.160 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.159+0000 7faef8887640 10 monclient: get_monmap_and_config 2026-02-17T12:00:24.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.159+0000 7faef8887640 10 monclient: build_initial_monmap 2026-02-17T12:00:24.161 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.159+0000 7faef8887640 10 monclient: monmap: 2026-02-17T12:00:24.161 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:24.161 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:24.161 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:24.159572+0000 2026-02-17T12:00:24.161 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:24.159572+0000 2026-02-17T12:00:24.161 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:24.161 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.159+0000 7faef8887640 1 Processor -- start 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.159+0000 7faef8887640 1 -- start start 2026-02-17T12:00:24.162 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.159+0000 7faef8887640 10 monclient: init 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 10 monclient: _add_conns ranks=[0,1,4,3,2,5] 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faef0152660 addr v1:10.20.193.10:6789/0 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7faef015b030 addr v1:10.20.193.71:6789/0 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7faef00c6ce0 0x7faef01631a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 10 monclient(hunting): picked mon.noname-b con 0x7faef00c6ce0 addr v2:10.20.193.71:3300/0 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef00c71e0 con 0x7faef0152660 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef00c74c0 con 0x7faef015b030 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7faef00c77a0 con 0x7faef00c6ce0 2026-02-17T12:00:24.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef8887640 10 monclient(hunting): authenticate will time out at 1293.881315s 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef65fc640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7faef0152660 0x7faef015a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:53096/0 (socket says 10.20.193.10:53096) 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef65fc640 1 -- 10.20.193.10:0/2159866861 learned_addr learned my addr 10.20.193.10:0/2159866861 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.160+0000 7faef6dfd640 1 --2- 10.20.193.10:0/2159866861 >> v2:10.20.193.71:3300/0 conn(0x7faef00c6ce0 0x7faef01631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef6dfd640 10 monclient(hunting): get_auth_request con 0x7faef00c6ce0 auth_method 0 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef6dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef6dfd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef6dfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef6dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef6dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef6dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:24.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef55fa640 1 -- 10.20.193.10:0/2159866861 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153980086 0 0) 0x7faef00c71e0 con 0x7faef0152660 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef55fa640 10 monclient(hunting): _negotiate 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef55fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef55fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef55fa640 10 monclient(hunting): my global_id is 4995 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.161+0000 7faef55fa640 1 -- 10.20.193.10:0/2159866861 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faee0003620 con 0x7faef0152660 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.162+0000 7faef6dfd640 10 monclient(hunting): handle_auth_done global_id 5032 payload 274 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.162+0000 7faef6dfd640 1 -- 10.20.193.10:0/2159866861 >> v1:10.20.193.71:6789/0 conn(0x7faef015b030 legacy=0x7faef00c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.162+0000 7faef6dfd640 1 -- 10.20.193.10:0/2159866861 >> v1:10.20.193.10:6789/0 conn(0x7faef0152660 legacy=0x7faef015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.162+0000 7faef6dfd640 10 monclient: _finish_hunting 0 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.162+0000 7faef6dfd640 1 monclient: found mon.noname-b 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.162+0000 7faef6dfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.162+0000 7faef6dfd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:00:24.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.162+0000 7faef6dfd640 1 -- 10.20.193.10:0/2159866861 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef0159e40 con 0x7faef00c6ce0 2026-02-17T12:00:24.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.164+0000 7faef6dfd640 1 --2- 10.20.193.10:0/2159866861 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faef00c6ce0 0x7faef01631a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faee4009d90 tx=0x7faee402f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d27934fe5d2af573 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:24.173 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 1 -- 10.20.193.10:0/2159866861 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee403c070 con 0x7faef00c6ce0 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 10 monclient: dump: 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:24.174 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 10 monclient: _finish_auth 0 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 10 monclient: _check_auth_tickets 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 1 -- 10.20.193.10:0/2159866861 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee4037440 con 0x7faef00c6ce0 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef8887640 5 monclient: authenticate success, global_id 5032 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef8887640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 1 -- 10.20.193.10:0/2159866861 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4037810 con 0x7faef00c6ce0 2026-02-17T12:00:24.175 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef55fa640 10 monclient: dump: 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:24.176 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef8887640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.166+0000 7faef8887640 4 set_mon_vals no callback set 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 10 monclient: shutdown 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 1 -- 10.20.193.10:0/2159866861 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faef00c6ce0 msgr2=0x7faef01631a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 1 --2- 10.20.193.10:0/2159866861 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faef00c6ce0 0x7faef01631a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faee4009d90 tx=0x7faee402f230 comp rx=0 tx=0).stop 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 1 -- 10.20.193.10:0/2159866861 shutdown_connections 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 1 --2- 10.20.193.10:0/2159866861 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faef00c6ce0 0x7faef01631a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 1 -- 10.20.193.10:0/2159866861 >> 10.20.193.10:0/2159866861 conn(0x7faef00c9d80 msgr2=0x7faef00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 1 -- 10.20.193.10:0/2159866861 shutdown_connections 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 1 -- 10.20.193.10:0/2159866861 wait complete. 2026-02-17T12:00:24.177 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 10 monclient: build_initial_monmap 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 10 monclient: monmap: 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 1 librados: starting msgr at 2026-02-17T12:00:24.178 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.167+0000 7faef8887640 1 librados: starting objecter 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 Processor -- start 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 -- start start 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 librados: setting wanted keys 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 librados: calling monclient init 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient: init 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faef00c6ce0 0x7faef01f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient(hunting): picked mon.noname-c con 0x7faef00c6ce0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faef0152660 0x7faef00cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient(hunting): picked mon.noname-b con 0x7faef0152660 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:24.179 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faef015b030 0x7faef0073e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient(hunting): picked mon.noname-a con 0x7faef015b030 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7faef00c94e0 con 0x7faef015b030 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7faef015a400 con 0x7faef0152660 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7faef00c9660 con 0x7faef00c6ce0 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef8887640 10 monclient(hunting): authenticate will time out at 1293.889490s 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef6dfd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faef015b030 0x7faef0073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef5dfb640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faef0152660 0x7faef00cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:24.180 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef6dfd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faef015b030 0x7faef0073e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:34108/0 (socket says 10.20.193.10:34108) 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef6dfd640 1 -- 10.20.193.10:0/2442685513 learned_addr learned my addr 10.20.193.10:0/2442685513 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef6dfd640 10 monclient(hunting): get_auth_request con 0x7faef015b030 auth_method 0 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef6dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef6dfd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.168+0000 7faef6dfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef5dfb640 10 monclient(hunting): get_auth_request con 0x7faef0152660 auth_method 0 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef5dfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef5dfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef5dfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef65fc640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faef00c6ce0 0x7faef01f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef6dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:24.181 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef6dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef6dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef65fc640 10 monclient(hunting): get_auth_request con 0x7faef00c6ce0 auth_method 0 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef65fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef65fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef65fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef5dfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef5dfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef5dfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef65fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef65fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.169+0000 7faef65fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 10 monclient(hunting): handle_auth_done global_id 4998 payload 824 2026-02-17T12:00:24.182 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 1 -- 10.20.193.10:0/2442685513 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faef00c6ce0 msgr2=0x7faef01f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faef00c6ce0 0x7faef01f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 1 -- 10.20.193.10:0/2442685513 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faef0152660 msgr2=0x7faef00cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faef0152660 0x7faef00cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 10 monclient: _finish_hunting 0 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 1 monclient: found mon.noname-a 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.170+0000 7faef6dfd640 1 -- 10.20.193.10:0/2442685513 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef00cbe50 con 0x7faef015b030 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.171+0000 7faef6dfd640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faef015b030 0x7faef0073e60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faee403a040 tx=0x7faee4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.171+0000 7faedaffd640 10 client.?.objecter ms_handle_connect 0x7faef015b030 2026-02-17T12:00:24.183 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.171+0000 7faedaffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:24.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 1 -- 10.20.193.10:0/2442685513 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee403c050 con 0x7faef015b030 2026-02-17T12:00:24.185 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 10 monclient: dump: 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:24.186 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 10 monclient: _finish_auth 0 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 1 -- 10.20.193.10:0/2442685513 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee4048070 con 0x7faef015b030 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef8887640 5 monclient: authenticate success, global_id 4998 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef8887640 10 monclient: _renew_subs 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef8887640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef00cc130 con 0x7faef015b030 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 1 -- 10.20.193.10:0/2442685513 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4041a30 con 0x7faef015b030 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:24.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faedaffd640 10 monclient: dump: 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:24.188 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef4df9640 4 set_mon_vals no callback set 2026-02-17T12:00:24.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef8887640 10 client.4998.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:24.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef8887640 10 monclient: _renew_subs 2026-02-17T12:00:24.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef8887640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:24.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef00cc6f0 con 0x7faef015b030 2026-02-17T12:00:24.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.173+0000 7faef8887640 1 librados: init done 2026-02-17T12:00:24.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.174+0000 7faef8887640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:24.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.174+0000 7faef8887640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:24.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.174+0000 7faef8887640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:24.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.174+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef0152a40 con 0x7faef015b030 2026-02-17T12:00:24.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.185+0000 7faedaffd640 1 -- 10.20.193.10:0/2442685513 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7faee4041bd0 con 0x7faef015b030 2026-02-17T12:00:24.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.185+0000 7faedaffd640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faec0078e50 0x7faec007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:24.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.186+0000 7faef65fc640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faec0078e50 0x7faec007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:24.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.186+0000 7faef65fc640 10 monclient: get_auth_request con 0x7faec0078e50 auth_method 0 2026-02-17T12:00:24.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.186+0000 7faedaffd640 10 client.4998.objecter ms_handle_connect 0x7faec0078e50 2026-02-17T12:00:24.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.186+0000 7faef65fc640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faec0078e50 0x7faec007b310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faee8007b60 tx=0x7faee8007ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:24.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.188+0000 7faedaffd640 1 -- 10.20.193.10:0/2442685513 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7faee4084400 con 0x7faef015b030 2026-02-17T12:00:24.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.188+0000 7faedaffd640 10 client.4998.objecter ms_dispatch2 0x7faef0000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:24.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.188+0000 7faedaffd640 3 client.4998.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:24.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.188+0000 7faedaffd640 3 client.4998.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:24.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.188+0000 7faedaffd640 20 client.4998.objecter dump_active .. 0 homeless 2026-02-17T12:00:24.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.288+0000 7faedaffd640 1 -- 10.20.193.10:0/2442685513 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faee40883c0 con 0x7faef015b030 2026-02-17T12:00:24.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.288+0000 7faedaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:24.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.288+0000 7faedaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:24.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.385+0000 7faef8887640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:24.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.385+0000 7faef8887640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:24.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.385+0000 7faef8887640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:24.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.385+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faef0150300 con 0x7faef015b030 2026-02-17T12:00:24.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.388+0000 7faedaffd640 1 -- 10.20.193.10:0/2442685513 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7faee408c6c0 con 0x7faef015b030 2026-02-17T12:00:24.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.388+0000 7faedaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:24.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.388+0000 7faedaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:24.390 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:24.390 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:24.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 10 librados: watch_flush enter 2026-02-17T12:00:24.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 10 librados: watch_flush exit 2026-02-17T12:00:24.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 20 client.4998.objecter shutdown clearing up homeless session... 2026-02-17T12:00:24.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 10 client.4998.objecter successfully canceled tick 2026-02-17T12:00:24.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faec0078e50 msgr2=0x7faec007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:24.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faec0078e50 0x7faec007b310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faee8007b60 tx=0x7faee8007ab0 comp rx=0 tx=0).stop 2026-02-17T12:00:24.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 10 monclient: shutdown 2026-02-17T12:00:24.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:24.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faef015b030 msgr2=0x7faef0073e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faef015b030 0x7faef0073e60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faee403a040 tx=0x7faee4004b40 comp rx=0 tx=0).stop 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 shutdown_connections 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7faec0078e50 0x7faec007b310 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faef015b030 0x7faef0073e60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faef0152660 0x7faef00cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 --2- 10.20.193.10:0/2442685513 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faef00c6ce0 0x7faef01f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 >> 10.20.193.10:0/2442685513 conn(0x7faef00c9d80 msgr2=0x7faef006b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 shutdown_connections 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 -- 10.20.193.10:0/2442685513 wait complete. 2026-02-17T12:00:24.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:24.389+0000 7faef8887640 1 librados: shutdown 2026-02-17T12:00:27.399 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:27.473 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.472+0000 7f9411949640 10 monclient: get_monmap_and_config 2026-02-17T12:00:27.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.472+0000 7f9411949640 10 monclient: build_initial_monmap 2026-02-17T12:00:27.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.472+0000 7f9411949640 10 monclient: monmap: 2026-02-17T12:00:27.474 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:27.474 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:27.474 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:27.472613+0000 2026-02-17T12:00:27.474 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:27.472613+0000 2026-02-17T12:00:27.474 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:27.474 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:27.474 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:27.475 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:27.475 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:27.475 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:27.475 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:27.475 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:27.475 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:27.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.472+0000 7f9411949640 1 Processor -- start 2026-02-17T12:00:27.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.472+0000 7f9411949640 1 -- start start 2026-02-17T12:00:27.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.472+0000 7f9411949640 10 monclient: init 2026-02-17T12:00:27.483 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:27.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 10 monclient: _add_conns ranks=[2,1,3,0,4,5] 2026-02-17T12:00:27.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f940c15d220 addr v1:10.20.193.153:6789/0 2026-02-17T12:00:27.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f940c0c92f0 addr v1:10.20.193.71:6789/0 2026-02-17T12:00:27.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f940c153d60 0x7f940c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 10 monclient(hunting): picked mon.noname-a con 0x7f940c153d60 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:27.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f940c0c58a0 con 0x7f940c0c92f0 2026-02-17T12:00:27.484 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f940c0c55c0 con 0x7f940c15d220 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f940c0c7e20 con 0x7f940c153d60 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f9411949640 10 monclient(hunting): authenticate will time out at 1297.194434s 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f940b7fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f940c153d60 0x7f940c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f940affd640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f940c15d220 0x7f940c0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:38326/0 (socket says 10.20.193.10:38326) 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f940affd640 1 -- 10.20.193.10:0/2856590207 learned_addr learned my addr 10.20.193.10:0/2856590207 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f940b7fe640 10 monclient(hunting): get_auth_request con 0x7f940c153d60 auth_method 0 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f940b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:27.485 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f940b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.473+0000 7f940b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.474+0000 7f940b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.474+0000 7f940b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.474+0000 7f940b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.475+0000 7f940b7fe640 10 monclient(hunting): handle_auth_done global_id 5001 payload 274 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.475+0000 7f940b7fe640 1 -- 10.20.193.10:0/2856590207 >> v1:10.20.193.153:6789/0 conn(0x7f940c15d220 legacy=0x7f940c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.475+0000 7f940b7fe640 1 -- 10.20.193.10:0/2856590207 >> v1:10.20.193.71:6789/0 conn(0x7f940c0c92f0 legacy=0x7f940c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.475+0000 7f940b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.475+0000 7f940b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:00:27.486 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.475+0000 7f940b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.475+0000 7f940b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.475+0000 7f940b7fe640 1 -- 10.20.193.10:0/2856590207 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c0c8100 con 0x7f940c153d60 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.476+0000 7f940b7fe640 1 --2- 10.20.193.10:0/2856590207 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c153d60 0x7f940c15d600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009dc0 tx=0x7f93fc02f280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cabfabe4b3d367 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 1 -- 10.20.193.10:0/2856590207 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc03c070 con 0x7f940c153d60 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 10 monclient: dump: 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:27.487 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 10 monclient: _finish_auth 0 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 5 monclient: authenticate success, global_id 5001 2026-02-17T12:00:27.488 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 1 -- 10.20.193.10:0/2856590207 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc037440 con 0x7f940c153d60 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 1 -- 10.20.193.10:0/2856590207 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc037810 con 0x7f940c153d60 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 4 set_mon_vals no callback set 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9409ffb640 10 monclient: dump: 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:27.489 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 10 monclient: shutdown 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 1 -- 10.20.193.10:0/2856590207 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c153d60 msgr2=0x7f940c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.490 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 1 --2- 10.20.193.10:0/2856590207 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c153d60 0x7f940c15d600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009dc0 tx=0x7f93fc02f280 comp rx=0 tx=0).stop 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 1 -- 10.20.193.10:0/2856590207 shutdown_connections 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 1 --2- 10.20.193.10:0/2856590207 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c153d60 0x7f940c15d600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 1 -- 10.20.193.10:0/2856590207 >> 10.20.193.10:0/2856590207 conn(0x7f940c0c9d80 msgr2=0x7f940c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 1 -- 10.20.193.10:0/2856590207 shutdown_connections 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.478+0000 7f9411949640 1 -- 10.20.193.10:0/2856590207 wait complete. 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient: build_initial_monmap 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient: monmap: 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:27.491 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 librados: starting msgr at 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 librados: starting objecter 2026-02-17T12:00:27.492 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 Processor -- start 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 -- start start 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 librados: setting wanted keys 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 librados: calling monclient init 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient: init 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f940c0c92f0 0x7f940c0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient(hunting): picked mon.noname-b con 0x7f940c0c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f940c153d60 0x7f940c1f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient(hunting): picked mon.noname-c con 0x7f940c153d60 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:27.493 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c15d220 0x7f940c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient(hunting): picked mon.noname-a con 0x7f940c15d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f940c074920 con 0x7f940c15d220 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0c86c0 con 0x7f940c0c92f0 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f940c074aa0 con 0x7f940c153d60 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.479+0000 7f9411949640 10 monclient(hunting): authenticate will time out at 1297.200807s 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c15d220 0x7f940c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:27.494 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940affd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f940c0c92f0 0x7f940c0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c15d220 0x7f940c0ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:34128/0 (socket says 10.20.193.10:34128) 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 1 -- 10.20.193.10:0/3625181723 learned_addr learned my addr 10.20.193.10:0/3625181723 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940a7fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f940c153d60 0x7f940c1f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 10 monclient(hunting): get_auth_request con 0x7f940c15d220 auth_method 0 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940a7fc640 10 monclient(hunting): get_auth_request con 0x7f940c153d60 auth_method 0 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:27.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940affd640 10 monclient(hunting): get_auth_request con 0x7f940c0c92f0 auth_method 0 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:27.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.480+0000 7f940affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 10 monclient(hunting): handle_auth_done global_id 5004 payload 824 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 1 -- 10.20.193.10:0/3625181723 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f940c153d60 msgr2=0x7f940c1f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f940c153d60 0x7f940c1f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 1 -- 10.20.193.10:0/3625181723 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f940c0c92f0 msgr2=0x7f940c0cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f940c0c92f0 0x7f940c0cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.481+0000 7f940b7fe640 1 -- 10.20.193.10:0/3625181723 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c072830 con 0x7f940c15d220 2026-02-17T12:00:27.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.482+0000 7f940b7fe640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c15d220 0x7f940c0ccb40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f93fc03a040 tx=0x7f93fc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:27.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.482+0000 7f93e3fff640 10 client.?.objecter ms_handle_connect 0x7f940c15d220 2026-02-17T12:00:27.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.482+0000 7f93e3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:27.500 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 1 -- 10.20.193.10:0/3625181723 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc03c050 con 0x7f940c15d220 2026-02-17T12:00:27.500 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 10 monclient: dump: 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:27.501 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 10 monclient: _finish_auth 0 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 1 -- 10.20.193.10:0/3625181723 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc048070 con 0x7f940c15d220 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 5 monclient: authenticate success, global_id 5004 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 10 monclient: _renew_subs 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:27.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940c0cb740 con 0x7f940c15d220 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 1 -- 10.20.193.10:0/3625181723 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc037e60 con 0x7f940c15d220 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f94097fa640 4 set_mon_vals no callback set 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f93e3fff640 10 monclient: dump: 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:27.503 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 10 client.5004.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 10 monclient: _renew_subs 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c0cbd00 con 0x7f940c15d220 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 1 librados: init done 2026-02-17T12:00:27.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.484+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940c072a00 con 0x7f940c15d220 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.496+0000 7f93e3fff640 1 -- 10.20.193.10:0/3625181723 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f93fc04d460 con 0x7f940c15d220 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.496+0000 7f93e3fff640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f93dc078e50 0x7f93dc07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.496+0000 7f940affd640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f93dc078e50 0x7f93dc07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.496+0000 7f940affd640 10 monclient: get_auth_request con 0x7f93dc078e50 auth_method 0 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.496+0000 7f940affd640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f93dc078e50 0x7f93dc07b310 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9400002770 tx=0x7f9400009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.496+0000 7f93e3fff640 10 client.5004.objecter ms_handle_connect 0x7f93dc078e50 2026-02-17T12:00:27.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.497+0000 7f93e3fff640 1 -- 10.20.193.10:0/3625181723 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f93fc035d40 con 0x7f940c15d220 2026-02-17T12:00:27.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.497+0000 7f93e3fff640 10 client.5004.objecter ms_dispatch2 0x7f940c000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:27.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.497+0000 7f93e3fff640 3 client.5004.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:27.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.497+0000 7f93e3fff640 3 client.5004.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:27.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.497+0000 7f93e3fff640 20 client.5004.objecter dump_active .. 0 homeless 2026-02-17T12:00:27.598 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.597+0000 7f93e3fff640 1 -- 10.20.193.10:0/3625181723 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f93fc0885d0 con 0x7f940c15d220 2026-02-17T12:00:27.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.597+0000 7f93e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:27.599 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.597+0000 7f93e3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:27.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.696+0000 7f9411949640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:27.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.696+0000 7f9411949640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:27.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.696+0000 7f9411949640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:27.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.696+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f940c050a50 con 0x7f940c15d220 2026-02-17T12:00:27.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.699+0000 7f93e3fff640 1 -- 10.20.193.10:0/3625181723 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f940c050a50 con 0x7f940c15d220 2026-02-17T12:00:27.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.699+0000 7f93e3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:27.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.699+0000 7f93e3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:27.701 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:27.701 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:27.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 10 librados: watch_flush enter 2026-02-17T12:00:27.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 10 librados: watch_flush exit 2026-02-17T12:00:27.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 20 client.5004.objecter shutdown clearing up homeless session... 2026-02-17T12:00:27.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 10 client.5004.objecter successfully canceled tick 2026-02-17T12:00:27.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f93dc078e50 msgr2=0x7f93dc07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f93dc078e50 0x7f93dc07b310 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9400002770 tx=0x7f9400009040 comp rx=0 tx=0).stop 2026-02-17T12:00:27.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 10 monclient: shutdown 2026-02-17T12:00:27.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:27.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c15d220 msgr2=0x7f940c0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c15d220 0x7f940c0ccb40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f93fc03a040 tx=0x7f93fc004b40 comp rx=0 tx=0).stop 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 shutdown_connections 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f93dc078e50 0x7f93dc07b310 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f940c15d220 0x7f940c0ccb40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f940c153d60 0x7f940c1f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 --2- 10.20.193.10:0/3625181723 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f940c0c92f0 0x7f940c0cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 >> 10.20.193.10:0/3625181723 conn(0x7f940c0c9d80 msgr2=0x7f940c152590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 shutdown_connections 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 -- 10.20.193.10:0/3625181723 wait complete. 2026-02-17T12:00:27.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:27.700+0000 7f9411949640 1 librados: shutdown 2026-02-17T12:00:30.710 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.777+0000 7fe1840b7640 10 monclient: get_monmap_and_config 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.777+0000 7fe1840b7640 10 monclient: build_initial_monmap 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.777+0000 7fe1840b7640 10 monclient: monmap: 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:30.778305+0000 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:30.778305+0000 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.777+0000 7fe1840b7640 1 Processor -- start 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.777+0000 7fe1840b7640 1 -- start start 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.777+0000 7fe1840b7640 10 monclient: init 2026-02-17T12:00:30.781 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 10 monclient: _add_conns ranks=[4,2,3,5,0,1] 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fe17c152660 0x7fe17c15a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 10 monclient(hunting): picked mon.noname-b con 0x7fe17c152660 addr v2:10.20.193.71:3300/0 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe17c152a40 addr v1:10.20.193.153:6789/0 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fe17c0c94e0 0x7fe17c15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 10 monclient(hunting): picked mon.noname-a con 0x7fe17c0c94e0 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17c0c71e0 con 0x7fe17c152a40 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fe17c0c77a0 con 0x7fe17c0c94e0 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe17c0c74c0 con 0x7fe17c152660 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe1840b7640 10 monclient(hunting): authenticate will time out at 1300.500118s 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe18162b640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fe17c152a40 0x7fe17c0c8dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:38328/0 (socket says 10.20.193.10:38328) 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe18162b640 1 -- 10.20.193.10:0/4080838845 learned_addr learned my addr 10.20.193.10:0/4080838845 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe18262d640 1 --2- 10.20.193.10:0/4080838845 >> v2:10.20.193.10:3300/0 conn(0x7fe17c0c94e0 0x7fe17c15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe181e2c640 1 --2- 10.20.193.10:0/4080838845 >> v2:10.20.193.71:3300/0 conn(0x7fe17c152660 0x7fe17c15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe18262d640 10 monclient(hunting): get_auth_request con 0x7fe17c0c94e0 auth_method 0 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe18262d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe18262d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe18262d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe181e2c640 10 monclient(hunting): get_auth_request con 0x7fe17c152660 auth_method 0 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe181e2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe181e2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.778+0000 7fe181e2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.779+0000 7fe18262d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.779+0000 7fe18262d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.779+0000 7fe18262d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:30.782 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.779+0000 7fe181e2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.779+0000 7fe181e2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.779+0000 7fe181e2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe180e2a640 1 -- 10.20.193.10:0/4080838845 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622353676 0 0) 0x7fe17c0c71e0 con 0x7fe17c152a40 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe180e2a640 10 monclient(hunting): _negotiate 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe180e2a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe180e2a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe180e2a640 10 monclient(hunting): my global_id is 5057 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe180e2a640 1 -- 10.20.193.10:0/4080838845 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe164003620 con 0x7fe17c152a40 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe18262d640 10 monclient(hunting): handle_auth_done global_id 5007 payload 274 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe18262d640 1 -- 10.20.193.10:0/4080838845 >> v2:10.20.193.71:3300/0 conn(0x7fe17c152660 msgr2=0x7fe17c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:30.783 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe18262d640 1 --2- 10.20.193.10:0/4080838845 >> v2:10.20.193.71:3300/0 conn(0x7fe17c152660 0x7fe17c15a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe18262d640 1 -- 10.20.193.10:0/4080838845 >> v1:10.20.193.153:6789/0 conn(0x7fe17c152a40 legacy=0x7fe17c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:30.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe18262d640 10 monclient: _finish_hunting 0 2026-02-17T12:00:30.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe18262d640 1 monclient: found mon.noname-a 2026-02-17T12:00:30.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe18262d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:30.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe18262d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:30.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.780+0000 7fe18262d640 1 -- 10.20.193.10:0/4080838845 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17c159e40 con 0x7fe17c0c94e0 2026-02-17T12:00:30.784 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.781+0000 7fe18262d640 1 --2- 10.20.193.10:0/4080838845 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c0c94e0 0x7fe17c15ae60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe17c076d70 tx=0x7fe17802f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0d341dd3803e53 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.782+0000 7fe180e2a640 1 -- 10.20.193.10:0/4080838845 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17803c070 con 0x7fe17c0c94e0 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.782+0000 7fe180e2a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.782+0000 7fe180e2a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.782+0000 7fe180e2a640 10 monclient: dump: 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.782+0000 7fe180e2a640 10 monclient: _finish_auth 0 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.782+0000 7fe180e2a640 10 monclient: _check_auth_tickets 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.782+0000 7fe180e2a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.782+0000 7fe1840b7640 5 monclient: authenticate success, global_id 5007 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.782+0000 7fe1840b7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe180e2a640 1 -- 10.20.193.10:0/4080838845 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe178037440 con 0x7fe17c0c94e0 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe180e2a640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe180e2a640 1 -- 10.20.193.10:0/4080838845 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1780377f0 con 0x7fe17c0c94e0 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe180e2a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe180e2a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe180e2a640 10 monclient: dump: 2026-02-17T12:00:30.785 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 4 set_mon_vals no callback set 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 10 monclient: shutdown 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 -- 10.20.193.10:0/4080838845 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c0c94e0 msgr2=0x7fe17c15ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 --2- 10.20.193.10:0/4080838845 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c0c94e0 0x7fe17c15ae60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe17c076d70 tx=0x7fe17802f1c0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 -- 10.20.193.10:0/4080838845 shutdown_connections 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 --2- 10.20.193.10:0/4080838845 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c0c94e0 0x7fe17c15ae60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 --2- 10.20.193.10:0/4080838845 >> v2:10.20.193.71:3300/0 conn(0x7fe17c152660 0x7fe17c15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 -- 10.20.193.10:0/4080838845 >> 10.20.193.10:0/4080838845 conn(0x7fe17c0c9d80 msgr2=0x7fe17c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 -- 10.20.193.10:0/4080838845 shutdown_connections 2026-02-17T12:00:30.786 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 -- 10.20.193.10:0/4080838845 wait complete. 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 10 monclient: build_initial_monmap 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 10 monclient: monmap: 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 librados: starting msgr at 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.783+0000 7fe1840b7640 1 librados: starting objecter 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 Processor -- start 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 -- start start 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 librados: setting wanted keys 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 librados: calling monclient init 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient: init 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:00:30.788 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe17c0c94e0 0x7fe17c1f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient(hunting): picked mon.noname-c con 0x7fe17c0c94e0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe17c152660 0x7fe17c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient(hunting): picked mon.noname-b con 0x7fe17c152660 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c152a40 0x7fe17c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient(hunting): picked mon.noname-a con 0x7fe17c152a40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c0c5cd0 con 0x7fe17c152a40 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c15a400 con 0x7fe17c152660 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c0c5e50 con 0x7fe17c0c94e0 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe1840b7640 10 monclient(hunting): authenticate will time out at 1300.506501s 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe18262d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c152a40 0x7fe17c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe181e2c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe17c0c94e0 0x7fe17c1f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe18262d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c152a40 0x7fe17c14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:34150/0 (socket says 10.20.193.10:34150) 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe18262d640 1 -- 10.20.193.10:0/76055911 learned_addr learned my addr 10.20.193.10:0/76055911 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe181e2c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe17c0c94e0 0x7fe17c1f1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:51606/0 (socket says 10.20.193.10:51606) 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe18262d640 10 monclient(hunting): get_auth_request con 0x7fe17c152a40 auth_method 0 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe18262d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe18262d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe18262d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe181e2c640 10 monclient(hunting): get_auth_request con 0x7fe17c0c94e0 auth_method 0 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe18162b640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe17c152660 0x7fe17c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe181e2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe181e2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.784+0000 7fe181e2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe181e2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe181e2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:30.789 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe181e2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18262d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18262d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18262d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18162b640 10 monclient(hunting): get_auth_request con 0x7fe17c152660 auth_method 0 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18162b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18162b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18162b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18162b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18162b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.785+0000 7fe18162b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 10 monclient(hunting): handle_auth_done global_id 5010 payload 824 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 1 -- 10.20.193.10:0/76055911 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe17c0c94e0 msgr2=0x7fe17c1f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe17c0c94e0 0x7fe17c1f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 1 -- 10.20.193.10:0/76055911 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe17c152660 msgr2=0x7fe17c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe17c152660 0x7fe17c15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 10 monclient: _finish_hunting 0 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 1 monclient: found mon.noname-a 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:30.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.786+0000 7fe18262d640 1 -- 10.20.193.10:0/76055911 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17c150b00 con 0x7fe17c152a40 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.787+0000 7fe18262d640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c152a40 0x7fe17c14e4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe17802f770 tx=0x7fe178004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.787+0000 7fe16a7fc640 10 client.?.objecter ms_handle_connect 0x7fe17c152a40 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.787+0000 7fe16a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 1 -- 10.20.193.10:0/76055911 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17803c050 con 0x7fe17c152a40 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 10 monclient: dump: 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:30.791 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 5 monclient: authenticate success, global_id 5010 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 1 -- 10.20.193.10:0/76055911 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe178048070 con 0x7fe17c152a40 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 1 -- 10.20.193.10:0/76055911 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178009450 con 0x7fe17c152a40 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16bfff640 4 set_mon_vals no callback set 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe16a7fc640 10 monclient: dump: 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:30.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 10 monclient: _renew_subs 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17c150de0 con 0x7fe17c152a40 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 10 client.5010.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 10 monclient: _renew_subs 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17c14dcb0 con 0x7fe17c152a40 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 1 librados: init done 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:30.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.789+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17c069900 con 0x7fe17c152a40 2026-02-17T12:00:30.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.801+0000 7fe16a7fc640 1 -- 10.20.193.10:0/76055911 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fe178004280 con 0x7fe17c152a40 2026-02-17T12:00:30.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.802+0000 7fe16a7fc640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe14c078e00 0x7fe14c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:30.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.802+0000 7fe181e2c640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe14c078e00 0x7fe14c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:30.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.802+0000 7fe181e2c640 10 monclient: get_auth_request con 0x7fe14c078e00 auth_method 0 2026-02-17T12:00:30.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.802+0000 7fe16a7fc640 10 client.5010.objecter ms_handle_connect 0x7fe14c078e00 2026-02-17T12:00:30.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.802+0000 7fe181e2c640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe14c078e00 0x7fe14c07b2c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009c40 tx=0x7fe16c009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:30.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.803+0000 7fe16a7fc640 1 -- 10.20.193.10:0/76055911 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe178084120 con 0x7fe17c152a40 2026-02-17T12:00:30.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.803+0000 7fe16a7fc640 10 client.5010.objecter ms_dispatch2 0x7fe17c000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:30.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.803+0000 7fe16a7fc640 3 client.5010.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:30.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.803+0000 7fe16a7fc640 3 client.5010.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:30.806 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.803+0000 7fe16a7fc640 20 client.5010.objecter dump_active .. 0 homeless 2026-02-17T12:00:30.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.904+0000 7fe16a7fc640 1 -- 10.20.193.10:0/76055911 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe17c069900 con 0x7fe17c152a40 2026-02-17T12:00:30.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.904+0000 7fe16a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:30.906 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:30.904+0000 7fe16a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:31.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.004+0000 7fe1840b7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:31.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.004+0000 7fe1840b7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:31.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.004+0000 7fe1840b7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:31.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.004+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe17c0c8dd0 con 0x7fe17c152a40 2026-02-17T12:00:31.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.007+0000 7fe16a7fc640 1 -- 10.20.193.10:0/76055911 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fe1780880e0 con 0x7fe17c152a40 2026-02-17T12:00:31.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.007+0000 7fe16a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:31.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.007+0000 7fe16a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:31.009 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:31.009 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:31.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 10 librados: watch_flush enter 2026-02-17T12:00:31.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 10 librados: watch_flush exit 2026-02-17T12:00:31.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 20 client.5010.objecter shutdown clearing up homeless session... 2026-02-17T12:00:31.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 10 client.5010.objecter successfully canceled tick 2026-02-17T12:00:31.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe14c078e00 msgr2=0x7fe14c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:31.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe14c078e00 0x7fe14c07b2c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009c40 tx=0x7fe16c009290 comp rx=0 tx=0).stop 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 10 monclient: shutdown 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c152a40 msgr2=0x7fe17c14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c152a40 0x7fe17c14e4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe17802f770 tx=0x7fe178004b40 comp rx=0 tx=0).stop 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 shutdown_connections 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fe14c078e00 0x7fe14c07b2c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fe17c152a40 0x7fe17c14e4b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fe17c152660 0x7fe17c15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 --2- 10.20.193.10:0/76055911 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe17c0c94e0 0x7fe17c1f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 >> 10.20.193.10:0/76055911 conn(0x7fe17c0c9d80 msgr2=0x7fe17c149b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 shutdown_connections 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 -- 10.20.193.10:0/76055911 wait complete. 2026-02-17T12:00:31.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:31.008+0000 7fe1840b7640 1 librados: shutdown 2026-02-17T12:00:34.019 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:34.090 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.088+0000 7fbde84da640 10 monclient: get_monmap_and_config 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.088+0000 7fbde84da640 10 monclient: build_initial_monmap 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.088+0000 7fbde84da640 10 monclient: monmap: 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:34.089543+0000 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:34.089543+0000 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:34.091 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:34.092 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:34.092 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:34.092 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:34.092 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:34.092 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:34.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.088+0000 7fbde84da640 1 Processor -- start 2026-02-17T12:00:34.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.088+0000 7fbde84da640 1 -- start start 2026-02-17T12:00:34.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.088+0000 7fbde84da640 10 monclient: init 2026-02-17T12:00:34.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:34.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 10 monclient: _add_conns ranks=[2,1,5,3,4,0] 2026-02-17T12:00:34.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbde015d220 addr v1:10.20.193.153:6789/0 2026-02-17T12:00:34.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbde00c92f0 addr v1:10.20.193.71:6789/0 2026-02-17T12:00:34.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fbde0153d60 0x7fbde015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:34.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 10 monclient(hunting): picked mon.noname-c con 0x7fbde0153d60 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:34.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde00c58a0 con 0x7fbde00c92f0 2026-02-17T12:00:34.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde00c55c0 con 0x7fbde015d220 2026-02-17T12:00:34.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbde00c7e20 con 0x7fbde0153d60 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde84da640 10 monclient(hunting): authenticate will time out at 1303.811375s 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde6a50640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fbde0153d60 0x7fbde015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde5a4e640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fbde00c92f0 0x7fbde0153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:34802/0 (socket says 10.20.193.10:34802) 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.089+0000 7fbde5a4e640 1 -- 10.20.193.10:0/4260944649 learned_addr learned my addr 10.20.193.10:0/4260944649 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.090+0000 7fbde6a50640 10 monclient(hunting): get_auth_request con 0x7fbde0153d60 auth_method 0 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.090+0000 7fbde6a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.090+0000 7fbde6a50640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.090+0000 7fbde6a50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.090+0000 7fbde6a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:34.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.090+0000 7fbde6a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.090+0000 7fbde6a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde524d640 1 -- 10.20.193.10:0/4260944649 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697885166 0 0) 0x7fbde00c58a0 con 0x7fbde00c92f0 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde524d640 10 monclient(hunting): _negotiate 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde524d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde524d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde524d640 10 monclient(hunting): my global_id is 5053 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde524d640 1 -- 10.20.193.10:0/4260944649 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc8003620 con 0x7fbde00c92f0 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde6a50640 10 monclient(hunting): handle_auth_done global_id 5063 payload 274 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde6a50640 1 -- 10.20.193.10:0/4260944649 >> v1:10.20.193.153:6789/0 conn(0x7fbde015d220 legacy=0x7fbde00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde6a50640 1 -- 10.20.193.10:0/4260944649 >> v1:10.20.193.71:6789/0 conn(0x7fbde00c92f0 legacy=0x7fbde0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde6a50640 10 monclient: _finish_hunting 0 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde6a50640 1 monclient: found mon.noname-c 2026-02-17T12:00:34.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde6a50640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:34.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde6a50640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:00:34.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.091+0000 7fbde6a50640 1 -- 10.20.193.10:0/4260944649 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde00c8100 con 0x7fbde0153d60 2026-02-17T12:00:34.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.093+0000 7fbde6a50640 1 --2- 10.20.193.10:0/4260944649 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 0x7fbde015d600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009dc0 tx=0x7fbddc02f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a73038fc011c2587 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:34.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 1 -- 10.20.193.10:0/4260944649 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc03c070 con 0x7fbde0153d60 2026-02-17T12:00:34.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 10 monclient: dump: 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:34.105 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 10 monclient: _finish_auth 0 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 10 monclient: _check_auth_tickets 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde84da640 5 monclient: authenticate success, global_id 5063 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde84da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 1 -- 10.20.193.10:0/4260944649 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc037440 con 0x7fbde0153d60 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 1 -- 10.20.193.10:0/4260944649 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc0377f0 con 0x7fbde0153d60 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:34.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde524d640 10 monclient: dump: 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde84da640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:34.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.094+0000 7fbde84da640 4 set_mon_vals no callback set 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 10 monclient: shutdown 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 -- 10.20.193.10:0/4260944649 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 msgr2=0x7fbde015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 --2- 10.20.193.10:0/4260944649 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 0x7fbde015d600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009dc0 tx=0x7fbddc02f230 comp rx=0 tx=0).stop 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 -- 10.20.193.10:0/4260944649 shutdown_connections 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 --2- 10.20.193.10:0/4260944649 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 0x7fbde015d600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 -- 10.20.193.10:0/4260944649 >> 10.20.193.10:0/4260944649 conn(0x7fbde00c9d80 msgr2=0x7fbde00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 -- 10.20.193.10:0/4260944649 shutdown_connections 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 -- 10.20.193.10:0/4260944649 wait complete. 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 10 monclient: build_initial_monmap 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 10 monclient: monmap: 2026-02-17T12:00:34.108 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 librados: starting msgr at 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 librados: starting objecter 2026-02-17T12:00:34.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 Processor -- start 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 -- start start 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 librados: setting wanted keys 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 1 librados: calling monclient init 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.095+0000 7fbde84da640 10 monclient: init 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbde00c92f0 0x7fbde01f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient(hunting): picked mon.noname-a con 0x7fbde00c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 0x7fbde014af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient(hunting): picked mon.noname-c con 0x7fbde0153d60 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbde015d220 0x7fbde014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient(hunting): picked mon.noname-b con 0x7fbde015d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:34.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fbde0074920 con 0x7fbde00c92f0 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbde00c86c0 con 0x7fbde015d220 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbde0074aa0 con 0x7fbde0153d60 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde84da640 10 monclient(hunting): authenticate will time out at 1303.818236s 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 0x7fbde014af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde624f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbde00c92f0 0x7fbde01f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde6a50640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbde015d220 0x7fbde014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 0x7fbde014af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:57946/0 (socket says 10.20.193.10:57946) 2026-02-17T12:00:34.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 1 -- 10.20.193.10:0/2305561013 learned_addr learned my addr 10.20.193.10:0/2305561013 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 10 monclient(hunting): get_auth_request con 0x7fbde0153d60 auth_method 0 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde624f640 10 monclient(hunting): get_auth_request con 0x7fbde00c92f0 auth_method 0 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde624f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde624f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde624f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde6a50640 10 monclient(hunting): get_auth_request con 0x7fbde015d220 auth_method 0 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde6a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde6a50640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde6a50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:34.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.096+0000 7fbde5a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.097+0000 7fbde624f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.097+0000 7fbde624f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.097+0000 7fbde624f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.097+0000 7fbde6a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.097+0000 7fbde6a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.097+0000 7fbde6a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 10 monclient(hunting): handle_auth_done global_id 5066 payload 824 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 1 -- 10.20.193.10:0/2305561013 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbde015d220 msgr2=0x7fbde014cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbde015d220 0x7fbde014cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 1 -- 10.20.193.10:0/2305561013 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbde00c92f0 msgr2=0x7fbde01f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:34.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbde00c92f0 0x7fbde01f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 10 monclient: _finish_hunting 0 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 1 monclient: found mon.noname-c 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.098+0000 7fbde5a4e640 1 -- 10.20.193.10:0/2305561013 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde0074420 con 0x7fbde0153d60 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.099+0000 7fbde5a4e640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 0x7fbde014af80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400c760 tx=0x7fbdd400cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.099+0000 7fbdc6ffd640 10 client.?.objecter ms_handle_connect 0x7fbde0153d60 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.099+0000 7fbdc6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbdc6ffd640 1 -- 10.20.193.10:0/2305561013 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4017070 con 0x7fbde0153d60 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbdc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbdc6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbdc6ffd640 10 monclient: dump: 2026-02-17T12:00:34.114 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbdc6ffd640 10 monclient: _finish_auth 0 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbdc6ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:34.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbdc6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 5 monclient: authenticate success, global_id 5066 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 10 monclient: _renew_subs 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde01f1db0 con 0x7fbde0153d60 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 10 client.5066.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 10 monclient: _renew_subs 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde01f2370 con 0x7fbde0153d60 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 1 librados: init done 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.100+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde01f2570 con 0x7fbde0153d60 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.101+0000 7fbdc6ffd640 1 -- 10.20.193.10:0/2305561013 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd4005bb0 con 0x7fbde0153d60 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.101+0000 7fbdc6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.101+0000 7fbdc6ffd640 1 -- 10.20.193.10:0/2305561013 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4021060 con 0x7fbde0153d60 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.101+0000 7fbdc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.101+0000 7fbdc6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.101+0000 7fbdc6ffd640 10 monclient: dump: 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:34.117 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:34.118 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:34.118 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:34.118 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.101+0000 7fbde4a4c640 4 set_mon_vals no callback set 2026-02-17T12:00:34.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.209+0000 7fbdc6ffd640 1 -- 10.20.193.10:0/2305561013 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fbdd4024080 con 0x7fbde0153d60 2026-02-17T12:00:34.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.209+0000 7fbdc6ffd640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbdb0078e00 0x7fbdb007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:34.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.209+0000 7fbde624f640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbdb0078e00 0x7fbdb007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:34.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.209+0000 7fbde624f640 10 monclient: get_auth_request con 0x7fbdb0078e00 auth_method 0 2026-02-17T12:00:34.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.209+0000 7fbdc6ffd640 10 client.5066.objecter ms_handle_connect 0x7fbdb0078e00 2026-02-17T12:00:34.212 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.209+0000 7fbde624f640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbdb0078e00 0x7fbdb007b2c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0004660 tx=0x7fbdd0009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:34.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.211+0000 7fbdc6ffd640 1 -- 10.20.193.10:0/2305561013 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fbdd405d4e0 con 0x7fbde0153d60 2026-02-17T12:00:34.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.211+0000 7fbdc6ffd640 10 client.5066.objecter ms_dispatch2 0x7fbde0000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:34.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.211+0000 7fbdc6ffd640 3 client.5066.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:34.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.211+0000 7fbdc6ffd640 3 client.5066.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:34.213 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.211+0000 7fbdc6ffd640 20 client.5066.objecter dump_active .. 0 homeless 2026-02-17T12:00:34.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.217+0000 7fbdc6ffd640 1 -- 10.20.193.10:0/2305561013 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbde01f2570 con 0x7fbde0153d60 2026-02-17T12:00:34.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.217+0000 7fbdc6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:34.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.217+0000 7fbdc6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:34.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.321+0000 7fbde84da640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:34.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.321+0000 7fbde84da640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:34.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.321+0000 7fbde84da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:34.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.321+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbde015d600 con 0x7fbde0153d60 2026-02-17T12:00:34.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.323+0000 7fbdc6ffd640 1 -- 10.20.193.10:0/2305561013 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fbdd40614a0 con 0x7fbde0153d60 2026-02-17T12:00:34.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.323+0000 7fbdc6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:34.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.323+0000 7fbdc6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:34.326 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:34.326 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:34.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 10 librados: watch_flush enter 2026-02-17T12:00:34.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 10 librados: watch_flush exit 2026-02-17T12:00:34.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 20 client.5066.objecter shutdown clearing up homeless session... 2026-02-17T12:00:34.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 10 client.5066.objecter successfully canceled tick 2026-02-17T12:00:34.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbdb0078e00 msgr2=0x7fbdb007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:34.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbdb0078e00 0x7fbdb007b2c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0004660 tx=0x7fbdd0009110 comp rx=0 tx=0).stop 2026-02-17T12:00:34.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 10 monclient: shutdown 2026-02-17T12:00:34.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:34.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 msgr2=0x7fbde014af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:34.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 0x7fbde014af80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400c760 tx=0x7fbdd400cc30 comp rx=0 tx=0).stop 2026-02-17T12:00:34.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 shutdown_connections 2026-02-17T12:00:34.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbdb0078e00 0x7fbdb007b2c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:34.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbde015d220 0x7fbde014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:34.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbde0153d60 0x7fbde014af80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:34.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 --2- 10.20.193.10:0/2305561013 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbde00c92f0 0x7fbde01f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:34.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 >> 10.20.193.10:0/2305561013 conn(0x7fbde00c9d80 msgr2=0x7fbde0152590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:34.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 shutdown_connections 2026-02-17T12:00:34.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 -- 10.20.193.10:0/2305561013 wait complete. 2026-02-17T12:00:34.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:34.325+0000 7fbde84da640 1 librados: shutdown 2026-02-17T12:00:35.371 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:06:52.539 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:35.399 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:06:52.527 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:35.399 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:06:52.567 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:35.400 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:06:52.528 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:35.400 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:06:52.564 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:35.401 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:06:52.564 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:35.408 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:06:52.576 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:35.408 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:06:52.537 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:35.410 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:06:52.573 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:37.336 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.406+0000 7f93d1c91640 10 monclient: get_monmap_and_config 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.406+0000 7f93d1c91640 10 monclient: build_initial_monmap 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.406+0000 7f93d1c91640 10 monclient: monmap: 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:37.407468+0000 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:37.407468+0000 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.406+0000 7f93d1c91640 1 Processor -- start 2026-02-17T12:00:37.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.406+0000 7f93d1c91640 1 -- start start 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.406+0000 7f93d1c91640 10 monclient: init 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 10 monclient: _add_conns ranks=[4,3,2,1,0,5] 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f93cc15d220 0x7f93cc15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 10 monclient(hunting): picked mon.noname-b con 0x7f93cc15d220 addr v2:10.20.193.71:3300/0 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f93cc074920 0x7f93cc0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 10 monclient(hunting): picked mon.noname-a con 0x7f93cc074920 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f93cc0c9120 addr v1:10.20.193.153:6789/0 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93cc0c95b0 con 0x7f93cc0c9120 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f93cc0c58a0 con 0x7f93cc074920 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f93cc0c55c0 con 0x7f93cc15d220 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:37.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.407+0000 7f93d1c91640 10 monclient(hunting): authenticate will time out at 1307.129179s 2026-02-17T12:00:37.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.413+0000 7f93cbfff640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f93cc0c9120 0x7f93cc153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:35204/0 (socket says 10.20.193.10:35204) 2026-02-17T12:00:37.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.413+0000 7f93cbfff640 1 -- 10.20.193.10:0/1401705713 learned_addr learned my addr 10.20.193.10:0/1401705713 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:00:37.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.415+0000 7f93caffd640 1 --2- 10.20.193.10:0/1401705713 >> v2:10.20.193.10:3300/0 conn(0x7f93cc074920 0x7f93cc0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:37.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.415+0000 7f93caffd640 10 monclient(hunting): get_auth_request con 0x7f93cc074920 auth_method 0 2026-02-17T12:00:37.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.415+0000 7f93caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:37.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.415+0000 7f93caffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:37.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.415+0000 7f93caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:37.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.415+0000 7f93caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:37.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.415+0000 7f93caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:37.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.415+0000 7f93caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:37.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93cb7fe640 1 --2- 10.20.193.10:0/1401705713 >> v2:10.20.193.71:3300/0 conn(0x7f93cc15d220 0x7f93cc15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93ca7fc640 1 -- 10.20.193.10:0/1401705713 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1120677538 0 0) 0x7f93cc0c95b0 con 0x7f93cc0c9120 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93ca7fc640 10 monclient(hunting): _negotiate 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93ca7fc640 10 monclient(hunting): my global_id is 5069 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93ca7fc640 1 -- 10.20.193.10:0/1401705713 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93b0003620 con 0x7f93cc0c9120 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93caffd640 10 monclient(hunting): handle_auth_done global_id 5016 payload 274 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93caffd640 1 -- 10.20.193.10:0/1401705713 >> v2:10.20.193.71:3300/0 conn(0x7f93cc15d220 msgr2=0x7f93cc15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93caffd640 1 --2- 10.20.193.10:0/1401705713 >> v2:10.20.193.71:3300/0 conn(0x7f93cc15d220 0x7f93cc15d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93caffd640 1 -- 10.20.193.10:0/1401705713 >> v1:10.20.193.153:6789/0 conn(0x7f93cc0c9120 legacy=0x7f93cc153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93caffd640 10 monclient: _finish_hunting 0 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93caffd640 1 monclient: found mon.noname-a 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93caffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:37.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.416+0000 7f93caffd640 1 -- 10.20.193.10:0/1401705713 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc0c7e20 con 0x7f93cc074920 2026-02-17T12:00:37.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.418+0000 7f93caffd640 1 --2- 10.20.193.10:0/1401705713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 0x7f93cc0c8be0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0098a0 tx=0x7f93bc02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390bfc351f8705c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:37.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 1 -- 10.20.193.10:0/1401705713 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc03c070 con 0x7f93cc074920 2026-02-17T12:00:37.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:37.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:37.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 10 monclient: dump: 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 10 monclient: _finish_auth 0 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 1 -- 10.20.193.10:0/1401705713 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93bc02fae0 con 0x7f93cc074920 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 5 monclient: authenticate success, global_id 5016 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 1 -- 10.20.193.10:0/1401705713 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc037440 con 0x7f93cc074920 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 4 set_mon_vals no callback set 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93ca7fc640 10 monclient: dump: 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:37.423 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 10 monclient: shutdown 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 1 -- 10.20.193.10:0/1401705713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 msgr2=0x7f93cc0c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 1 --2- 10.20.193.10:0/1401705713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 0x7f93cc0c8be0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0098a0 tx=0x7f93bc02ee10 comp rx=0 tx=0).stop 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 1 -- 10.20.193.10:0/1401705713 shutdown_connections 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 1 --2- 10.20.193.10:0/1401705713 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 0x7f93cc0c8be0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 1 --2- 10.20.193.10:0/1401705713 >> v2:10.20.193.71:3300/0 conn(0x7f93cc15d220 0x7f93cc15d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 1 -- 10.20.193.10:0/1401705713 >> 10.20.193.10:0/1401705713 conn(0x7f93cc0c9d80 msgr2=0x7f93cc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 1 -- 10.20.193.10:0/1401705713 shutdown_connections 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.421+0000 7f93d1c91640 1 -- 10.20.193.10:0/1401705713 wait complete. 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.422+0000 7f93d1c91640 10 monclient: build_initial_monmap 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.422+0000 7f93d1c91640 10 monclient: monmap: 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:37.424 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.422+0000 7f93d1c91640 1 librados: starting msgr at 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.422+0000 7f93d1c91640 1 librados: starting objecter 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.422+0000 7f93d1c91640 1 Processor -- start 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.422+0000 7f93d1c91640 1 -- start start 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.422+0000 7f93d1c91640 1 librados: setting wanted keys 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.422+0000 7f93d1c91640 1 librados: calling monclient init 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.422+0000 7f93d1c91640 10 monclient: init 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 0x7f93cc1f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient(hunting): picked mon.noname-a con 0x7f93cc074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f93cc0c9120 0x7f93cc06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient(hunting): picked mon.noname-b con 0x7f93cc0c9120 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f93cc15d220 0x7f93cc147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient(hunting): picked mon.noname-c con 0x7f93cc15d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0c86c0 con 0x7f93cc074920 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0c83e0 con 0x7f93cc0c9120 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc074d70 con 0x7f93cc15d220 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:37.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93d1c91640 10 monclient(hunting): authenticate will time out at 1307.145367s 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cb7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 0x7f93cc1f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cbfff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f93cc15d220 0x7f93cc147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cb7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 0x7f93cc1f7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:50480/0 (socket says 10.20.193.10:50480) 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cb7fe640 1 -- 10.20.193.10:0/2921333350 learned_addr learned my addr 10.20.193.10:0/2921333350 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cb7fe640 10 monclient(hunting): get_auth_request con 0x7f93cc074920 auth_method 0 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cbfff640 10 monclient(hunting): get_auth_request con 0x7f93cc15d220 auth_method 0 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93caffd640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f93cc0c9120 0x7f93cc06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.423+0000 7f93cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93caffd640 10 monclient(hunting): get_auth_request con 0x7f93cc0c9120 auth_method 0 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93caffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:37.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.424+0000 7f93caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 10 monclient(hunting): handle_auth_done global_id 5072 payload 824 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 1 -- 10.20.193.10:0/2921333350 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f93cc0c9120 msgr2=0x7f93cc06d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f93cc0c9120 0x7f93cc06d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 1 -- 10.20.193.10:0/2921333350 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 msgr2=0x7f93cc1f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 0x7f93cc1f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 10 monclient: _finish_hunting 0 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 1 monclient: found mon.noname-c 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:00:37.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.425+0000 7f93cbfff640 1 -- 10.20.193.10:0/2921333350 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc1f3480 con 0x7f93cc15d220 2026-02-17T12:00:37.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.426+0000 7f93cbfff640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f93cc15d220 0x7f93cc147ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f93c000ca80 tx=0x7f93c000cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:37.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.426+0000 7f93a7fff640 10 client.?.objecter ms_handle_connect 0x7f93cc15d220 2026-02-17T12:00:37.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.426+0000 7f93a7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93a7fff640 1 -- 10.20.193.10:0/2921333350 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c000ac40 con 0x7f93cc15d220 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93a7fff640 10 monclient: dump: 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93a7fff640 10 monclient: _finish_auth 0 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93a7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93d1c91640 5 monclient: authenticate success, global_id 5072 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93d1c91640 10 monclient: _renew_subs 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93d1c91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93cc1f3760 con 0x7f93cc15d220 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93d1c91640 10 client.5072.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93d1c91640 10 monclient: _renew_subs 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93d1c91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc1f3d20 con 0x7f93cc15d220 2026-02-17T12:00:37.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.427+0000 7f93d1c91640 1 librados: init done 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93a7fff640 1 -- 10.20.193.10:0/2921333350 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c000ade0 con 0x7f93cc15d220 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93a7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93a7fff640 1 -- 10.20.193.10:0/2921333350 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c001b600 con 0x7f93cc15d220 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93c9ffb640 4 set_mon_vals no callback set 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93a7fff640 10 monclient: dump: 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93d1c91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93d1c91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93d1c91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:37.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.428+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93cc0c8be0 con 0x7f93cc15d220 2026-02-17T12:00:37.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.439+0000 7f93a7fff640 1 -- 10.20.193.10:0/2921333350 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f93c001b7a0 con 0x7f93cc15d220 2026-02-17T12:00:37.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.439+0000 7f93a7fff640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f939c078e00 0x7f939c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:37.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.439+0000 7f93cb7fe640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f939c078e00 0x7f939c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:37.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.439+0000 7f93cb7fe640 10 monclient: get_auth_request con 0x7f939c078e00 auth_method 0 2026-02-17T12:00:37.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.439+0000 7f93cb7fe640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f939c078e00 0x7f939c07b2c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93b8006fd0 tx=0x7f93b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:37.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.439+0000 7f93a7fff640 10 client.5072.objecter ms_handle_connect 0x7f939c078e00 2026-02-17T12:00:37.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.440+0000 7f93a7fff640 1 -- 10.20.193.10:0/2921333350 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f93c0098070 con 0x7f93cc15d220 2026-02-17T12:00:37.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.440+0000 7f93a7fff640 10 client.5072.objecter ms_dispatch2 0x7f93cc000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:37.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.440+0000 7f93a7fff640 3 client.5072.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:37.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.440+0000 7f93a7fff640 3 client.5072.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:37.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.440+0000 7f93a7fff640 20 client.5072.objecter dump_active .. 0 homeless 2026-02-17T12:00:37.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.546+0000 7f93a7fff640 1 -- 10.20.193.10:0/2921333350 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f93c0062840 con 0x7f93cc15d220 2026-02-17T12:00:37.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.546+0000 7f93a7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:37.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.546+0000 7f93a7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:37.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.646+0000 7f93d1c91640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:37.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.646+0000 7f93d1c91640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:37.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.646+0000 7f93d1c91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:37.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.646+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f93cc0c9b60 con 0x7f93cc15d220 2026-02-17T12:00:37.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.648+0000 7f93a7fff640 1 -- 10.20.193.10:0/2921333350 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f93c0066b40 con 0x7f93cc15d220 2026-02-17T12:00:37.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.648+0000 7f93a7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:37.650 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.648+0000 7f93a7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:37.650 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:37.651 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:37.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 10 librados: watch_flush enter 2026-02-17T12:00:37.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 10 librados: watch_flush exit 2026-02-17T12:00:37.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 20 client.5072.objecter shutdown clearing up homeless session... 2026-02-17T12:00:37.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 10 client.5072.objecter successfully canceled tick 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f939c078e00 msgr2=0x7f939c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f939c078e00 0x7f939c07b2c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93b8006fd0 tx=0x7f93b8008040 comp rx=0 tx=0).stop 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 10 monclient: shutdown 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f93cc15d220 msgr2=0x7f93cc147ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f93cc15d220 0x7f93cc147ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f93c000ca80 tx=0x7f93c000cf50 comp rx=0 tx=0).stop 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 shutdown_connections 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f939c078e00 0x7f939c07b2c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f93cc15d220 0x7f93cc147ce0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:37.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f93cc0c9120 0x7f93cc06d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:37.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 --2- 10.20.193.10:0/2921333350 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f93cc074920 0x7f93cc1f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:37.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 >> 10.20.193.10:0/2921333350 conn(0x7f93cc0c9d80 msgr2=0x7f93cc1527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:37.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 shutdown_connections 2026-02-17T12:00:37.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 -- 10.20.193.10:0/2921333350 wait complete. 2026-02-17T12:00:37.654 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:37.649+0000 7f93d1c91640 1 librados: shutdown 2026-02-17T12:00:40.661 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:40.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.728+0000 7fcd8e9f7640 10 monclient: get_monmap_and_config 2026-02-17T12:00:40.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.728+0000 7fcd8e9f7640 10 monclient: build_initial_monmap 2026-02-17T12:00:40.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.728+0000 7fcd8e9f7640 10 monclient: monmap: 2026-02-17T12:00:40.731 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:40.731 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:40.731 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:40.729782+0000 2026-02-17T12:00:40.731 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:40.729782+0000 2026-02-17T12:00:40.731 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:40.732 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:40.732 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:40.732 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:40.732 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:40.732 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:40.732 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:40.733 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:40.733 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:40.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.728+0000 7fcd8e9f7640 1 Processor -- start 2026-02-17T12:00:40.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.728+0000 7fcd8e9f7640 1 -- start start 2026-02-17T12:00:40.733 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.728+0000 7fcd8e9f7640 10 monclient: init 2026-02-17T12:00:40.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:40.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 10 monclient: _add_conns ranks=[5,0,3,1,4,2] 2026-02-17T12:00:40.740 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcd8815d220 0x7fcd8815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 10 monclient(hunting): picked mon.noname-c con 0x7fcd8815d220 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcd88074920 addr v1:10.20.193.10:6789/0 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fcd880c92f0 0x7fcd88153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 10 monclient(hunting): picked mon.noname-a con 0x7fcd880c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd880c58a0 con 0x7fcd88074920 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fcd880c55c0 con 0x7fcd880c92f0 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcd880c7e20 con 0x7fcd8815d220 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8e9f7640 10 monclient(hunting): authenticate will time out at 1310.451483s 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd8cf6d640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fcd880c92f0 0x7fcd88153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.729+0000 7fcd87fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcd8815d220 0x7fcd8815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd87fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fcd8815d220 0x7fcd8815d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:57956/0 (socket says 10.20.193.10:57956) 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd87fff640 1 -- 10.20.193.10:0/537844177 learned_addr learned my addr 10.20.193.10:0/537844177 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd87fff640 10 monclient(hunting): get_auth_request con 0x7fcd8815d220 auth_method 0 2026-02-17T12:00:40.741 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd8cf6d640 10 monclient(hunting): get_auth_request con 0x7fcd880c92f0 auth_method 0 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd8cf6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd8cf6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd8cf6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd8cf6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd8cf6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.730+0000 7fcd8cf6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.731+0000 7fcd87fff640 10 monclient(hunting): handle_auth_done global_id 5075 payload 274 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.731+0000 7fcd87fff640 1 -- 10.20.193.10:0/537844177 >> v2:10.20.193.10:3300/0 conn(0x7fcd880c92f0 msgr2=0x7fcd88153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.731+0000 7fcd87fff640 1 --2- 10.20.193.10:0/537844177 >> v2:10.20.193.10:3300/0 conn(0x7fcd880c92f0 0x7fcd88153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.731+0000 7fcd87fff640 1 -- 10.20.193.10:0/537844177 >> v1:10.20.193.10:6789/0 conn(0x7fcd88074920 legacy=0x7fcd880c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.731+0000 7fcd87fff640 10 monclient: _finish_hunting 0 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.731+0000 7fcd87fff640 1 monclient: found mon.noname-c 2026-02-17T12:00:40.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.731+0000 7fcd87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.731+0000 7fcd87fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.731+0000 7fcd87fff640 1 -- 10.20.193.10:0/537844177 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880c8100 con 0x7fcd8815d220 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.732+0000 7fcd87fff640 1 --2- 10.20.193.10:0/537844177 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcd8815d220 0x7fcd8815d600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009970 tx=0x7fcd7402eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ed028b48d025ef server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 1 -- 10.20.193.10:0/537844177 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7403c070 con 0x7fcd8815d220 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 10 monclient: dump: 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:40.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 10 monclient: _finish_auth 0 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 1 -- 10.20.193.10:0/537844177 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7402fb20 con 0x7fcd8815d220 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 1 -- 10.20.193.10:0/537844177 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74037440 con 0x7fcd8815d220 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd86ffd640 10 monclient: dump: 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:40.744 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 5 monclient: authenticate success, global_id 5075 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 4 set_mon_vals no callback set 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 10 monclient: shutdown 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/537844177 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcd8815d220 msgr2=0x7fcd8815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 1 --2- 10.20.193.10:0/537844177 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcd8815d220 0x7fcd8815d600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009970 tx=0x7fcd7402eef0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/537844177 shutdown_connections 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 1 --2- 10.20.193.10:0/537844177 >> v2:10.20.193.10:3300/0 conn(0x7fcd880c92f0 0x7fcd88153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 1 --2- 10.20.193.10:0/537844177 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcd8815d220 0x7fcd8815d600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/537844177 >> 10.20.193.10:0/537844177 conn(0x7fcd880c9d80 msgr2=0x7fcd880ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/537844177 shutdown_connections 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/537844177 wait complete. 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 10 monclient: build_initial_monmap 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.734+0000 7fcd8e9f7640 10 monclient: monmap: 2026-02-17T12:00:40.745 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 librados: starting msgr at 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 librados: starting objecter 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 Processor -- start 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 -- start start 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 librados: setting wanted keys 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 librados: calling monclient init 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient: init 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:00:40.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcd88074920 0x7fcd881f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient(hunting): picked mon.noname-c con 0x7fcd88074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcd880c92f0 0x7fcd881e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient(hunting): picked mon.noname-b con 0x7fcd880c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcd8815d220 0x7fcd88148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient(hunting): picked mon.noname-a con 0x7fcd8815d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fcd88074d70 con 0x7fcd8815d220 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880c86c0 con 0x7fcd880c92f0 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd88153b90 con 0x7fcd88074920 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8e9f7640 10 monclient(hunting): authenticate will time out at 1310.457643s 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.735+0000 7fcd8cf6d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcd8815d220 0x7fcd88148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd87fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcd88074920 0x7fcd881f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd8cf6d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcd8815d220 0x7fcd88148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:50496/0 (socket says 10.20.193.10:50496) 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd8cf6d640 1 -- 10.20.193.10:0/1830428274 learned_addr learned my addr 10.20.193.10:0/1830428274 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd8cf6d640 10 monclient(hunting): get_auth_request con 0x7fcd8815d220 auth_method 0 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd8cf6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd8cf6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd8cf6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:40.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd877fe640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcd880c92f0 0x7fcd881e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd87fff640 10 monclient(hunting): get_auth_request con 0x7fcd88074920 auth_method 0 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd8cf6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd8cf6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd8cf6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd877fe640 10 monclient(hunting): get_auth_request con 0x7fcd880c92f0 auth_method 0 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.736+0000 7fcd877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 10 monclient(hunting): handle_auth_done global_id 5025 payload 824 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 1 -- 10.20.193.10:0/1830428274 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcd88074920 msgr2=0x7fcd881f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcd88074920 0x7fcd881f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 1 -- 10.20.193.10:0/1830428274 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcd880c92f0 msgr2=0x7fcd881e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcd880c92f0 0x7fcd881e6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 10 monclient: _finish_hunting 0 2026-02-17T12:00:40.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 1 monclient: found mon.noname-a 2026-02-17T12:00:40.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:40.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:40.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.737+0000 7fcd8cf6d640 1 -- 10.20.193.10:0/1830428274 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd881e6d50 con 0x7fcd8815d220 2026-02-17T12:00:40.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.738+0000 7fcd8cf6d640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcd8815d220 0x7fcd88148ec0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00efc0 tx=0x7fcd7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:40.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.738+0000 7fcd84ff9640 10 client.?.objecter ms_handle_connect 0x7fcd8815d220 2026-02-17T12:00:40.749 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.738+0000 7fcd84ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd84ff9640 1 -- 10.20.193.10:0/1830428274 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c018020 con 0x7fcd8815d220 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd84ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd84ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd84ff9640 10 monclient: dump: 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:40.750 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd84ff9640 10 monclient: _finish_auth 0 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd84ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd84ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd8e9f7640 5 monclient: authenticate success, global_id 5025 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd8e9f7640 10 monclient: _renew_subs 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd8e9f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd881e7030 con 0x7fcd8815d220 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd8e9f7640 10 client.5025.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd8e9f7640 10 monclient: _renew_subs 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd8e9f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd881e75f0 con 0x7fcd8815d220 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.739+0000 7fcd8e9f7640 1 librados: init done 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd8e9f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd8e9f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd8e9f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd88153f70 con 0x7fcd8815d220 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd84ff9640 1 -- 10.20.193.10:0/1830428274 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c014480 con 0x7fcd8815d220 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd84ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd84ff9640 1 -- 10.20.193.10:0/1830428274 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c014830 con 0x7fcd8815d220 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd84ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd84ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:40.751 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd867fc640 4 set_mon_vals no callback set 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.740+0000 7fcd84ff9640 10 monclient: dump: 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:40.752 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:40.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.844+0000 7fcd84ff9640 1 -- 10.20.193.10:0/1830428274 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fcd7c0149d0 con 0x7fcd8815d220 2026-02-17T12:00:40.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.844+0000 7fcd84ff9640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd58078e30 0x7fcd5807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:40.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.844+0000 7fcd87fff640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd58078e30 0x7fcd5807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:40.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.844+0000 7fcd87fff640 10 monclient: get_auth_request con 0x7fcd58078e30 auth_method 0 2026-02-17T12:00:40.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.845+0000 7fcd87fff640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd58078e30 0x7fcd5807b2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcd88076d10 tx=0x7fcd74033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:40.846 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.845+0000 7fcd84ff9640 10 client.5025.objecter ms_handle_connect 0x7fcd58078e30 2026-02-17T12:00:40.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.851+0000 7fcd84ff9640 1 -- 10.20.193.10:0/1830428274 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fcd7c05f190 con 0x7fcd8815d220 2026-02-17T12:00:40.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.851+0000 7fcd84ff9640 10 client.5025.objecter ms_dispatch2 0x7fcd88000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:40.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.851+0000 7fcd84ff9640 3 client.5025.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:40.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.851+0000 7fcd84ff9640 3 client.5025.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:40.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.851+0000 7fcd84ff9640 20 client.5025.objecter dump_active .. 0 homeless 2026-02-17T12:00:40.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.851+0000 7fcd84ff9640 1 -- 10.20.193.10:0/1830428274 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcd7c022030 con 0x7fcd8815d220 2026-02-17T12:00:40.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.851+0000 7fcd84ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:40.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.851+0000 7fcd84ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:40.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.953+0000 7fcd8e9f7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:40.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.953+0000 7fcd8e9f7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:40.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.953+0000 7fcd8e9f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:40.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.953+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcd881573e0 con 0x7fcd8815d220 2026-02-17T12:00:40.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.956+0000 7fcd84ff9640 1 -- 10.20.193.10:0/1830428274 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fcd7c010040 con 0x7fcd8815d220 2026-02-17T12:00:40.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.956+0000 7fcd84ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:40.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.956+0000 7fcd84ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:40.958 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:40.958 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 10 librados: watch_flush enter 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 10 librados: watch_flush exit 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 20 client.5025.objecter shutdown clearing up homeless session... 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 10 client.5025.objecter successfully canceled tick 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd58078e30 msgr2=0x7fcd5807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd58078e30 0x7fcd5807b2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcd88076d10 tx=0x7fcd74033000 comp rx=0 tx=0).stop 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 10 monclient: shutdown 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcd8815d220 msgr2=0x7fcd88148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcd8815d220 0x7fcd88148ec0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00efc0 tx=0x7fcd7c00c490 comp rx=0 tx=0).stop 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 shutdown_connections 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fcd58078e30 0x7fcd5807b2f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fcd8815d220 0x7fcd88148ec0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fcd880c92f0 0x7fcd881e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 --2- 10.20.193.10:0/1830428274 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcd88074920 0x7fcd881f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 >> 10.20.193.10:0/1830428274 conn(0x7fcd880c9d80 msgr2=0x7fcd8814e110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 shutdown_connections 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 -- 10.20.193.10:0/1830428274 wait complete. 2026-02-17T12:00:40.960 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:40.958+0000 7fcd8e9f7640 1 librados: shutdown 2026-02-17T12:00:43.970 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:44.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.035+0000 7f2524587640 10 monclient: get_monmap_and_config 2026-02-17T12:00:44.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.035+0000 7f2524587640 10 monclient: build_initial_monmap 2026-02-17T12:00:44.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.035+0000 7f2524587640 10 monclient: monmap: 2026-02-17T12:00:44.038 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:44.038 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:44.037090+0000 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:44.037090+0000 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:44.039 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 1 Processor -- start 2026-02-17T12:00:44.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 1 -- start start 2026-02-17T12:00:44.040 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient: init 2026-02-17T12:00:44.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:44.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient: _add_conns ranks=[1,3,5,4,2,0] 2026-02-17T12:00:44.047 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f251c15d220 addr v1:10.20.193.71:6789/0 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f251c0c92f0 0x7f251c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient(hunting): picked mon.noname-a con 0x7f251c0c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f251c074920 0x7f251c153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient(hunting): picked mon.noname-c con 0x7f251c074920 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f251c0c58a0 con 0x7f251c15d220 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f251c0c55c0 con 0x7f251c0c92f0 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f251c0c7e20 con 0x7f251c074920 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:44.048 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.036+0000 7f2524587640 10 monclient(hunting): authenticate will time out at 1313.758818s 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f25222fc640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f251c15d220 0x7f251c0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:36952/0 (socket says 10.20.193.10:36952) 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f25222fc640 1 -- 10.20.193.10:0/4034018501 learned_addr learned my addr 10.20.193.10:0/4034018501 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2522afd640 1 --2- 10.20.193.10:0/4034018501 >> v2:10.20.193.153:3300/0 conn(0x7f251c074920 0x7f251c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2521afb640 1 --2- 10.20.193.10:0/4034018501 >> v2:10.20.193.10:3300/0 conn(0x7f251c0c92f0 0x7f251c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2522afd640 10 monclient(hunting): get_auth_request con 0x7f251c074920 auth_method 0 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2522afd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2522afd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2522afd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2521afb640 10 monclient(hunting): get_auth_request con 0x7f251c0c92f0 auth_method 0 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2521afb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:44.049 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2521afb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2521afb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2522afd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2522afd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2522afd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2521afb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2521afb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.037+0000 7f2521afb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f25212fa640 1 -- 10.20.193.10:0/4034018501 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542120904 0 0) 0x7f251c0c58a0 con 0x7f251c15d220 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f25212fa640 10 monclient(hunting): _negotiate 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f25212fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f25212fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:44.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f25212fa640 10 monclient(hunting): my global_id is 5065 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f25212fa640 1 -- 10.20.193.10:0/4034018501 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2504003620 con 0x7f251c15d220 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f2522afd640 10 monclient(hunting): handle_auth_done global_id 5081 payload 274 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f2522afd640 1 -- 10.20.193.10:0/4034018501 >> v2:10.20.193.10:3300/0 conn(0x7f251c0c92f0 msgr2=0x7f251c15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f2522afd640 1 --2- 10.20.193.10:0/4034018501 >> v2:10.20.193.10:3300/0 conn(0x7f251c0c92f0 0x7f251c15d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f2522afd640 1 -- 10.20.193.10:0/4034018501 >> v1:10.20.193.71:6789/0 conn(0x7f251c15d220 legacy=0x7f251c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f2522afd640 10 monclient: _finish_hunting 0 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f2522afd640 1 monclient: found mon.noname-c 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f2522afd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f2522afd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.038+0000 7f2522afd640 1 -- 10.20.193.10:0/4034018501 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251c0c8100 con 0x7f251c074920 2026-02-17T12:00:44.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.039+0000 7f2522afd640 1 --2- 10.20.193.10:0/4034018501 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 0x7f251c153650 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2518009d90 tx=0x7f251802f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5203ff2b40bc5fcd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 1 -- 10.20.193.10:0/4034018501 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251803c070 con 0x7f251c074920 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 10 monclient: dump: 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:44.052 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 10 monclient: _finish_auth 0 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 10 monclient: _check_auth_tickets 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 1 -- 10.20.193.10:0/4034018501 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2518037440 con 0x7f251c074920 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 1 -- 10.20.193.10:0/4034018501 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518037810 con 0x7f251c074920 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 5 monclient: authenticate success, global_id 5081 2026-02-17T12:00:44.053 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 4 set_mon_vals no callback set 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f25212fa640 10 monclient: dump: 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:44.054 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 10 monclient: shutdown 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 1 -- 10.20.193.10:0/4034018501 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 msgr2=0x7f251c153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 1 --2- 10.20.193.10:0/4034018501 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 0x7f251c153650 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2518009d90 tx=0x7f251802f1e0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 1 -- 10.20.193.10:0/4034018501 shutdown_connections 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 1 --2- 10.20.193.10:0/4034018501 >> v2:10.20.193.10:3300/0 conn(0x7f251c0c92f0 0x7f251c15d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 1 --2- 10.20.193.10:0/4034018501 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 0x7f251c153650 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 1 -- 10.20.193.10:0/4034018501 >> 10.20.193.10:0/4034018501 conn(0x7f251c0c9d80 msgr2=0x7f251c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 1 -- 10.20.193.10:0/4034018501 shutdown_connections 2026-02-17T12:00:44.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.041+0000 7f2524587640 1 -- 10.20.193.10:0/4034018501 wait complete. 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.042+0000 7f2524587640 10 monclient: build_initial_monmap 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.042+0000 7f2524587640 10 monclient: monmap: 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:44.056 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.042+0000 7f2524587640 1 librados: starting msgr at 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.042+0000 7f2524587640 1 librados: starting objecter 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.042+0000 7f2524587640 1 Processor -- start 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.042+0000 7f2524587640 1 -- start start 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.042+0000 7f2524587640 1 librados: setting wanted keys 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.042+0000 7f2524587640 1 librados: calling monclient init 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.042+0000 7f2524587640 10 monclient: init 2026-02-17T12:00:44.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 0x7f251c1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient(hunting): picked mon.noname-c con 0x7f251c074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f251c0c92f0 0x7f251c148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient(hunting): picked mon.noname-b con 0x7f251c0c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f251c15d220 0x7f251c1f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient(hunting): picked mon.noname-a con 0x7f251c15d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f251c074d70 con 0x7f251c15d220 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:44.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f251c0c86c0 con 0x7f251c0c92f0 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f251c153b90 con 0x7f251c074920 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2524587640 10 monclient(hunting): authenticate will time out at 1313.765359s 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2522afd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f251c15d220 0x7f251c1f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 0x7f251c1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2521afb640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f251c0c92f0 0x7f251c148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 0x7f251c1f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:38512/0 (socket says 10.20.193.10:38512) 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 1 -- 10.20.193.10:0/116271537 learned_addr learned my addr 10.20.193.10:0/116271537 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:44.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 10 monclient(hunting): get_auth_request con 0x7f251c074920 auth_method 0 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2522afd640 10 monclient(hunting): get_auth_request con 0x7f251c15d220 auth_method 0 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2522afd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2522afd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2522afd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2521afb640 10 monclient(hunting): get_auth_request con 0x7f251c0c92f0 auth_method 0 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2521afb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2521afb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:44.060 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f2521afb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.043+0000 7f25222fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.044+0000 7f2522afd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.044+0000 7f2522afd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.044+0000 7f2522afd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.044+0000 7f2521afb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.044+0000 7f2521afb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.044+0000 7f2521afb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 10 monclient(hunting): handle_auth_done global_id 5084 payload 824 2026-02-17T12:00:44.061 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 1 -- 10.20.193.10:0/116271537 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f251c0c92f0 msgr2=0x7f251c148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:44.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f251c0c92f0 0x7f251c148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 1 -- 10.20.193.10:0/116271537 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f251c15d220 msgr2=0x7f251c1f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:44.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f251c15d220 0x7f251c1f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 10 monclient: _finish_hunting 0 2026-02-17T12:00:44.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 1 monclient: found mon.noname-c 2026-02-17T12:00:44.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:44.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:00:44.062 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.045+0000 7f25222fc640 1 -- 10.20.193.10:0/116271537 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251c1f36f0 con 0x7f251c074920 2026-02-17T12:00:44.064 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.046+0000 7f25222fc640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 0x7f251c1f4a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f250c00c520 tx=0x7f250c00c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:44.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.046+0000 7f2502ffd640 10 client.?.objecter ms_handle_connect 0x7f251c074920 2026-02-17T12:00:44.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.046+0000 7f2502ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:44.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 1 -- 10.20.193.10:0/116271537 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c017070 con 0x7f251c074920 2026-02-17T12:00:44.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:44.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:44.065 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 10 monclient: dump: 2026-02-17T12:00:44.065 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:44.065 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 10 monclient: _finish_auth 0 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:44.066 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 1 -- 10.20.193.10:0/116271537 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250c005de0 con 0x7f251c074920 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 5 monclient: authenticate success, global_id 5084 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 10 monclient: _renew_subs 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251c1f39d0 con 0x7f251c074920 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 1 -- 10.20.193.10:0/116271537 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c007270 con 0x7f251c074920 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2502ffd640 10 monclient: dump: 2026-02-17T12:00:44.067 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:44.068 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2520af9640 4 set_mon_vals no callback set 2026-02-17T12:00:44.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 10 client.5084.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:44.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 10 monclient: _renew_subs 2026-02-17T12:00:44.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:44.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f251c1f3f90 con 0x7f251c074920 2026-02-17T12:00:44.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 1 librados: init done 2026-02-17T12:00:44.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:44.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:44.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:44.069 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.048+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f251c15e100 con 0x7f251c074920 2026-02-17T12:00:44.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.156+0000 7f2502ffd640 1 -- 10.20.193.10:0/116271537 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f250c007410 con 0x7f251c074920 2026-02-17T12:00:44.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.156+0000 7f2502ffd640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f24ec078e30 0x7f24ec07b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:44.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.156+0000 7f2521afb640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f24ec078e30 0x7f24ec07b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:44.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.156+0000 7f2521afb640 10 monclient: get_auth_request con 0x7f24ec078e30 auth_method 0 2026-02-17T12:00:44.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.157+0000 7f2521afb640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f24ec078e30 0x7f24ec07b2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f251c074770 tx=0x7f2510009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:44.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.157+0000 7f2502ffd640 10 client.5084.objecter ms_handle_connect 0x7f24ec078e30 2026-02-17T12:00:44.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.157+0000 7f2502ffd640 1 -- 10.20.193.10:0/116271537 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f250c007730 con 0x7f251c074920 2026-02-17T12:00:44.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.157+0000 7f2502ffd640 10 client.5084.objecter ms_dispatch2 0x7f251c000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:44.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.157+0000 7f2502ffd640 3 client.5084.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:44.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.157+0000 7f2502ffd640 3 client.5084.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:44.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.157+0000 7f2502ffd640 20 client.5084.objecter dump_active .. 0 homeless 2026-02-17T12:00:44.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.164+0000 7f2502ffd640 1 -- 10.20.193.10:0/116271537 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f251c15e100 con 0x7f251c074920 2026-02-17T12:00:44.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.164+0000 7f2502ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:44.165 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.164+0000 7f2502ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:44.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.264+0000 7f2524587640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:44.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.264+0000 7f2524587640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:44.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.264+0000 7f2524587640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:44.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.264+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f251c069900 con 0x7f251c074920 2026-02-17T12:00:44.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.267+0000 7f2502ffd640 1 -- 10.20.193.10:0/116271537 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f251c069900 con 0x7f251c074920 2026-02-17T12:00:44.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.267+0000 7f2502ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:44.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.267+0000 7f2502ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:44.270 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:44.270 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:44.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 10 librados: watch_flush enter 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 10 librados: watch_flush exit 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 20 client.5084.objecter shutdown clearing up homeless session... 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 10 client.5084.objecter successfully canceled tick 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f24ec078e30 msgr2=0x7f24ec07b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f24ec078e30 0x7f24ec07b2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f251c074770 tx=0x7f2510009290 comp rx=0 tx=0).stop 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 10 monclient: shutdown 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 msgr2=0x7f251c1f4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 0x7f251c1f4a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f250c00c520 tx=0x7f250c00c9f0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 shutdown_connections 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f24ec078e30 0x7f24ec07b2f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f251c15d220 0x7f251c1f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f251c0c92f0 0x7f251c148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 --2- 10.20.193.10:0/116271537 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f251c074920 0x7f251c1f4a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:44.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 >> 10.20.193.10:0/116271537 conn(0x7f251c0c9d80 msgr2=0x7f251c06b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:44.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 shutdown_connections 2026-02-17T12:00:44.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 -- 10.20.193.10:0/116271537 wait complete. 2026-02-17T12:00:44.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:44.269+0000 7f2524587640 1 librados: shutdown 2026-02-17T12:00:47.280 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:47.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.347+0000 7f1cb5066640 10 monclient: get_monmap_and_config 2026-02-17T12:00:47.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.347+0000 7f1cb5066640 10 monclient: build_initial_monmap 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.347+0000 7f1cb5066640 10 monclient: monmap: 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:47.348326+0000 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:47.348326+0000 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.347+0000 7f1cb5066640 1 Processor -- start 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.347+0000 7f1cb5066640 1 -- start start 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.347+0000 7f1cb5066640 10 monclient: init 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.347+0000 7f1cb5066640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.347+0000 7f1cb5066640 10 monclient: _add_conns ranks=[0,5,3,1,4,2] 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.347+0000 7f1cb5066640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1cb015d220 addr v1:10.20.193.10:6789/0 2026-02-17T12:00:47.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1cb00c92f0 0x7f1cb015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 10 monclient(hunting): picked mon.noname-c con 0x7f1cb00c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f1cb0074920 0x7f1cb0153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 10 monclient(hunting): picked mon.noname-a con 0x7f1cb0074920 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb00c58a0 con 0x7f1cb015d220 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb00c55c0 con 0x7f1cb0074920 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb00c7e20 con 0x7f1cb00c92f0 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cb5066640 10 monclient(hunting): authenticate will time out at 1317.070034s 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1caf577640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f1cb0074920 0x7f1cb0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cae575640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f1cb00c92f0 0x7f1cb015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1caf577640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f1cb0074920 0x7f1cb0153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:37762/0 (socket says 10.20.193.10:37762) 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1caf577640 1 -- 10.20.193.10:0/2547803522 learned_addr learned my addr 10.20.193.10:0/2547803522 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1caf577640 10 monclient(hunting): get_auth_request con 0x7f1cb0074920 auth_method 0 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1caf577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1caf577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1caf577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cae575640 10 monclient(hunting): get_auth_request con 0x7f1cb00c92f0 auth_method 0 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.348+0000 7f1cae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:47.350 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.349+0000 7f1caf577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.349+0000 7f1caf577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.349+0000 7f1caf577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.349+0000 7f1cae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.349+0000 7f1cae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.349+0000 7f1cae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 10 monclient(hunting): handle_auth_done global_id 5034 payload 274 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 1 -- 10.20.193.10:0/2547803522 >> v2:10.20.193.153:3300/0 conn(0x7f1cb00c92f0 msgr2=0x7f1cb015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 1 --2- 10.20.193.10:0/2547803522 >> v2:10.20.193.153:3300/0 conn(0x7f1cb00c92f0 0x7f1cb015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 1 -- 10.20.193.10:0/2547803522 >> v1:10.20.193.10:6789/0 conn(0x7f1cb015d220 legacy=0x7f1cb00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 10 monclient: _finish_hunting 0 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 1 monclient: found mon.noname-a 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:47.351 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 1 -- 10.20.193.10:0/2547803522 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb00c8100 con 0x7f1cb0074920 2026-02-17T12:00:47.352 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.350+0000 7f1caf577640 1 --2- 10.20.193.10:0/2547803522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 0x7f1cb0153650 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009e50 tx=0x7f1ca002f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf114c98b5359278 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 1 -- 10.20.193.10:0/2547803522 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca002fcc0 con 0x7f1cb0074920 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 10 monclient: dump: 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 10 monclient: _finish_auth 0 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 10 monclient: _check_auth_tickets 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 1 -- 10.20.193.10:0/2547803522 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca00373f0 con 0x7f1cb0074920 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 5 monclient: authenticate success, global_id 5034 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 1 -- 10.20.193.10:0/2547803522 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca002fe60 con 0x7f1cb0074920 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cadd74640 10 monclient: dump: 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:47.355 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 4 set_mon_vals no callback set 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 10 monclient: shutdown 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 1 -- 10.20.193.10:0/2547803522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 msgr2=0x7f1cb0153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 1 --2- 10.20.193.10:0/2547803522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 0x7f1cb0153650 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009e50 tx=0x7f1ca002f2a0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 1 -- 10.20.193.10:0/2547803522 shutdown_connections 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 1 --2- 10.20.193.10:0/2547803522 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 0x7f1cb0153650 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 1 --2- 10.20.193.10:0/2547803522 >> v2:10.20.193.153:3300/0 conn(0x7f1cb00c92f0 0x7f1cb015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 1 -- 10.20.193.10:0/2547803522 >> 10.20.193.10:0/2547803522 conn(0x7f1cb00c9d80 msgr2=0x7f1cb00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 1 -- 10.20.193.10:0/2547803522 shutdown_connections 2026-02-17T12:00:47.356 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.353+0000 7f1cb5066640 1 -- 10.20.193.10:0/2547803522 wait complete. 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient: build_initial_monmap 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient: monmap: 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 librados: starting msgr at 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 librados: starting objecter 2026-02-17T12:00:47.357 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 Processor -- start 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 -- start start 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 librados: setting wanted keys 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 librados: calling monclient init 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient: init 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 0x7f1cb006e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient(hunting): picked mon.noname-a con 0x7f1cb0074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1cb00c92f0 0x7f1cb006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient(hunting): picked mon.noname-b con 0x7f1cb00c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1cb015d220 0x7f1cb01f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient(hunting): picked mon.noname-c con 0x7f1cb015d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb0074d70 con 0x7f1cb0074920 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb00c86c0 con 0x7f1cb00c92f0 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb0153b90 con 0x7f1cb015d220 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.354+0000 7f1cb5066640 10 monclient(hunting): authenticate will time out at 1317.076894s 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 0x7f1cb006e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caf577640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1cb015d220 0x7f1cb01f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 0x7f1cb006e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:37766/0 (socket says 10.20.193.10:37766) 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 1 -- 10.20.193.10:0/2235026405 learned_addr learned my addr 10.20.193.10:0/2235026405 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 10 monclient(hunting): get_auth_request con 0x7f1cb0074920 auth_method 0 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caf577640 10 monclient(hunting): get_auth_request con 0x7f1cb015d220 auth_method 0 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caf577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caf577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caf577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1cae575640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1cb00c92f0 0x7f1cb006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caf577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caf577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:47.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1caf577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1cae575640 10 monclient(hunting): get_auth_request con 0x7f1cb00c92f0 auth_method 0 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1cae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1cae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1cae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1cae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1cae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.355+0000 7f1cae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 10 monclient(hunting): handle_auth_done global_id 5037 payload 824 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 1 -- 10.20.193.10:0/2235026405 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1cb015d220 msgr2=0x7f1cb01f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1cb015d220 0x7f1cb01f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 1 -- 10.20.193.10:0/2235026405 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1cb00c92f0 msgr2=0x7f1cb006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1cb00c92f0 0x7f1cb006eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 10 monclient: _finish_hunting 0 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 1 monclient: found mon.noname-a 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.356+0000 7f1caed76640 1 -- 10.20.193.10:0/2235026405 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb0073e50 con 0x7f1cb0074920 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.357+0000 7f1caed76640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 0x7f1cb006e990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400b4d0 tx=0x7f1ca400b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.357+0000 7f1c8f7fe640 10 client.?.objecter ms_handle_connect 0x7f1cb0074920 2026-02-17T12:00:47.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.357+0000 7f1c8f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 1 -- 10.20.193.10:0/2235026405 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4004480 con 0x7f1cb0074920 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 10 monclient: dump: 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:00:47.361 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 1 -- 10.20.193.10:0/2235026405 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca4015070 con 0x7f1cb0074920 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cb5066640 5 monclient: authenticate success, global_id 5037 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cb5066640 10 monclient: _renew_subs 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cb5066640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb006d8f0 con 0x7f1cb0074920 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 1 -- 10.20.193.10:0/2235026405 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4002920 con 0x7f1cb0074920 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1c8f7fe640 10 monclient: dump: 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cad573640 4 set_mon_vals no callback set 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cb5066640 10 client.5037.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cb5066640 10 monclient: _renew_subs 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cb5066640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb006deb0 con 0x7f1cb0074920 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.359+0000 7f1cb5066640 1 librados: init done 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.360+0000 7f1cb5066640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.360+0000 7f1cb5066640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.360+0000 7f1cb5066640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:47.362 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.360+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb0069900 con 0x7f1cb0074920 2026-02-17T12:00:47.373 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.371+0000 7f1c8f7fe640 1 -- 10.20.193.10:0/2235026405 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f1ca4010480 con 0x7f1cb0074920 2026-02-17T12:00:47.374 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.372+0000 7f1c8f7fe640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1c7c078e50 0x7f1c7c07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:47.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.372+0000 7f1cae575640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1c7c078e50 0x7f1c7c07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:47.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.372+0000 7f1cae575640 10 monclient: get_auth_request con 0x7f1c7c078e50 auth_method 0 2026-02-17T12:00:47.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.372+0000 7f1cae575640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1c7c078e50 0x7f1c7c07b310 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1cb01f4770 tx=0x7f1c98009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:47.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.372+0000 7f1c8f7fe640 10 client.5037.objecter ms_handle_connect 0x7f1c7c078e50 2026-02-17T12:00:47.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.373+0000 7f1c8f7fe640 1 -- 10.20.193.10:0/2235026405 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f1ca405e1c0 con 0x7f1cb0074920 2026-02-17T12:00:47.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.373+0000 7f1c8f7fe640 10 client.5037.objecter ms_dispatch2 0x7f1cb0000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:47.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.373+0000 7f1c8f7fe640 3 client.5037.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:47.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.373+0000 7f1c8f7fe640 3 client.5037.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:47.376 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.373+0000 7f1c8f7fe640 20 client.5037.objecter dump_active .. 0 homeless 2026-02-17T12:00:47.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.474+0000 7f1c8f7fe640 1 -- 10.20.193.10:0/2235026405 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1cb0069900 con 0x7f1cb0074920 2026-02-17T12:00:47.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.474+0000 7f1c8f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:47.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.474+0000 7f1c8f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:47.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.575+0000 7f1cb5066640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:47.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.575+0000 7f1cb5066640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:47.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.575+0000 7f1cb5066640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:47.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.575+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1cb0153f20 con 0x7f1cb0074920 2026-02-17T12:00:47.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.578+0000 7f1c8f7fe640 1 -- 10.20.193.10:0/2235026405 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f1ca4062180 con 0x7f1cb0074920 2026-02-17T12:00:47.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.578+0000 7f1c8f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:47.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.578+0000 7f1c8f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:47.580 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:47.581 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:47.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 10 librados: watch_flush enter 2026-02-17T12:00:47.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 10 librados: watch_flush exit 2026-02-17T12:00:47.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 20 client.5037.objecter shutdown clearing up homeless session... 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 10 client.5037.objecter successfully canceled tick 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1c7c078e50 msgr2=0x7f1c7c07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1c7c078e50 0x7f1c7c07b310 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1cb01f4770 tx=0x7f1c98009290 comp rx=0 tx=0).stop 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 10 monclient: shutdown 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 msgr2=0x7f1cb006e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 0x7f1cb006e990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400b4d0 tx=0x7f1ca400b9a0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 shutdown_connections 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1c7c078e50 0x7f1c7c07b310 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1cb015d220 0x7f1cb01f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1cb00c92f0 0x7f1cb006eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 --2- 10.20.193.10:0/2235026405 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1cb0074920 0x7f1cb006e990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:47.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 >> 10.20.193.10:0/2235026405 conn(0x7f1cb00c9d80 msgr2=0x7f1cb0153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:47.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 shutdown_connections 2026-02-17T12:00:47.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 -- 10.20.193.10:0/2235026405 wait complete. 2026-02-17T12:00:47.584 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:47.579+0000 7f1cb5066640 1 librados: shutdown 2026-02-17T12:00:50.591 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:50.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.657+0000 7f5cac2c4640 10 monclient: get_monmap_and_config 2026-02-17T12:00:50.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.657+0000 7f5cac2c4640 10 monclient: build_initial_monmap 2026-02-17T12:00:50.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.657+0000 7f5cac2c4640 10 monclient: monmap: 2026-02-17T12:00:50.660 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:50.660 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:50.660 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:50.658576+0000 2026-02-17T12:00:50.660 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:50.658576+0000 2026-02-17T12:00:50.660 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:50.660 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.657+0000 7f5cac2c4640 1 Processor -- start 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.657+0000 7f5cac2c4640 1 -- start start 2026-02-17T12:00:50.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.657+0000 7f5cac2c4640 10 monclient: init 2026-02-17T12:00:50.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:50.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 10 monclient: _add_conns ranks=[5,3,0,2,4,1] 2026-02-17T12:00:50.670 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5ca415d220 0x7f5ca415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 10 monclient(hunting): picked mon.noname-c con 0x7f5ca415d220 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f5ca4074920 0x7f5ca40c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 10 monclient(hunting): picked mon.noname-a con 0x7f5ca4074920 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5ca40c9120 addr v1:10.20.193.10:6789/0 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca40c95b0 con 0x7f5ca40c9120 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca40c58a0 con 0x7f5ca4074920 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca40c55c0 con 0x7f5ca415d220 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5cac2c4640 10 monclient(hunting): authenticate will time out at 1320.380513s 2026-02-17T12:00:50.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5ca9838640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f5ca4074920 0x7f5ca40c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.658+0000 7f5caa039640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5ca415d220 0x7f5ca415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5ca9838640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f5ca4074920 0x7f5ca40c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:37778/0 (socket says 10.20.193.10:37778) 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5ca9838640 1 -- 10.20.193.10:0/4171573884 learned_addr learned my addr 10.20.193.10:0/4171573884 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5ca9838640 10 monclient(hunting): get_auth_request con 0x7f5ca4074920 auth_method 0 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5ca9838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5ca9838640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5ca9838640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5caa039640 10 monclient(hunting): get_auth_request con 0x7f5ca415d220 auth_method 0 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5caa039640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5caa039640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5caa039640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5ca9838640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:50.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5ca9838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5ca9838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5caa039640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5caa039640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.659+0000 7f5caa039640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.660+0000 7f5ca9838640 10 monclient(hunting): handle_auth_done global_id 5040 payload 274 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.660+0000 7f5ca9838640 1 -- 10.20.193.10:0/4171573884 >> v2:10.20.193.153:3300/0 conn(0x7f5ca415d220 msgr2=0x7f5ca415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.660+0000 7f5ca9838640 1 --2- 10.20.193.10:0/4171573884 >> v2:10.20.193.153:3300/0 conn(0x7f5ca415d220 0x7f5ca415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.660+0000 7f5ca9838640 1 -- 10.20.193.10:0/4171573884 >> v1:10.20.193.10:6789/0 conn(0x7f5ca40c9120 legacy=0x7f5ca4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.660+0000 7f5ca9838640 10 monclient: _finish_hunting 0 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.660+0000 7f5ca9838640 1 monclient: found mon.noname-a 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.660+0000 7f5ca9838640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.660+0000 7f5ca9838640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:50.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.660+0000 7f5ca9838640 1 -- 10.20.193.10:0/4171573884 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca40c7e20 con 0x7f5ca4074920 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.661+0000 7f5ca9838640 1 --2- 10.20.193.10:0/4171573884 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca4074920 0x7f5ca40c8be0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009970 tx=0x7f5c9802eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0315a678f9c825 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 1 -- 10.20.193.10:0/4171573884 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9803c070 con 0x7f5ca4074920 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 10 monclient: dump: 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:50.674 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 10 monclient: _finish_auth 0 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 10 monclient: _check_auth_tickets 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 5 monclient: authenticate success, global_id 5040 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 1 -- 10.20.193.10:0/4171573884 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c9802fb20 con 0x7f5ca4074920 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 1 -- 10.20.193.10:0/4171573884 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98037440 con 0x7f5ca4074920 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 4 set_mon_vals no callback set 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:50.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5ca9037640 10 monclient: dump: 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 10 monclient: shutdown 2026-02-17T12:00:50.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 1 -- 10.20.193.10:0/4171573884 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca4074920 msgr2=0x7f5ca40c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 1 --2- 10.20.193.10:0/4171573884 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca4074920 0x7f5ca40c8be0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009970 tx=0x7f5c9802eef0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 1 -- 10.20.193.10:0/4171573884 shutdown_connections 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 1 --2- 10.20.193.10:0/4171573884 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca4074920 0x7f5ca40c8be0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 1 --2- 10.20.193.10:0/4171573884 >> v2:10.20.193.153:3300/0 conn(0x7f5ca415d220 0x7f5ca415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 1 -- 10.20.193.10:0/4171573884 >> 10.20.193.10:0/4171573884 conn(0x7f5ca40c9d80 msgr2=0x7f5ca40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 1 -- 10.20.193.10:0/4171573884 shutdown_connections 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.663+0000 7f5cac2c4640 1 -- 10.20.193.10:0/4171573884 wait complete. 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.664+0000 7f5cac2c4640 10 monclient: build_initial_monmap 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.664+0000 7f5cac2c4640 10 monclient: monmap: 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:50.677 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.664+0000 7f5cac2c4640 1 librados: starting msgr at 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.664+0000 7f5cac2c4640 1 librados: starting objecter 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.664+0000 7f5cac2c4640 1 Processor -- start 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.664+0000 7f5cac2c4640 1 -- start start 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.664+0000 7f5cac2c4640 1 librados: setting wanted keys 2026-02-17T12:00:50.678 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.664+0000 7f5cac2c4640 1 librados: calling monclient init 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.664+0000 7f5cac2c4640 10 monclient: init 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ca4074920 0x7f5ca406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient(hunting): picked mon.noname-c con 0x7f5ca4074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca40c9120 0x7f5ca406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient(hunting): picked mon.noname-a con 0x7f5ca40c9120 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ca415d220 0x7f5ca4151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient(hunting): picked mon.noname-b con 0x7f5ca415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca40c86c0 con 0x7f5ca40c9120 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca40c83e0 con 0x7f5ca415d220 2026-02-17T12:00:50.679 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4074d70 con 0x7f5ca4074920 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5cac2c4640 10 monclient(hunting): authenticate will time out at 1320.387418s 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5caa039640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ca4074920 0x7f5ca406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5ca9838640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca40c9120 0x7f5ca406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5ca9838640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca40c9120 0x7f5ca406d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:37792/0 (socket says 10.20.193.10:37792) 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5ca9838640 1 -- 10.20.193.10:0/1316283572 learned_addr learned my addr 10.20.193.10:0/1316283572 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5ca9838640 10 monclient(hunting): get_auth_request con 0x7f5ca40c9120 auth_method 0 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5ca9838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5ca9838640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5ca9838640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5caa039640 10 monclient(hunting): get_auth_request con 0x7f5ca4074920 auth_method 0 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5caa039640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5caa039640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:50.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5caa039640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.665+0000 7f5caa83a640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ca415d220 0x7f5ca4151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa83a640 10 monclient(hunting): get_auth_request con 0x7f5ca415d220 auth_method 0 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa83a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa83a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa83a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5ca9838640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5ca9838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5ca9838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa039640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa039640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa039640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa83a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa83a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:50.681 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.666+0000 7f5caa83a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 10 monclient(hunting): handle_auth_done global_id 5043 payload 824 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 1 -- 10.20.193.10:0/1316283572 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ca4074920 msgr2=0x7f5ca406eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ca4074920 0x7f5ca406eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 1 -- 10.20.193.10:0/1316283572 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ca415d220 msgr2=0x7f5ca4151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ca415d220 0x7f5ca4151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 10 monclient: _finish_hunting 0 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 1 monclient: found mon.noname-a 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.667+0000 7f5ca9838640 1 -- 10.20.193.10:0/1316283572 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca41e5000 con 0x7f5ca40c9120 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.668+0000 7f5ca9838640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca40c9120 0x7f5ca406d1b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5c9802f400 tx=0x7f5c980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.668+0000 7f5c8affd640 10 client.?.objecter ms_handle_connect 0x7f5ca40c9120 2026-02-17T12:00:50.682 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.668+0000 7f5c8affd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:50.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.669+0000 7f5c8affd640 1 -- 10.20.193.10:0/1316283572 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9803c040 con 0x7f5ca40c9120 2026-02-17T12:00:50.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:50.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:50.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 10 monclient: dump: 2026-02-17T12:00:50.684 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 10 monclient: _finish_auth 0 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 5 monclient: authenticate success, global_id 5043 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 10 monclient: _renew_subs 2026-02-17T12:00:50.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 1 -- 10.20.193.10:0/1316283572 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c98042630 con 0x7f5ca40c9120 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca406db80 con 0x7f5ca40c9120 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 1 -- 10.20.193.10:0/1316283572 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98042a20 con 0x7f5ca40c9120 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5ca8836640 4 set_mon_vals no callback set 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5c8affd640 10 monclient: dump: 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:50.686 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 10 client.5043.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 10 monclient: _renew_subs 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca41e52a0 con 0x7f5ca40c9120 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 1 librados: init done 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.670+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca40c8be0 con 0x7f5ca40c9120 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.682+0000 7f5c8affd640 1 -- 10.20.193.10:0/1316283572 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5c98042bc0 con 0x7f5ca40c9120 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.682+0000 7f5c8affd640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c74078e50 0x7f5c7407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.682+0000 7f5caa039640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c74078e50 0x7f5c7407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.682+0000 7f5caa039640 10 monclient: get_auth_request con 0x7f5c74078e50 auth_method 0 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.682+0000 7f5caa039640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c74078e50 0x7f5c7407b310 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009ba0 tx=0x7f5c94009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:50.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.682+0000 7f5c8affd640 10 client.5043.objecter ms_handle_connect 0x7f5c74078e50 2026-02-17T12:00:50.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.684+0000 7f5c8affd640 1 -- 10.20.193.10:0/1316283572 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5c9802f9e0 con 0x7f5ca40c9120 2026-02-17T12:00:50.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.684+0000 7f5c8affd640 10 client.5043.objecter ms_dispatch2 0x7f5ca4000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:50.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.684+0000 7f5c8affd640 3 client.5043.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:50.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.684+0000 7f5c8affd640 3 client.5043.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:50.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.684+0000 7f5c8affd640 20 client.5043.objecter dump_active .. 0 homeless 2026-02-17T12:00:50.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.784+0000 7f5c8affd640 1 -- 10.20.193.10:0/1316283572 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5c980876f0 con 0x7f5ca40c9120 2026-02-17T12:00:50.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.784+0000 7f5c8affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:50.787 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.784+0000 7f5c8affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:50.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.885+0000 7f5cac2c4640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:50.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.885+0000 7f5cac2c4640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:50.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.885+0000 7f5cac2c4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:50.887 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.885+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5ca40c9b60 con 0x7f5ca40c9120 2026-02-17T12:00:50.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.911+0000 7f5c8affd640 1 -- 10.20.193.10:0/1316283572 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f5c9808b9f0 con 0x7f5ca40c9120 2026-02-17T12:00:50.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.912+0000 7f5c8affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:50.913 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.912+0000 7f5c8affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:50.913 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:50.913 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 10 librados: watch_flush enter 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 10 librados: watch_flush exit 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 20 client.5043.objecter shutdown clearing up homeless session... 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 10 client.5043.objecter successfully canceled tick 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c74078e50 msgr2=0x7f5c7407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c74078e50 0x7f5c7407b310 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009ba0 tx=0x7f5c94009290 comp rx=0 tx=0).stop 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 10 monclient: shutdown 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca40c9120 msgr2=0x7f5ca406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca40c9120 0x7f5ca406d1b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5c9802f400 tx=0x7f5c980047c0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 shutdown_connections 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5c74078e50 0x7f5c7407b310 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5ca415d220 0x7f5ca4151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5ca40c9120 0x7f5ca406d1b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 --2- 10.20.193.10:0/1316283572 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5ca4074920 0x7f5ca406eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 >> 10.20.193.10:0/1316283572 conn(0x7f5ca40c9d80 msgr2=0x7f5ca4152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 shutdown_connections 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 -- 10.20.193.10:0/1316283572 wait complete. 2026-02-17T12:00:50.916 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:50.914+0000 7f5cac2c4640 1 librados: shutdown 2026-02-17T12:00:53.926 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:53.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.994+0000 7f83a23ba640 10 monclient: get_monmap_and_config 2026-02-17T12:00:53.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.994+0000 7f83a23ba640 10 monclient: build_initial_monmap 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.994+0000 7f83a23ba640 10 monclient: monmap: 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:53.994419+0000 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:53.994419+0000 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:53.996 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:53.997 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:53.997 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:53.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.994+0000 7f83a23ba640 1 Processor -- start 2026-02-17T12:00:53.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.994+0000 7f83a23ba640 1 -- start start 2026-02-17T12:00:53.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.994+0000 7f83a23ba640 10 monclient: init 2026-02-17T12:00:54.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:54.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 10 monclient: _add_conns ranks=[1,0,5,3,4,2] 2026-02-17T12:00:54.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f839c15d220 addr v1:10.20.193.71:6789/0 2026-02-17T12:00:54.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f839c0c92f0 addr v1:10.20.193.10:6789/0 2026-02-17T12:00:54.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f839c153d60 0x7f839c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:54.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 10 monclient(hunting): picked mon.noname-c con 0x7f839c153d60 addr v2:10.20.193.153:3300/0 2026-02-17T12:00:54.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839c0c58a0 con 0x7f839c0c92f0 2026-02-17T12:00:54.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839c0c55c0 con 0x7f839c15d220 2026-02-17T12:00:54.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f839c0c7e20 con 0x7f839c153d60 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a23ba640 10 monclient(hunting): authenticate will time out at 1323.716255s 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f839bfff640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f839c15d220 0x7f839c0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:59010/0 (socket says 10.20.193.10:59010) 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f839b7fe640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f839c0c92f0 0x7f839c153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:40400/0 (socket says 10.20.193.10:40400) 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f839bfff640 1 -- 10.20.193.10:0/680001417 learned_addr learned my addr 10.20.193.10:0/680001417 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a0930640 1 --2- 10.20.193.10:0/680001417 >> v2:10.20.193.153:3300/0 conn(0x7f839c153d60 0x7f839c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a0930640 10 monclient(hunting): get_auth_request con 0x7f839c153d60 auth_method 0 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a0930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a0930640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:54.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.995+0000 7f83a0930640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f83a0930640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f83a0930640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f83a0930640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 1 -- 10.20.193.10:0/680001417 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058254358 0 0) 0x7f839c0c58a0 con 0x7f839c0c92f0 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 10 monclient(hunting): _negotiate 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 10 monclient(hunting): my global_id is 5046 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 1 -- 10.20.193.10:0/680001417 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8380003620 con 0x7f839c0c92f0 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 1 -- 10.20.193.10:0/680001417 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686451298 0 0) 0x7f839c0c55c0 con 0x7f839c15d220 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 10 monclient(hunting): _negotiate 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:54.007 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 10 monclient(hunting): my global_id is 5077 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.996+0000 7f839affd640 1 -- 10.20.193.10:0/680001417 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f839c0c58a0 con 0x7f839c15d220 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.997+0000 7f83a0930640 10 monclient(hunting): handle_auth_done global_id 5099 payload 274 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.997+0000 7f83a0930640 1 -- 10.20.193.10:0/680001417 >> v1:10.20.193.71:6789/0 conn(0x7f839c15d220 legacy=0x7f839c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.997+0000 7f83a0930640 1 -- 10.20.193.10:0/680001417 >> v1:10.20.193.10:6789/0 conn(0x7f839c0c92f0 legacy=0x7f839c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.997+0000 7f83a0930640 10 monclient: _finish_hunting 0 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.997+0000 7f83a0930640 1 monclient: found mon.noname-c 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.997+0000 7f83a0930640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.997+0000 7f83a0930640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.997+0000 7f83a0930640 1 -- 10.20.193.10:0/680001417 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c0c8100 con 0x7f839c153d60 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.997+0000 7f83a0930640 1 --2- 10.20.193.10:0/680001417 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c153d60 0x7f839c15d600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8390009dc0 tx=0x7f839002f280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5f2d23e39c93755 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 1 -- 10.20.193.10:0/680001417 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839003c070 con 0x7f839c153d60 2026-02-17T12:00:54.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 10 monclient: dump: 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:54.009 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 10 monclient: _finish_auth 0 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 1 -- 10.20.193.10:0/680001417 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8390037440 con 0x7f839c153d60 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 5 monclient: authenticate success, global_id 5099 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 1 -- 10.20.193.10:0/680001417 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390037810 con 0x7f839c153d60 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 4 set_mon_vals no callback set 2026-02-17T12:00:54.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f839affd640 10 monclient: dump: 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:54.011 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 10 monclient: shutdown 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 1 -- 10.20.193.10:0/680001417 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c153d60 msgr2=0x7f839c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 1 --2- 10.20.193.10:0/680001417 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c153d60 0x7f839c15d600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8390009dc0 tx=0x7f839002f280 comp rx=0 tx=0).stop 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 1 -- 10.20.193.10:0/680001417 shutdown_connections 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 1 --2- 10.20.193.10:0/680001417 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c153d60 0x7f839c15d600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 1 -- 10.20.193.10:0/680001417 >> 10.20.193.10:0/680001417 conn(0x7f839c0c9d80 msgr2=0x7f839c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 1 -- 10.20.193.10:0/680001417 shutdown_connections 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:53.999+0000 7f83a23ba640 1 -- 10.20.193.10:0/680001417 wait complete. 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.000+0000 7f83a23ba640 10 monclient: build_initial_monmap 2026-02-17T12:00:54.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.000+0000 7f83a23ba640 10 monclient: monmap: 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.000+0000 7f83a23ba640 1 librados: starting msgr at 2026-02-17T12:00:54.013 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.000+0000 7f83a23ba640 1 librados: starting objecter 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.000+0000 7f83a23ba640 1 Processor -- start 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.000+0000 7f83a23ba640 1 -- start start 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.000+0000 7f83a23ba640 1 librados: setting wanted keys 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.000+0000 7f83a23ba640 1 librados: calling monclient init 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.000+0000 7f83a23ba640 10 monclient: init 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f839c0c92f0 0x7f839c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient(hunting): picked mon.noname-a con 0x7f839c0c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f839c153d60 0x7f839c1f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient(hunting): picked mon.noname-b con 0x7f839c153d60 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c15d220 0x7f839c15a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:54.014 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient(hunting): picked mon.noname-c con 0x7f839c15d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f839c074920 con 0x7f839c0c92f0 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0c86c0 con 0x7f839c153d60 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f839c074aa0 con 0x7f839c15d220 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a23ba640 10 monclient(hunting): authenticate will time out at 1323.722087s 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c15d220 0x7f839c15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839bfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f839c0c92f0 0x7f839c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839b7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f839c153d60 0x7f839c1f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:54.015 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c15d220 0x7f839c15a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:50750/0 (socket says 10.20.193.10:50750) 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 1 -- 10.20.193.10:0/3164758681 learned_addr learned my addr 10.20.193.10:0/3164758681 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 10 monclient(hunting): get_auth_request con 0x7f839c15d220 auth_method 0 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839bfff640 10 monclient(hunting): get_auth_request con 0x7f839c0c92f0 auth_method 0 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839b7fe640 10 monclient(hunting): get_auth_request con 0x7f839c153d60 auth_method 0 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:54.016 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f83a0930640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.001+0000 7f839b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 10 monclient(hunting): handle_auth_done global_id 5102 payload 824 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 1 -- 10.20.193.10:0/3164758681 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f839c153d60 msgr2=0x7f839c1f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f839c153d60 0x7f839c1f7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:54.017 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 1 -- 10.20.193.10:0/3164758681 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f839c0c92f0 msgr2=0x7f839c156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:54.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f839c0c92f0 0x7f839c156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:54.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 10 monclient: _finish_hunting 0 2026-02-17T12:00:54.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 1 monclient: found mon.noname-c 2026-02-17T12:00:54.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:54.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:00:54.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.002+0000 7f83a0930640 1 -- 10.20.193.10:0/3164758681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c15a6d0 con 0x7f839c15d220 2026-02-17T12:00:54.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.003+0000 7f83a0930640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c15d220 0x7f839c15a190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8390009dc0 tx=0x7f8390004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:54.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.003+0000 7f8398ff9640 10 client.?.objecter ms_handle_connect 0x7f839c15d220 2026-02-17T12:00:54.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.003+0000 7f8398ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:54.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 1 -- 10.20.193.10:0/3164758681 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390047020 con 0x7f839c15d220 2026-02-17T12:00:54.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 10 monclient: dump: 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:54.022 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 10 monclient: _finish_auth 0 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 5 monclient: authenticate success, global_id 5102 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 10 monclient: _renew_subs 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c1f38f0 con 0x7f839c15d220 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 10 client.5102.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 10 monclient: _renew_subs 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:54.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c1f3eb0 con 0x7f839c15d220 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 1 librados: init done 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 1 -- 10.20.193.10:0/3164758681 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839003d040 con 0x7f839c15d220 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 1 -- 10.20.193.10:0/3164758681 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839003c050 con 0x7f839c15d220 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f8398ff9640 10 monclient: dump: 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:54.024 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f839a7fc640 4 set_mon_vals no callback set 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.005+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c14e270 con 0x7f839c15d220 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.016+0000 7f8398ff9640 1 -- 10.20.193.10:0/3164758681 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f8390054070 con 0x7f839c15d220 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.017+0000 7f8398ff9640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f836c078e00 0x7f836c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:54.025 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.017+0000 7f839bfff640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f836c078e00 0x7f836c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:54.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.017+0000 7f839bfff640 10 monclient: get_auth_request con 0x7f836c078e00 auth_method 0 2026-02-17T12:00:54.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.017+0000 7f8398ff9640 10 client.5102.objecter ms_handle_connect 0x7f836c078e00 2026-02-17T12:00:54.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.017+0000 7f839bfff640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f836c078e00 0x7f836c07b2c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8388005980 tx=0x7f8388009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:54.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.018+0000 7f8398ff9640 1 -- 10.20.193.10:0/3164758681 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f83900bd5e0 con 0x7f839c15d220 2026-02-17T12:00:54.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.018+0000 7f8398ff9640 10 client.5102.objecter ms_dispatch2 0x7f839c000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:54.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.018+0000 7f8398ff9640 3 client.5102.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:54.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.018+0000 7f8398ff9640 3 client.5102.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:54.026 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.018+0000 7f8398ff9640 20 client.5102.objecter dump_active .. 0 homeless 2026-02-17T12:00:54.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.123+0000 7f8398ff9640 1 -- 10.20.193.10:0/3164758681 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f839c14e270 con 0x7f839c15d220 2026-02-17T12:00:54.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.123+0000 7f8398ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:54.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.123+0000 7f8398ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:54.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.222+0000 7f83a23ba640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:54.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.222+0000 7f83a23ba640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:54.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.222+0000 7f83a23ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:00:54.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.222+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f839c15d600 con 0x7f839c15d220 2026-02-17T12:00:54.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.225+0000 7f8398ff9640 1 -- 10.20.193.10:0/3164758681 <== mon.2 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f8390051020 con 0x7f839c15d220 2026-02-17T12:00:54.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.225+0000 7f8398ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:54.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.225+0000 7f8398ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:54.226 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:54.227 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:54.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 10 librados: watch_flush enter 2026-02-17T12:00:54.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 10 librados: watch_flush exit 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 20 client.5102.objecter shutdown clearing up homeless session... 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 10 client.5102.objecter successfully canceled tick 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f836c078e00 msgr2=0x7f836c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f836c078e00 0x7f836c07b2c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8388005980 tx=0x7f8388009040 comp rx=0 tx=0).stop 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 10 monclient: shutdown 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c15d220 msgr2=0x7f839c15a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c15d220 0x7f839c15a190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8390009dc0 tx=0x7f8390004b40 comp rx=0 tx=0).stop 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 shutdown_connections 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f836c078e00 0x7f836c07b2c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:54.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f839c15d220 0x7f839c15a190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:54.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f839c153d60 0x7f839c1f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:54.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 --2- 10.20.193.10:0/3164758681 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f839c0c92f0 0x7f839c156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:54.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 >> 10.20.193.10:0/3164758681 conn(0x7f839c0c9d80 msgr2=0x7f839c14db60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:54.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 shutdown_connections 2026-02-17T12:00:54.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 -- 10.20.193.10:0/3164758681 wait complete. 2026-02-17T12:00:54.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:54.226+0000 7f83a23ba640 1 librados: shutdown 2026-02-17T12:00:55.394 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:07:12.563 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:55.422 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:07:12.590 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:55.423 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:07:12.587 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:55.423 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:07:12.552 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:55.425 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:07:12.588 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:55.425 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:07:12.554 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:55.430 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:07:12.599 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:55.432 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:07:12.596 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:55.433 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:07:12.562 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:00:57.236 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:00:57.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.303+0000 7fda4c8bf640 10 monclient: get_monmap_and_config 2026-02-17T12:00:57.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.303+0000 7fda4c8bf640 10 monclient: build_initial_monmap 2026-02-17T12:00:57.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.303+0000 7fda4c8bf640 10 monclient: monmap: 2026-02-17T12:00:57.305 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:57.305 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:57.305 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:00:57.303868+0000 2026-02-17T12:00:57.305 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:00:57.303868+0000 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 1 Processor -- start 2026-02-17T12:00:57.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 1 -- start start 2026-02-17T12:00:57.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 10 monclient: init 2026-02-17T12:00:57.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:57.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 10 monclient: _add_conns ranks=[3,0,1,5,2,4] 2026-02-17T12:00:57.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fda44155e80 0x7fda440745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:57.309 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 10 monclient(hunting): picked mon.noname-a con 0x7fda44155e80 addr v2:10.20.193.10:3300/0 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fda44156260 addr v1:10.20.193.10:6789/0 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fda440cd2d0 addr v1:10.20.193.71:6789/0 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda44073520 con 0x7fda44156260 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda44073800 con 0x7fda440cd2d0 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fda440cd840 con 0x7fda44155e80 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.304+0000 7fda4c8bf640 10 monclient(hunting): authenticate will time out at 1327.025719s 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fda44155e80 0x7fda440745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fda44155e80 0x7fda440745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38976/0 (socket says 10.20.193.10:38976) 2026-02-17T12:00:57.310 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 1 -- 10.20.193.10:0/2721004750 learned_addr learned my addr 10.20.193.10:0/2721004750 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 10 monclient(hunting): get_auth_request con 0x7fda44155e80 auth_method 0 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.305+0000 7fda4a634640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.306+0000 7fda4a634640 10 monclient(hunting): handle_auth_done global_id 5052 payload 274 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.306+0000 7fda4a634640 1 -- 10.20.193.10:0/2721004750 >> v1:10.20.193.71:6789/0 conn(0x7fda440cd2d0 legacy=0x7fda4415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.306+0000 7fda4a634640 1 -- 10.20.193.10:0/2721004750 >> v1:10.20.193.10:6789/0 conn(0x7fda44156260 legacy=0x7fda440ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.306+0000 7fda4a634640 10 monclient: _finish_hunting 0 2026-02-17T12:00:57.311 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.306+0000 7fda4a634640 1 monclient: found mon.noname-a 2026-02-17T12:00:57.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.306+0000 7fda4a634640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:57.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.306+0000 7fda4a634640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:57.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.306+0000 7fda4a634640 1 -- 10.20.193.10:0/2721004750 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda44073ae0 con 0x7fda44155e80 2026-02-17T12:00:57.312 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.307+0000 7fda4a634640 1 --2- 10.20.193.10:0/2721004750 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 0x7fda440745c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009970 tx=0x7fda3c02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae67dda5907dff7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:57.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 1 -- 10.20.193.10:0/2721004750 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c03c070 con 0x7fda44155e80 2026-02-17T12:00:57.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:57.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:57.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 10 monclient: dump: 2026-02-17T12:00:57.319 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:57.319 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:57.319 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:57.319 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:57.319 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 10 monclient: _finish_auth 0 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 10 monclient: _check_auth_tickets 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 1 -- 10.20.193.10:0/2721004750 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c02fbb0 con 0x7fda44155e80 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 5 monclient: authenticate success, global_id 5052 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:57.320 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 1 -- 10.20.193.10:0/2721004750 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c037440 con 0x7fda44155e80 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda49632640 10 monclient: dump: 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:57.321 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 10 monclient: get_monmap_and_config success 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 4 set_mon_vals no callback set 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 10 monclient: shutdown 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 1 -- 10.20.193.10:0/2721004750 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 msgr2=0x7fda440745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 1 --2- 10.20.193.10:0/2721004750 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 0x7fda440745c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009970 tx=0x7fda3c02eef0 comp rx=0 tx=0).stop 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 1 -- 10.20.193.10:0/2721004750 shutdown_connections 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 1 --2- 10.20.193.10:0/2721004750 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 0x7fda440745c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 1 -- 10.20.193.10:0/2721004750 >> 10.20.193.10:0/2721004750 conn(0x7fda440ce2b0 msgr2=0x7fda440ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 1 -- 10.20.193.10:0/2721004750 shutdown_connections 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.310+0000 7fda4c8bf640 1 -- 10.20.193.10:0/2721004750 wait complete. 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient: build_initial_monmap 2026-02-17T12:00:57.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient: monmap: 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 librados: starting msgr at 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 librados: starting objecter 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 Processor -- start 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 -- start start 2026-02-17T12:00:57.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 librados: setting wanted keys 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 librados: calling monclient init 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient: init 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient: _reopen_session rank -1 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fda440cd2d0 0x7fda44158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient(hunting): picked mon.noname-c con 0x7fda440cd2d0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 0x7fda440c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient(hunting): picked mon.noname-a con 0x7fda44155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fda44156260 0x7fda440c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient(hunting): picked mon.noname-b con 0x7fda44156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fda440c4870 con 0x7fda44155e80 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fda440740a0 con 0x7fda44156260 2026-02-17T12:00:57.324 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda440c49f0 con 0x7fda440cd2d0 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient(hunting): _renew_subs 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.311+0000 7fda4c8bf640 10 monclient(hunting): authenticate will time out at 1327.032841s 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 0x7fda440c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4ae35640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fda44156260 0x7fda440c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4a634640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fda440cd2d0 0x7fda44158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 0x7fda440c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38982/0 (socket says 10.20.193.10:38982) 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 1 -- 10.20.193.10:0/1135435999 learned_addr learned my addr 10.20.193.10:0/1135435999 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 10 monclient(hunting): get_auth_request con 0x7fda44155e80 auth_method 0 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4ae35640 10 monclient(hunting): get_auth_request con 0x7fda44156260 auth_method 0 2026-02-17T12:00:57.325 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4ae35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4ae35640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4ae35640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4a634640 10 monclient(hunting): get_auth_request con 0x7fda440cd2d0 auth_method 0 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4a634640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4a634640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4a634640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda49e33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4ae35640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4ae35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4ae35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4a634640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4a634640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.312+0000 7fda4a634640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.313+0000 7fda49e33640 10 monclient(hunting): handle_auth_done global_id 5055 payload 824 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.313+0000 7fda49e33640 1 -- 10.20.193.10:0/1135435999 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fda440cd2d0 msgr2=0x7fda44158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:57.326 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.313+0000 7fda49e33640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fda440cd2d0 0x7fda44158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.313+0000 7fda49e33640 1 -- 10.20.193.10:0/1135435999 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fda44156260 msgr2=0x7fda440c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.313+0000 7fda49e33640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fda44156260 0x7fda440c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.314+0000 7fda49e33640 10 monclient: _finish_hunting 0 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.314+0000 7fda49e33640 1 monclient: found mon.noname-a 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.314+0000 7fda49e33640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.314+0000 7fda49e33640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.314+0000 7fda49e33640 1 -- 10.20.193.10:0/1135435999 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda441e9ca0 con 0x7fda44155e80 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.315+0000 7fda49e33640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 0x7fda440c57d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda3000b4d0 tx=0x7fda3000b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.315+0000 7fda2effd640 10 client.?.objecter ms_handle_connect 0x7fda44155e80 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.315+0000 7fda2effd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 1 -- 10.20.193.10:0/1135435999 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30004480 con 0x7fda44155e80 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 10 monclient: dump: 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:57.327 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 10 monclient: _finish_auth 0 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 10 monclient: _check_auth_tickets 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 1 -- 10.20.193.10:0/1135435999 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda30015070 con 0x7fda44155e80 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 1 -- 10.20.193.10:0/1135435999 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30002920 con 0x7fda44155e80 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda4c8bf640 5 monclient: authenticate success, global_id 5055 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda4c8bf640 10 monclient: _renew_subs 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda4c8bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda48e31640 4 set_mon_vals no callback set 2026-02-17T12:00:57.328 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda441e8920 con 0x7fda44155e80 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda2effd640 10 monclient: dump: 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda4c8bf640 10 client.5055.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda4c8bf640 10 monclient: _renew_subs 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda4c8bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda441e8ee0 con 0x7fda44155e80 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.316+0000 7fda4c8bf640 1 librados: init done 2026-02-17T12:00:57.329 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.317+0000 7fda4c8bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:57.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.317+0000 7fda4c8bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:57.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.317+0000 7fda4c8bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:57.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.317+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda440ccbc0 con 0x7fda44155e80 2026-02-17T12:00:57.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.329+0000 7fda2effd640 1 -- 10.20.193.10:0/1135435999 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fda30002ac0 con 0x7fda44155e80 2026-02-17T12:00:57.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.329+0000 7fda2effd640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fda14078e00 0x7fda1407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:00:57.330 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.329+0000 7fda4a634640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fda14078e00 0x7fda1407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:00:57.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.329+0000 7fda4a634640 10 monclient: get_auth_request con 0x7fda14078e00 auth_method 0 2026-02-17T12:00:57.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.329+0000 7fda4a634640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fda14078e00 0x7fda1407b2c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda4408f5e0 tx=0x7fda3c033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:00:57.331 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.329+0000 7fda2effd640 10 client.5055.objecter ms_handle_connect 0x7fda14078e00 2026-02-17T12:00:57.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.331+0000 7fda2effd640 1 -- 10.20.193.10:0/1135435999 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fda3005e180 con 0x7fda44155e80 2026-02-17T12:00:57.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.331+0000 7fda2effd640 10 client.5055.objecter ms_dispatch2 0x7fda44000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:00:57.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.331+0000 7fda2effd640 3 client.5055.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:00:57.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.331+0000 7fda2effd640 3 client.5055.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:00:57.332 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.331+0000 7fda2effd640 20 client.5055.objecter dump_active .. 0 homeless 2026-02-17T12:00:57.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.434+0000 7fda2effd640 1 -- 10.20.193.10:0/1135435999 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fda30062140 con 0x7fda44155e80 2026-02-17T12:00:57.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.434+0000 7fda2effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:00:57.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.434+0000 7fda2effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:00:57.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.534+0000 7fda4c8bf640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:00:57.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.534+0000 7fda4c8bf640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:57.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.534+0000 7fda4c8bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:00:57.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.534+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fda441e9f30 con 0x7fda44155e80 2026-02-17T12:00:57.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.537+0000 7fda2effd640 1 -- 10.20.193.10:0/1135435999 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fda30066440 con 0x7fda44155e80 2026-02-17T12:00:57.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.537+0000 7fda2effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:00:57.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.537+0000 7fda2effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:00:57.538 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:00:57.539 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:00:57.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 10 librados: watch_flush enter 2026-02-17T12:00:57.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 10 librados: watch_flush exit 2026-02-17T12:00:57.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 20 client.5055.objecter shutdown clearing up homeless session... 2026-02-17T12:00:57.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 10 client.5055.objecter successfully canceled tick 2026-02-17T12:00:57.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fda14078e00 msgr2=0x7fda1407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:57.541 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fda14078e00 0x7fda1407b2c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda4408f5e0 tx=0x7fda3c033000 comp rx=0 tx=0).stop 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 10 monclient: shutdown 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 msgr2=0x7fda440c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 0x7fda440c57d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda3000b4d0 tx=0x7fda3000b9a0 comp rx=0 tx=0).stop 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 shutdown_connections 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fda14078e00 0x7fda1407b2c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fda44156260 0x7fda440c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fda44155e80 0x7fda440c57d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 --2- 10.20.193.10:0/1135435999 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fda440cd2d0 0x7fda44158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 >> 10.20.193.10:0/1135435999 conn(0x7fda440ce2b0 msgr2=0x7fda44152c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 shutdown_connections 2026-02-17T12:00:57.542 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 -- 10.20.193.10:0/1135435999 wait complete. 2026-02-17T12:00:57.543 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:00:57.538+0000 7fda4c8bf640 1 librados: shutdown 2026-02-17T12:01:00.549 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:01:00.618 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.616+0000 7f6c66322640 10 monclient: get_monmap_and_config 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.616+0000 7f6c66322640 10 monclient: build_initial_monmap 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.616+0000 7f6c66322640 10 monclient: monmap: 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:00.617559+0000 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:00.617559+0000 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:00.619 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:00.620 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:00.620 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:00.620 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:00.620 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:00.620 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:00.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.616+0000 7f6c66322640 1 Processor -- start 2026-02-17T12:01:00.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.616+0000 7f6c66322640 1 -- start start 2026-02-17T12:01:00.620 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.616+0000 7f6c66322640 10 monclient: init 2026-02-17T12:01:00.623 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:00.623 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 10 monclient: _add_conns ranks=[3,0,5,4,1,2] 2026-02-17T12:01:00.623 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f6c6015d220 0x7f6c6015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:00.623 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 10 monclient(hunting): picked mon.noname-a con 0x7f6c6015d220 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:00.623 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6c60074920 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6c600c92f0 0x7f6c60153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 10 monclient(hunting): picked mon.noname-c con 0x7f6c600c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c600c58a0 con 0x7f6c60074920 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f6c600c55c0 con 0x7f6c6015d220 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6c600c7e20 con 0x7f6c600c92f0 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c66322640 10 monclient(hunting): authenticate will time out at 1330.339267s 2026-02-17T12:01:00.624 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c5ffff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f6c6015d220 0x7f6c6015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c64898640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6c600c92f0 0x7f6c60153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c5ffff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f6c6015d220 0x7f6c6015d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:38994/0 (socket says 10.20.193.10:38994) 2026-02-17T12:01:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c5ffff640 1 -- 10.20.193.10:0/111045525 learned_addr learned my addr 10.20.193.10:0/111045525 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c5ffff640 10 monclient(hunting): get_auth_request con 0x7f6c6015d220 auth_method 0 2026-02-17T12:01:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.617+0000 7f6c5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c64898640 10 monclient(hunting): get_auth_request con 0x7f6c600c92f0 auth_method 0 2026-02-17T12:01:00.625 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c64898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c64898640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c64898640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c64898640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c64898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:00.626 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.618+0000 7f6c64898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:00.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.619+0000 7f6c5ffff640 10 monclient(hunting): handle_auth_done global_id 5058 payload 274 2026-02-17T12:01:00.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.619+0000 7f6c5ffff640 1 -- 10.20.193.10:0/111045525 >> v2:10.20.193.153:3300/0 conn(0x7f6c600c92f0 msgr2=0x7f6c60153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:00.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.619+0000 7f6c5ffff640 1 --2- 10.20.193.10:0/111045525 >> v2:10.20.193.153:3300/0 conn(0x7f6c600c92f0 0x7f6c60153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.619+0000 7f6c5ffff640 1 -- 10.20.193.10:0/111045525 >> v1:10.20.193.10:6789/0 conn(0x7f6c60074920 legacy=0x7f6c600c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:00.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.619+0000 7f6c5ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:00.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.619+0000 7f6c5ffff640 1 monclient: found mon.noname-a 2026-02-17T12:01:00.627 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.619+0000 7f6c5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:00.628 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.619+0000 7f6c5ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:00.628 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.619+0000 7f6c5ffff640 1 -- 10.20.193.10:0/111045525 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c600c8100 con 0x7f6c6015d220 2026-02-17T12:01:00.628 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.620+0000 7f6c5ffff640 1 --2- 10.20.193.10:0/111045525 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 0x7f6c6015d600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009970 tx=0x7f6c4c02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f76de32cc49934 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 1 -- 10.20.193.10:0/111045525 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c03c070 con 0x7f6c6015d220 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 10 monclient: dump: 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 10 monclient: _finish_auth 0 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 1 -- 10.20.193.10:0/111045525 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4c02fb20 con 0x7f6c6015d220 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 5 monclient: authenticate success, global_id 5058 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 1 -- 10.20.193.10:0/111045525 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c037440 con 0x7f6c6015d220 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c5effd640 10 monclient: dump: 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:00.635 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 4 set_mon_vals no callback set 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 10 monclient: shutdown 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 1 -- 10.20.193.10:0/111045525 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 msgr2=0x7f6c6015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 1 --2- 10.20.193.10:0/111045525 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 0x7f6c6015d600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009970 tx=0x7f6c4c02eef0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 1 -- 10.20.193.10:0/111045525 shutdown_connections 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 1 --2- 10.20.193.10:0/111045525 >> v2:10.20.193.153:3300/0 conn(0x7f6c600c92f0 0x7f6c60153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 1 --2- 10.20.193.10:0/111045525 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 0x7f6c6015d600 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 1 -- 10.20.193.10:0/111045525 >> 10.20.193.10:0/111045525 conn(0x7f6c600c9d80 msgr2=0x7f6c600ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 1 -- 10.20.193.10:0/111045525 shutdown_connections 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.622+0000 7f6c66322640 1 -- 10.20.193.10:0/111045525 wait complete. 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 10 monclient: build_initial_monmap 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 10 monclient: monmap: 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 1 librados: starting msgr at 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 1 librados: starting objecter 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 1 Processor -- start 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 1 -- start start 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 1 librados: setting wanted keys 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 1 librados: calling monclient init 2026-02-17T12:01:00.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 10 monclient: init 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c60074920 0x7f6c60145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 10 monclient(hunting): picked mon.noname-c con 0x7f6c60074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.623+0000 7f6c66322640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c600c92f0 0x7f6c601f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 10 monclient(hunting): picked mon.noname-b con 0x7f6c600c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 0x7f6c601f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 10 monclient(hunting): picked mon.noname-a con 0x7f6c6015d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60074d70 con 0x7f6c6015d220 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c600c86c0 con 0x7f6c600c92f0 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60153b90 con 0x7f6c60074920 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c66322640 10 monclient(hunting): authenticate will time out at 1330.346018s 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 0x7f6c601f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5ffff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c60074920 0x7f6c60145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 0x7f6c601f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:39004/0 (socket says 10.20.193.10:39004) 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 1 -- 10.20.193.10:0/126522248 learned_addr learned my addr 10.20.193.10:0/126522248 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 10 monclient(hunting): get_auth_request con 0x7f6c6015d220 auth_method 0 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5ffff640 10 monclient(hunting): get_auth_request con 0x7f6c60074920 auth_method 0 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5f7fe640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c600c92f0 0x7f6c601f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c64898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6c600c92f0 auth_method 0 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:00.637 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.624+0000 7f6c5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 10 monclient(hunting): handle_auth_done global_id 5061 payload 824 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 1 -- 10.20.193.10:0/126522248 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c60074920 msgr2=0x7f6c60145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c60074920 0x7f6c60145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 1 -- 10.20.193.10:0/126522248 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c600c92f0 msgr2=0x7f6c601f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c600c92f0 0x7f6c601f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 10 monclient: _finish_hunting 0 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 1 monclient: found mon.noname-a 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.625+0000 7f6c64898640 1 -- 10.20.193.10:0/126522248 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c601f4c30 con 0x7f6c6015d220 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.626+0000 7f6c64898640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 0x7f6c601f61d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009dd0 tx=0x7f6c5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.626+0000 7f6c5cff9640 10 client.?.objecter ms_handle_connect 0x7f6c6015d220 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.626+0000 7f6c5cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 1 -- 10.20.193.10:0/126522248 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54018020 con 0x7f6c6015d220 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 10 monclient: dump: 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 10 monclient: _finish_auth 0 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 10 monclient: _check_auth_tickets 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 1 -- 10.20.193.10:0/126522248 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c54014480 con 0x7f6c6015d220 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 5 monclient: authenticate success, global_id 5061 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 10 monclient: _renew_subs 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c601f4ed0 con 0x7f6c6015d220 2026-02-17T12:01:00.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 1 -- 10.20.193.10:0/126522248 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54014870 con 0x7f6c6015d220 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5e7fc640 4 set_mon_vals no callback set 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c5cff9640 10 monclient: dump: 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 10 client.5061.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 10 monclient: _renew_subs 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c601f5490 con 0x7f6c6015d220 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 1 librados: init done 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:00.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.628+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c60153f70 con 0x7f6c6015d220 2026-02-17T12:01:00.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.640+0000 7f6c5cff9640 1 -- 10.20.193.10:0/126522248 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6c54014a10 con 0x7f6c6015d220 2026-02-17T12:01:00.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.640+0000 7f6c5cff9640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6c30078e50 0x7f6c3007b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:00.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.640+0000 7f6c5ffff640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6c30078e50 0x7f6c3007b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:00.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.640+0000 7f6c5ffff640 10 monclient: get_auth_request con 0x7f6c30078e50 auth_method 0 2026-02-17T12:01:00.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.641+0000 7f6c5cff9640 10 client.5061.objecter ms_handle_connect 0x7f6c30078e50 2026-02-17T12:01:00.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.641+0000 7f6c5ffff640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6c30078e50 0x7f6c3007b310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c600c6b30 tx=0x7f6c4c033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:00.644 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.641+0000 7f6c5cff9640 1 -- 10.20.193.10:0/126522248 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f6c5405ef40 con 0x7f6c6015d220 2026-02-17T12:01:00.644 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.641+0000 7f6c5cff9640 10 client.5061.objecter ms_dispatch2 0x7f6c60000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:00.644 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.641+0000 7f6c5cff9640 3 client.5061.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:00.644 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.641+0000 7f6c5cff9640 3 client.5061.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:00.644 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.641+0000 7f6c5cff9640 20 client.5061.objecter dump_active .. 0 homeless 2026-02-17T12:01:00.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.740+0000 7f6c5cff9640 1 -- 10.20.193.10:0/126522248 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6c54022070 con 0x7f6c6015d220 2026-02-17T12:01:00.742 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.740+0000 7f6c5cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:00.743 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.740+0000 7f6c5cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:00.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.842+0000 7f6c66322640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:01:00.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.842+0000 7f6c66322640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:01:00.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.842+0000 7f6c66322640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:00.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.842+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6c600c9b60 con 0x7f6c6015d220 2026-02-17T12:01:00.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.845+0000 7f6c5cff9640 1 -- 10.20.193.10:0/126522248 <== mon.0 v2:10.20.193.10:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7f6c54010040 con 0x7f6c6015d220 2026-02-17T12:01:00.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.845+0000 7f6c5cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:01:00.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.845+0000 7f6c5cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:00.848 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:01:00.848 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:01:00.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 10 librados: watch_flush enter 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 10 librados: watch_flush exit 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 20 client.5061.objecter shutdown clearing up homeless session... 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 10 client.5061.objecter successfully canceled tick 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6c30078e50 msgr2=0x7f6c3007b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6c30078e50 0x7f6c3007b310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c600c6b30 tx=0x7f6c4c033000 comp rx=0 tx=0).stop 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 10 monclient: shutdown 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 msgr2=0x7f6c601f61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 0x7f6c601f61d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009dd0 tx=0x7f6c5400c490 comp rx=0 tx=0).stop 2026-02-17T12:01:00.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 shutdown_connections 2026-02-17T12:01:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6c30078e50 0x7f6c3007b310 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c6015d220 0x7f6c601f61d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c600c92f0 0x7f6c601f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 --2- 10.20.193.10:0/126522248 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c60074920 0x7f6c60145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 >> 10.20.193.10:0/126522248 conn(0x7f6c600c9d80 msgr2=0x7f6c60153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 shutdown_connections 2026-02-17T12:01:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 -- 10.20.193.10:0/126522248 wait complete. 2026-02-17T12:01:00.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:00.846+0000 7f6c66322640 1 librados: shutdown 2026-02-17T12:01:03.858 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:01:03.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.924+0000 7fedfa711640 10 monclient: get_monmap_and_config 2026-02-17T12:01:03.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.924+0000 7fedfa711640 10 monclient: build_initial_monmap 2026-02-17T12:01:03.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.924+0000 7fedfa711640 10 monclient: monmap: 2026-02-17T12:01:03.927 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:03.928 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:03.928 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:03.926030+0000 2026-02-17T12:01:03.928 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:03.926030+0000 2026-02-17T12:01:03.928 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:03.928 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:03.928 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:03.928 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:03.929 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:03.929 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:03.929 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:03.929 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:03.929 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:03.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 1 Processor -- start 2026-02-17T12:01:03.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 1 -- start start 2026-02-17T12:01:03.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient: init 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient: _add_conns ranks=[0,4,3,2,1,5] 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fedf415d220 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fedf40c92f0 0x7fedf415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient(hunting): picked mon.noname-b con 0x7fedf40c92f0 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fedf4074920 0x7fedf4153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient(hunting): picked mon.noname-a con 0x7fedf4074920 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf40c58a0 con 0x7fedf415d220 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fedf40c55c0 con 0x7fedf4074920 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fedf40c7e20 con 0x7fedf40c92f0 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.925+0000 7fedfa711640 10 monclient(hunting): authenticate will time out at 1333.647832s 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fedf4074920 0x7fedf4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf37fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fedf40c92f0 0x7fedf415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fedf4074920 0x7fedf4153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44642/0 (socket says 10.20.193.10:44642) 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 1 -- 10.20.193.10:0/3029749654 learned_addr learned my addr 10.20.193.10:0/3029749654 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 10 monclient(hunting): get_auth_request con 0x7fedf4074920 auth_method 0 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf37fe640 10 monclient(hunting): get_auth_request con 0x7fedf40c92f0 auth_method 0 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:03.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.926+0000 7fedf8c87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf8c87640 10 monclient(hunting): handle_auth_done global_id 5064 payload 274 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf8c87640 1 -- 10.20.193.10:0/3029749654 >> v2:10.20.193.71:3300/0 conn(0x7fedf40c92f0 msgr2=0x7fedf415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf8c87640 1 --2- 10.20.193.10:0/3029749654 >> v2:10.20.193.71:3300/0 conn(0x7fedf40c92f0 0x7fedf415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf8c87640 1 -- 10.20.193.10:0/3029749654 >> v1:10.20.193.10:6789/0 conn(0x7fedf415d220 legacy=0x7fedf40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf8c87640 10 monclient: _finish_hunting 0 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf8c87640 1 monclient: found mon.noname-a 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf8c87640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf8c87640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.927+0000 7fedf8c87640 1 -- 10.20.193.10:0/3029749654 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf40c8100 con 0x7fedf4074920 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.928+0000 7fedf8c87640 1 --2- 10.20.193.10:0/3029749654 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf4074920 0x7fedf4153650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fede8009e50 tx=0x7fede802f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b33544600f781f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.930+0000 7fedf2ffd640 1 -- 10.20.193.10:0/3029749654 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede802fcc0 con 0x7fedf4074920 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.930+0000 7fedf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 10 monclient: dump: 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 1 -- 10.20.193.10:0/3029749654 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede80373f0 con 0x7fedf4074920 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 5 monclient: authenticate success, global_id 5064 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 1 -- 10.20.193.10:0/3029749654 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede802fe60 con 0x7fedf4074920 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedf2ffd640 10 monclient: dump: 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:03.942 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 4 set_mon_vals no callback set 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 10 monclient: shutdown 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 1 -- 10.20.193.10:0/3029749654 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf4074920 msgr2=0x7fedf4153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 1 --2- 10.20.193.10:0/3029749654 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf4074920 0x7fedf4153650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fede8009e50 tx=0x7fede802f2a0 comp rx=0 tx=0).stop 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 1 -- 10.20.193.10:0/3029749654 shutdown_connections 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 1 --2- 10.20.193.10:0/3029749654 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf4074920 0x7fedf4153650 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 1 --2- 10.20.193.10:0/3029749654 >> v2:10.20.193.71:3300/0 conn(0x7fedf40c92f0 0x7fedf415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 1 -- 10.20.193.10:0/3029749654 >> 10.20.193.10:0/3029749654 conn(0x7fedf40c9d80 msgr2=0x7fedf40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 1 -- 10.20.193.10:0/3029749654 shutdown_connections 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 1 -- 10.20.193.10:0/3029749654 wait complete. 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 10 monclient: build_initial_monmap 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.931+0000 7fedfa711640 10 monclient: monmap: 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 librados: starting msgr at 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 librados: starting objecter 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 Processor -- start 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 -- start start 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 librados: setting wanted keys 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 librados: calling monclient init 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient: init 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fedf4074920 0x7fedf406e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient(hunting): picked mon.noname-b con 0x7fedf4074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fedf40c92f0 0x7fedf406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:03.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient(hunting): picked mon.noname-c con 0x7fedf40c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf415d220 0x7fedf41f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient(hunting): picked mon.noname-a con 0x7fedf415d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fedf4074d70 con 0x7fedf415d220 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fedf40c86c0 con 0x7fedf4074920 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fedf4153b90 con 0x7fedf40c92f0 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedfa711640 10 monclient(hunting): authenticate will time out at 1333.654602s 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedf8c87640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf415d220 0x7fedf41f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.932+0000 7fedf3fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fedf4074920 0x7fedf406e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf8c87640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf415d220 0x7fedf41f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44646/0 (socket says 10.20.193.10:44646) 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf8c87640 1 -- 10.20.193.10:0/411722411 learned_addr learned my addr 10.20.193.10:0/411722411 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf8c87640 10 monclient(hunting): get_auth_request con 0x7fedf415d220 auth_method 0 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf8c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf8c87640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf8c87640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf3fff640 10 monclient(hunting): get_auth_request con 0x7fedf4074920 auth_method 0 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf37fe640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fedf40c92f0 0x7fedf406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf8c87640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf8c87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf8c87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf37fe640 10 monclient(hunting): get_auth_request con 0x7fedf40c92f0 auth_method 0 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.933+0000 7fedf37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 10 monclient(hunting): handle_auth_done global_id 5095 payload 824 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 1 -- 10.20.193.10:0/411722411 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fedf40c92f0 msgr2=0x7fedf406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fedf40c92f0 0x7fedf406eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 1 -- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf415d220 msgr2=0x7fedf41f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf415d220 0x7fedf41f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 1 monclient: found mon.noname-b 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:03.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf3fff640 1 -- 10.20.193.10:0/411722411 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf4073e50 con 0x7fedf4074920 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.934+0000 7fedf8c87640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf415d220 0x7fedf41f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.935+0000 7fedf3fff640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fedf4074920 0x7fedf406e990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fede000b410 tx=0x7fede000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.935+0000 7fedf0ff9640 10 client.?.objecter ms_handle_connect 0x7fedf4074920 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.935+0000 7fedf0ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 1 -- 10.20.193.10:0/411722411 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0016070 con 0x7fedf4074920 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 10 monclient: dump: 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 10 monclient: _finish_auth 0 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 5 monclient: authenticate success, global_id 5095 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 10 monclient: _renew_subs 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf406d8f0 con 0x7fedf4074920 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 10 client.5095.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 10 monclient: _renew_subs 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf406deb0 con 0x7fedf4074920 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 1 librados: init done 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 1 -- 10.20.193.10:0/411722411 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede0004480 con 0x7fedf4074920 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 1 -- 10.20.193.10:0/411722411 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0020060 con 0x7fedf4074920 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf0ff9640 10 monclient: dump: 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:03.945 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:03.946 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:03.946 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:03.946 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:03.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedf27fc640 4 set_mon_vals no callback set 2026-02-17T12:01:03.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:03.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:03.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:03.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.937+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf4069900 con 0x7fedf4074920 2026-02-17T12:01:03.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.949+0000 7fedf0ff9640 1 -- 10.20.193.10:0/411722411 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fede0023080 con 0x7fedf4074920 2026-02-17T12:01:03.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.949+0000 7fedf0ff9640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fedc4078e00 0x7fedc407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:03.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.949+0000 7fedf37fe640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fedc4078e00 0x7fedc407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:03.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.949+0000 7fedf37fe640 10 monclient: get_auth_request con 0x7fedc4078e00 auth_method 0 2026-02-17T12:01:03.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.950+0000 7fedf0ff9640 10 client.5095.objecter ms_handle_connect 0x7fedc4078e00 2026-02-17T12:01:03.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.950+0000 7fedf37fe640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fedc4078e00 0x7fedc407b2c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fedf41f4770 tx=0x7fede4009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:03.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.950+0000 7fedf0ff9640 1 -- 10.20.193.10:0/411722411 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fede0096ca0 con 0x7fedf4074920 2026-02-17T12:01:03.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.950+0000 7fedf0ff9640 10 client.5095.objecter ms_dispatch2 0x7fedf4000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:03.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.950+0000 7fedf0ff9640 3 client.5095.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:03.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.950+0000 7fedf0ff9640 3 client.5095.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:03.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:03.950+0000 7fedf0ff9640 20 client.5095.objecter dump_active .. 0 homeless 2026-02-17T12:01:04.050 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.048+0000 7fedf0ff9640 1 -- 10.20.193.10:0/411722411 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fedf4069900 con 0x7fedf4074920 2026-02-17T12:01:04.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.048+0000 7fedf0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.051 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.048+0000 7fedf0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:04.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.147+0000 7fedfa711640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:01:04.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.147+0000 7fedfa711640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:01:04.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.147+0000 7fedfa711640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:04.149 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.147+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fedf4153f20 con 0x7fedf4074920 2026-02-17T12:01:04.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.150+0000 7fedf0ff9640 1 -- 10.20.193.10:0/411722411 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+199 (secure 0 0 0) 0x7fede0061470 con 0x7fedf4074920 2026-02-17T12:01:04.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.150+0000 7fedf0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:01:04.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.150+0000 7fedf0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:04.152 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:01:04.153 INFO:teuthology.orchestra.run.trial010.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"9 OSD(s) experiencing slow operations in BlueStore","count":9},"muted":false}},"mutes":[]} 2026-02-17T12:01:04.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 10 librados: watch_flush enter 2026-02-17T12:01:04.154 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 10 librados: watch_flush exit 2026-02-17T12:01:04.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 20 client.5095.objecter shutdown clearing up homeless session... 2026-02-17T12:01:04.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 10 client.5095.objecter successfully canceled tick 2026-02-17T12:01:04.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fedc4078e00 msgr2=0x7fedc407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fedc4078e00 0x7fedc407b2c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fedf41f4770 tx=0x7fede4009290 comp rx=0 tx=0).stop 2026-02-17T12:01:04.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 10 monclient: shutdown 2026-02-17T12:01:04.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:04.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fedf4074920 msgr2=0x7fedf406e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fedf4074920 0x7fedf406e990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fede000b410 tx=0x7fede000b8e0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.155 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 shutdown_connections 2026-02-17T12:01:04.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fedc4078e00 0x7fedc407b2c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fedf415d220 0x7fedf41f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fedf40c92f0 0x7fedf406eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 --2- 10.20.193.10:0/411722411 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fedf4074920 0x7fedf406e990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 >> 10.20.193.10:0/411722411 conn(0x7fedf40c9d80 msgr2=0x7fedf4153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:04.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 shutdown_connections 2026-02-17T12:01:04.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 -- 10.20.193.10:0/411722411 wait complete. 2026-02-17T12:01:04.156 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.151+0000 7fedfa711640 1 librados: shutdown 2026-02-17T12:01:04.162 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T12:01:04.162 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:01:04.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.228+0000 7fabc9e4d640 10 monclient: get_monmap_and_config 2026-02-17T12:01:04.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.228+0000 7fabc9e4d640 10 monclient: build_initial_monmap 2026-02-17T12:01:04.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.228+0000 7fabc9e4d640 10 monclient: monmap: 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:04.230128+0000 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:04.230128+0000 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:04.232 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:04.233 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:04.233 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 1 Processor -- start 2026-02-17T12:01:04.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 1 -- start start 2026-02-17T12:01:04.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient: init 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient: _add_conns ranks=[0,3,5,4,1,2] 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fabc415d220 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fabc40c92f0 0x7fabc415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient(hunting): picked mon.noname-a con 0x7fabc40c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fabc4074920 0x7fabc4153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient(hunting): picked mon.noname-c con 0x7fabc4074920 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabc40c58a0 con 0x7fabc415d220 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fabc40c55c0 con 0x7fabc40c92f0 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fabc40c7e20 con 0x7fabc4074920 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.229+0000 7fabc9e4d640 10 monclient(hunting): authenticate will time out at 1333.951909s 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fabc40c92f0 0x7fabc415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc3fff640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fabc4074920 0x7fabc4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fabc40c92f0 0x7fabc415d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44662/0 (socket says 10.20.193.10:44662) 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 1 -- 10.20.193.10:0/4212622543 learned_addr learned my addr 10.20.193.10:0/4212622543 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 10 monclient(hunting): get_auth_request con 0x7fabc40c92f0 auth_method 0 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc3fff640 10 monclient(hunting): get_auth_request con 0x7fabc4074920 auth_method 0 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.230+0000 7fabc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.231+0000 7fabc2ffd640 10 monclient(hunting): handle_auth_done global_id 5070 payload 274 2026-02-17T12:01:04.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.231+0000 7fabc2ffd640 1 -- 10.20.193.10:0/4212622543 >> v2:10.20.193.153:3300/0 conn(0x7fabc4074920 msgr2=0x7fabc4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:04.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.231+0000 7fabc2ffd640 1 --2- 10.20.193.10:0/4212622543 >> v2:10.20.193.153:3300/0 conn(0x7fabc4074920 0x7fabc4153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.231+0000 7fabc2ffd640 1 -- 10.20.193.10:0/4212622543 >> v1:10.20.193.10:6789/0 conn(0x7fabc415d220 legacy=0x7fabc40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:04.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.231+0000 7fabc2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:04.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.231+0000 7fabc2ffd640 1 monclient: found mon.noname-a 2026-02-17T12:01:04.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.231+0000 7fabc2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:04.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.231+0000 7fabc2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.231+0000 7fabc2ffd640 1 -- 10.20.193.10:0/4212622543 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc40c8100 con 0x7fabc40c92f0 2026-02-17T12:01:04.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.232+0000 7fabc2ffd640 1 --2- 10.20.193.10:0/4212622543 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc40c92f0 0x7fabc415d600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009970 tx=0x7fabb402eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a573076cb00f61c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:04.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 1 -- 10.20.193.10:0/4212622543 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb403c070 con 0x7fabc40c92f0 2026-02-17T12:01:04.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:04.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 10 monclient: dump: 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:04.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 1 -- 10.20.193.10:0/4212622543 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb402fb20 con 0x7fabc40c92f0 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 5 monclient: authenticate success, global_id 5070 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 1 -- 10.20.193.10:0/4212622543 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4037440 con 0x7fabc40c92f0 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 4 set_mon_vals no callback set 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc27fc640 10 monclient: dump: 2026-02-17T12:01:04.248 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 10 monclient: shutdown 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:04.249 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 1 -- 10.20.193.10:0/4212622543 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc40c92f0 msgr2=0x7fabc415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 1 --2- 10.20.193.10:0/4212622543 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc40c92f0 0x7fabc415d600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009970 tx=0x7fabb402eef0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 1 -- 10.20.193.10:0/4212622543 shutdown_connections 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 1 --2- 10.20.193.10:0/4212622543 >> v2:10.20.193.153:3300/0 conn(0x7fabc4074920 0x7fabc4153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 1 --2- 10.20.193.10:0/4212622543 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc40c92f0 0x7fabc415d600 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 1 -- 10.20.193.10:0/4212622543 >> 10.20.193.10:0/4212622543 conn(0x7fabc40c9d80 msgr2=0x7fabc40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 1 -- 10.20.193.10:0/4212622543 shutdown_connections 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 1 -- 10.20.193.10:0/4212622543 wait complete. 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 10 monclient: build_initial_monmap 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.235+0000 7fabc9e4d640 10 monclient: monmap: 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:04.250 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 librados: starting msgr at 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 librados: starting objecter 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 Processor -- start 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 -- start start 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 librados: setting wanted keys 2026-02-17T12:01:04.251 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 librados: calling monclient init 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient: init 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4074920 0x7fabc4145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient(hunting): picked mon.noname-c con 0x7fabc4074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabc40c92f0 0x7fabc4145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient(hunting): picked mon.noname-b con 0x7fabc40c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc415d220 0x7fabc4072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient(hunting): picked mon.noname-a con 0x7fabc415d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4074d70 con 0x7fabc415d220 2026-02-17T12:01:04.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fabc40c86c0 con 0x7fabc40c92f0 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4153b90 con 0x7fabc4074920 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.236+0000 7fabc9e4d640 10 monclient(hunting): authenticate will time out at 1333.958789s 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc415d220 0x7fabc4072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc37fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4074920 0x7fabc4145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc415d220 0x7fabc4072c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44670/0 (socket says 10.20.193.10:44670) 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 1 -- 10.20.193.10:0/1289215963 learned_addr learned my addr 10.20.193.10:0/1289215963 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 10 monclient(hunting): get_auth_request con 0x7fabc415d220 auth_method 0 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc2ffd640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabc40c92f0 0x7fabc4145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc2ffd640 10 monclient(hunting): get_auth_request con 0x7fabc40c92f0 auth_method 0 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc37fe640 10 monclient(hunting): get_auth_request con 0x7fabc4074920 auth_method 0 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.237+0000 7fabc2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 10 monclient(hunting): handle_auth_done global_id 5073 payload 824 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 1 -- 10.20.193.10:0/1289215963 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4074920 msgr2=0x7fabc4145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4074920 0x7fabc4145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 1 -- 10.20.193.10:0/1289215963 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabc40c92f0 msgr2=0x7fabc4145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabc40c92f0 0x7fabc4145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 1 monclient: found mon.noname-a 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.238+0000 7fabc3fff640 1 -- 10.20.193.10:0/1289215963 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc4072730 con 0x7fabc415d220 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.239+0000 7fabc3fff640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc415d220 0x7fabc4072c30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fabb800efc0 tx=0x7fabb800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.239+0000 7fab9ffff640 10 client.?.objecter ms_handle_connect 0x7fabc415d220 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.239+0000 7fab9ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 1 -- 10.20.193.10:0/1289215963 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8018020 con 0x7fabc415d220 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 10 monclient: dump: 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.256 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:04.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 1 -- 10.20.193.10:0/1289215963 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb8014480 con 0x7fabc415d220 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 1 -- 10.20.193.10:0/1289215963 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8014870 con 0x7fabc415d220 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fab9ffff640 10 monclient: dump: 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.258 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc1ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 5 monclient: authenticate success, global_id 5073 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 10 monclient: _renew_subs 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc415ae50 con 0x7fabc415d220 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 10 client.5073.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 10 monclient: _renew_subs 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc415b410 con 0x7fabc415d220 2026-02-17T12:01:04.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 1 librados: init done 2026-02-17T12:01:04.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.241+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc4072900 con 0x7fabc415d220 2026-02-17T12:01:04.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.254+0000 7fab9ffff640 1 -- 10.20.193.10:0/1289215963 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fabb8014a10 con 0x7fabc415d220 2026-02-17T12:01:04.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.255+0000 7fab9ffff640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab94078e50 0x7fab9407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.255+0000 7fabc37fe640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab94078e50 0x7fab9407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.255+0000 7fabc37fe640 10 monclient: get_auth_request con 0x7fab94078e50 auth_method 0 2026-02-17T12:01:04.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.255+0000 7fabc37fe640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab94078e50 0x7fab9407b310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fabb0004660 tx=0x7fabb0009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:04.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.255+0000 7fab9ffff640 10 client.5073.objecter ms_handle_connect 0x7fab94078e50 2026-02-17T12:01:04.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.256+0000 7fab9ffff640 1 -- 10.20.193.10:0/1289215963 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fabb805ee50 con 0x7fabc415d220 2026-02-17T12:01:04.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.256+0000 7fab9ffff640 10 client.5073.objecter ms_dispatch2 0x7fabc4000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:04.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.256+0000 7fab9ffff640 3 client.5073.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:04.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.256+0000 7fab9ffff640 3 client.5073.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:04.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.257+0000 7fab9ffff640 20 client.5073.objecter dump_active .. 0 homeless 2026-02-17T12:01:04.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.356+0000 7fab9ffff640 1 -- 10.20.193.10:0/1289215963 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fabb8022070 con 0x7fabc415d220 2026-02-17T12:01:04.358 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.356+0000 7fab9ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.359 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.356+0000 7fab9ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:04.442 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.440+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabc4153f70 con 0x7fab94078e50 2026-02-17T12:01:04.443 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.441+0000 7fab9ffff640 1 -- 10.20.193.10:0/1289215963 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44249 (secure 0 0 0) 0x7fabc4153f70 con 0x7fab94078e50 2026-02-17T12:01:04.444 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:01:04.445 INFO:teuthology.orchestra.run.trial010.stderr:dumped all 2026-02-17T12:01:04.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 10 librados: watch_flush enter 2026-02-17T12:01:04.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 10 librados: watch_flush exit 2026-02-17T12:01:04.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 20 client.5073.objecter shutdown clearing up homeless session... 2026-02-17T12:01:04.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 10 client.5073.objecter successfully canceled tick 2026-02-17T12:01:04.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab94078e50 msgr2=0x7fab9407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab94078e50 0x7fab9407b310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fabb0004660 tx=0x7fabb0009110 comp rx=0 tx=0).stop 2026-02-17T12:01:04.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 10 monclient: shutdown 2026-02-17T12:01:04.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:04.446 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc415d220 msgr2=0x7fabc4072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc415d220 0x7fabc4072c30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fabb800efc0 tx=0x7fabb800c490 comp rx=0 tx=0).stop 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 shutdown_connections 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fab94078e50 0x7fab9407b310 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabc415d220 0x7fabc4072c30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabc40c92f0 0x7fabc4145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 --2- 10.20.193.10:0/1289215963 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4074920 0x7fabc4145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 >> 10.20.193.10:0/1289215963 conn(0x7fabc40c9d80 msgr2=0x7fabc4153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 shutdown_connections 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 -- 10.20.193.10:0/1289215963 wait complete. 2026-02-17T12:01:04.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.443+0000 7fabc9e4d640 1 librados: shutdown 2026-02-17T12:01:04.453 INFO:teuthology.orchestra.run.trial010.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2026-02-17T12:01:03.810097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438232,"kb_used_data":6808,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511208,"statfs":{"total":1546188226560,"available":1545739476992,"internally_reserved":0,"allocated":6971392,"data_stored":3471254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25500,"internal_metadata":441424996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001575"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:07.916577+0000","last_change":"2026-02-17T11:55:57.532493+0000","last_active":"2026-02-17T11:58:07.916577+0000","last_peered":"2026-02-17T11:58:07.916577+0000","last_clean":"2026-02-17T11:58:07.916577+0000","last_became_active":"2026-02-17T11:55:55.658594+0000","last_became_peered":"2026-02-17T11:55:55.658594+0000","last_unstale":"2026-02-17T11:58:07.916577+0000","last_undegraded":"2026-02-17T11:58:07.916577+0000","last_fullsized":"2026-02-17T11:58:07.916577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:26:38.378508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042345316000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:06.393337+0000","last_change":"2026-02-17T11:55:57.587525+0000","last_active":"2026-02-17T11:58:06.393337+0000","last_peered":"2026-02-17T11:58:06.393337+0000","last_clean":"2026-02-17T11:58:06.393337+0000","last_became_active":"2026-02-17T11:55:55.781344+0000","last_became_peered":"2026-02-17T11:55:55.781344+0000","last_unstale":"2026-02-17T11:58:06.393337+0000","last_undegraded":"2026-02-17T11:58:06.393337+0000","last_fullsized":"2026-02-17T11:58:06.393337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:52.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037397883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:02.969298+0000","last_change":"2026-02-17T11:55:57.503086+0000","last_active":"2026-02-17T11:58:02.969298+0000","last_peered":"2026-02-17T11:58:02.969298+0000","last_clean":"2026-02-17T11:58:02.969298+0000","last_became_active":"2026-02-17T11:55:55.451241+0000","last_became_peered":"2026-02-17T11:55:55.451241+0000","last_unstale":"2026-02-17T11:58:02.969298+0000","last_undegraded":"2026-02-17T11:58:02.969298+0000","last_fullsized":"2026-02-17T11:58:02.969298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:35:03.971846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037882574000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:03.012781+0000","last_change":"2026-02-17T11:55:57.580958+0000","last_active":"2026-02-17T11:58:03.012781+0000","last_peered":"2026-02-17T11:58:03.012781+0000","last_clean":"2026-02-17T11:58:03.012781+0000","last_became_active":"2026-02-17T11:55:55.648482+0000","last_became_peered":"2026-02-17T11:55:55.648482+0000","last_unstale":"2026-02-17T11:58:03.012781+0000","last_undegraded":"2026-02-17T11:58:03.012781+0000","last_fullsized":"2026-02-17T11:58:03.012781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:44:03.363850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037738756999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:02.524969+0000","last_change":"2026-02-17T11:55:57.569398+0000","last_active":"2026-02-17T11:58:02.524969+0000","last_peered":"2026-02-17T11:58:02.524969+0000","last_clean":"2026-02-17T11:58:02.524969+0000","last_became_active":"2026-02-17T11:55:55.640831+0000","last_became_peered":"2026-02-17T11:55:55.640831+0000","last_unstale":"2026-02-17T11:58:02.524969+0000","last_undegraded":"2026-02-17T11:58:02.524969+0000","last_fullsized":"2026-02-17T11:58:02.524969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:53:48.237641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056907020000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,12],"acting":[2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:00.462505+0000","last_change":"2026-02-17T11:55:57.578304+0000","last_active":"2026-02-17T11:58:00.462505+0000","last_peered":"2026-02-17T11:58:00.462505+0000","last_clean":"2026-02-17T11:58:00.462505+0000","last_became_active":"2026-02-17T11:55:55.453952+0000","last_became_peered":"2026-02-17T11:55:55.453952+0000","last_unstale":"2026-02-17T11:58:00.462505+0000","last_undegraded":"2026-02-17T11:58:00.462505+0000","last_fullsized":"2026-02-17T11:58:00.462505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:34:50.379105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034638460000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:57:57.522955+0000","last_change":"2026-02-17T11:55:57.561696+0000","last_active":"2026-02-17T11:57:57.522955+0000","last_peered":"2026-02-17T11:57:57.522955+0000","last_clean":"2026-02-17T11:57:57.522955+0000","last_became_active":"2026-02-17T11:55:55.508618+0000","last_became_peered":"2026-02-17T11:55:55.508618+0000","last_unstale":"2026-02-17T11:57:57.522955+0000","last_undegraded":"2026-02-17T11:57:57.522955+0000","last_fullsized":"2026-02-17T11:57:57.522955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:29:21.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055960348,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"32'1","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:03.767027+0000","last_change":"2026-02-17T11:55:57.580322+0000","last_active":"2026-02-17T11:58:03.767027+0000","last_peered":"2026-02-17T11:58:03.767027+0000","last_clean":"2026-02-17T11:58:03.767027+0000","last_became_active":"2026-02-17T11:55:55.408633+0000","last_became_peered":"2026-02-17T11:55:55.408633+0000","last_unstale":"2026-02-17T11:58:03.767027+0000","last_undegraded":"2026-02-17T11:58:03.767027+0000","last_fullsized":"2026-02-17T11:58:03.767027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:37:04.068558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027166316999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"29'32","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:57:43.759185+0000","last_change":"2026-02-17T11:55:50.153568+0000","last_active":"2026-02-17T11:57:43.759185+0000","last_peered":"2026-02-17T11:57:43.759185+0000","last_clean":"2026-02-17T11:57:43.759185+0000","last_became_active":"2026-02-17T11:55:49.807188+0000","last_became_peered":"2026-02-17T11:55:49.807188+0000","last_unstale":"2026-02-17T11:57:43.759185+0000","last_undegraded":"2026-02-17T11:57:43.759185+0000","last_fullsized":"2026-02-17T11:57:43.759185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_clean_scrub_stamp":"2026-02-17T11:55:42.183447+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:38:58.356098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[2,4,5,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":28,"seq":120259084352,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,5,6,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":28,"seq":120259084354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313284,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":22,"seq":94489280580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,6,7,8,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":25,"seq":107374182466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,4,5,6,7,8,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":24,"seq":103079215171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":24,"seq":103079215170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[2,4,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":27,"seq":115964117060,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,5,6,7,8,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,3,5,6,7,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":27,"seq":115964117061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":27,"seq":115964117063,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":27,"seq":115964117060,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,2,4,6,7,8,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":27,"seq":115964117062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,2,3,4,5,7,9,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:01:04.455 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.521+0000 7fba083f5640 10 monclient: get_monmap_and_config 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.521+0000 7fba083f5640 10 monclient: build_initial_monmap 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.521+0000 7fba083f5640 10 monclient: monmap: 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:04.522663+0000 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:04.522663+0000 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:04.523 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.521+0000 7fba083f5640 1 Processor -- start 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.521+0000 7fba083f5640 1 -- start start 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.521+0000 7fba083f5640 10 monclient: init 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 10 monclient: _add_conns ranks=[0,5,4,1,2,3] 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fba0015d220 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fba000c92f0 0x7fba0015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 10 monclient(hunting): picked mon.noname-c con 0x7fba000c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fba00074920 0x7fba00153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 10 monclient(hunting): picked mon.noname-b con 0x7fba00074920 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba000c58a0 con 0x7fba0015d220 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fba000c55c0 con 0x7fba00074920 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fba000c7e20 con 0x7fba000c92f0 2026-02-17T12:01:04.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba083f5640 10 monclient(hunting): authenticate will time out at 1334.244463s 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba0616a640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fba0015d220 0x7fba000c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44756/0 (socket says 10.20.193.10:44756) 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba0616a640 1 -- 10.20.193.10:0/317188020 learned_addr learned my addr 10.20.193.10:0/317188020 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba0696b640 1 --2- 10.20.193.10:0/317188020 >> v2:10.20.193.71:3300/0 conn(0x7fba00074920 0x7fba00153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.522+0000 7fba05969640 1 --2- 10.20.193.10:0/317188020 >> v2:10.20.193.153:3300/0 conn(0x7fba000c92f0 0x7fba0015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba0696b640 10 monclient(hunting): get_auth_request con 0x7fba00074920 auth_method 0 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba0696b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba0696b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba0696b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba05969640 10 monclient(hunting): get_auth_request con 0x7fba000c92f0 auth_method 0 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba05969640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba05969640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba05969640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba0696b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba0696b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba0696b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba05969640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba05969640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.523+0000 7fba05969640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.524+0000 7fba0696b640 10 monclient(hunting): handle_auth_done global_id 5101 payload 274 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.524+0000 7fba0696b640 1 -- 10.20.193.10:0/317188020 >> v2:10.20.193.153:3300/0 conn(0x7fba000c92f0 msgr2=0x7fba0015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.524+0000 7fba0696b640 1 --2- 10.20.193.10:0/317188020 >> v2:10.20.193.153:3300/0 conn(0x7fba000c92f0 0x7fba0015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.524+0000 7fba0696b640 1 -- 10.20.193.10:0/317188020 >> v1:10.20.193.10:6789/0 conn(0x7fba0015d220 legacy=0x7fba000c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.524+0000 7fba0696b640 10 monclient: _finish_hunting 0 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.524+0000 7fba0696b640 1 monclient: found mon.noname-b 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.524+0000 7fba0696b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.524+0000 7fba0696b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.524+0000 7fba0696b640 1 -- 10.20.193.10:0/317188020 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba000c8100 con 0x7fba00074920 2026-02-17T12:01:04.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.525+0000 7fba0696b640 1 --2- 10.20.193.10:0/317188020 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba00074920 0x7fba00153650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009d90 tx=0x7fb9fc02f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b00c6d11bf6a3d54 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 1 -- 10.20.193.10:0/317188020 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc03c070 con 0x7fba00074920 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 10 monclient: dump: 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 10 monclient: _finish_auth 0 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 10 monclient: _check_auth_tickets 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba083f5640 5 monclient: authenticate success, global_id 5101 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 1 -- 10.20.193.10:0/317188020 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc037440 con 0x7fba00074920 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba083f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:04.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 1 -- 10.20.193.10:0/317188020 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc037810 con 0x7fba00074920 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba083f5640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba083f5640 4 set_mon_vals no callback set 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.526+0000 7fba05168640 10 monclient: dump: 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 10 monclient: shutdown 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 -- 10.20.193.10:0/317188020 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba00074920 msgr2=0x7fba00153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 --2- 10.20.193.10:0/317188020 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba00074920 0x7fba00153650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009d90 tx=0x7fb9fc02f1e0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 -- 10.20.193.10:0/317188020 shutdown_connections 2026-02-17T12:01:04.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 --2- 10.20.193.10:0/317188020 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba00074920 0x7fba00153650 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 --2- 10.20.193.10:0/317188020 >> v2:10.20.193.153:3300/0 conn(0x7fba000c92f0 0x7fba0015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 -- 10.20.193.10:0/317188020 >> 10.20.193.10:0/317188020 conn(0x7fba000c9d80 msgr2=0x7fba000ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:04.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 -- 10.20.193.10:0/317188020 shutdown_connections 2026-02-17T12:01:04.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 -- 10.20.193.10:0/317188020 wait complete. 2026-02-17T12:01:04.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 10 monclient: build_initial_monmap 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 10 monclient: monmap: 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 librados: starting msgr at 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 librados: starting objecter 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 Processor -- start 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 -- start start 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 librados: setting wanted keys 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 1 librados: calling monclient init 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.527+0000 7fba083f5640 10 monclient: init 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fba00074920 0x7fba001e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient(hunting): picked mon.noname-a con 0x7fba00074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fba000c92f0 0x7fba001e64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient(hunting): picked mon.noname-c con 0x7fba000c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba0015d220 0x7fba0015c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient(hunting): picked mon.noname-b con 0x7fba0015d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fba00074d70 con 0x7fba00074920 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba000c86c0 con 0x7fba0015d220 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fba00153b90 con 0x7fba000c92f0 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba083f5640 10 monclient(hunting): authenticate will time out at 1334.250397s 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0696b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba0015d220 0x7fba0015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0616a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fba00074920 0x7fba001e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba05969640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fba000c92f0 0x7fba001e64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0696b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba0015d220 0x7fba0015c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59302/0 (socket says 10.20.193.10:59302) 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0696b640 1 -- 10.20.193.10:0/3253164384 learned_addr learned my addr 10.20.193.10:0/3253164384 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0696b640 10 monclient(hunting): get_auth_request con 0x7fba0015d220 auth_method 0 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0696b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0696b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0696b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0616a640 10 monclient(hunting): get_auth_request con 0x7fba00074920 auth_method 0 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0616a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0616a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba0616a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba05969640 10 monclient(hunting): get_auth_request con 0x7fba000c92f0 auth_method 0 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba05969640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba05969640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.528+0000 7fba05969640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.529+0000 7fba0696b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.529+0000 7fba0696b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.529+0000 7fba0696b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.529+0000 7fba0616a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.529+0000 7fba0616a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.529+0000 7fba0616a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.529+0000 7fba05969640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.529+0000 7fba05969640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.529+0000 7fba05969640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 10 monclient(hunting): handle_auth_done global_id 5104 payload 824 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 1 -- 10.20.193.10:0/3253164384 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fba000c92f0 msgr2=0x7fba001e64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fba000c92f0 0x7fba001e64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 1 -- 10.20.193.10:0/3253164384 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fba00074920 msgr2=0x7fba001e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fba00074920 0x7fba001e89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 10 monclient: _finish_hunting 0 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 1 monclient: found mon.noname-b 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:04.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.530+0000 7fba0696b640 1 -- 10.20.193.10:0/3253164384 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba001e8f20 con 0x7fba0015d220 2026-02-17T12:01:04.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.531+0000 7fba0696b640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba0015d220 0x7fba0015c070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc03a040 tx=0x7fb9fc004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:04.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.531+0000 7fb9e6ffd640 10 client.?.objecter ms_handle_connect 0x7fba0015d220 2026-02-17T12:01:04.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.531+0000 7fb9e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:04.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 1 -- 10.20.193.10:0/3253164384 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc03c050 con 0x7fba0015d220 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 10 monclient: dump: 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 5 monclient: authenticate success, global_id 5104 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 10 monclient: _renew_subs 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba001f2990 con 0x7fba0015d220 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 10 client.5104.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 10 monclient: _renew_subs 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:04.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba00073680 con 0x7fba0015d220 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 1 librados: init done 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 1 -- 10.20.193.10:0/3253164384 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc048070 con 0x7fba0015d220 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 1 -- 10.20.193.10:0/3253164384 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc035a50 con 0x7fba0015d220 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fb9e6ffd640 10 monclient: dump: 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba04967640 4 set_mon_vals no callback set 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.532+0000 7fba083f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.533+0000 7fba083f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.533+0000 7fba083f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:04.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.533+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba000c6360 con 0x7fba0015d220 2026-02-17T12:01:04.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.544+0000 7fb9e6ffd640 1 -- 10.20.193.10:0/3253164384 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fb9fc035bf0 con 0x7fba0015d220 2026-02-17T12:01:04.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.544+0000 7fb9e6ffd640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb9d0078e00 0x7fb9d007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.544+0000 7fba0616a640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb9d0078e00 0x7fb9d007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.544+0000 7fba0616a640 10 monclient: get_auth_request con 0x7fb9d0078e00 auth_method 0 2026-02-17T12:01:04.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.544+0000 7fba0616a640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb9d0078e00 0x7fb9d007b2c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0002770 tx=0x7fb9f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:04.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.544+0000 7fb9e6ffd640 10 client.5104.objecter ms_handle_connect 0x7fb9d0078e00 2026-02-17T12:01:04.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.639+0000 7fb9e6ffd640 1 -- 10.20.193.10:0/3253164384 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb9fc084610 con 0x7fba0015d220 2026-02-17T12:01:04.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.639+0000 7fb9e6ffd640 10 client.5104.objecter ms_dispatch2 0x7fba00000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:04.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.639+0000 7fb9e6ffd640 3 client.5104.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:04.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.639+0000 7fb9e6ffd640 3 client.5104.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:04.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.639+0000 7fb9e6ffd640 20 client.5104.objecter dump_active .. 0 homeless 2026-02-17T12:01:04.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.646+0000 7fb9e6ffd640 1 -- 10.20.193.10:0/3253164384 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fba000c6360 con 0x7fba0015d220 2026-02-17T12:01:04.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.646+0000 7fb9e6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.648 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.646+0000 7fb9e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:04.731 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.729+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba00153f70 con 0x7fb9d0078e00 2026-02-17T12:01:04.732 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.730+0000 7fb9e6ffd640 1 -- 10.20.193.10:0/3253164384 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44249 (secure 0 0 0) 0x7fba00153f70 con 0x7fb9d0078e00 2026-02-17T12:01:04.733 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:01:04.734 INFO:teuthology.orchestra.run.trial010.stderr:dumped all 2026-02-17T12:01:04.734 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.731+0000 7fba083f5640 10 librados: watch_flush enter 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 10 librados: watch_flush exit 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 20 client.5104.objecter shutdown clearing up homeless session... 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 10 client.5104.objecter successfully canceled tick 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb9d0078e00 msgr2=0x7fb9d007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb9d0078e00 0x7fb9d007b2c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0002770 tx=0x7fb9f0009040 comp rx=0 tx=0).stop 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 10 monclient: shutdown 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba0015d220 msgr2=0x7fba0015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba0015d220 0x7fba0015c070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc03a040 tx=0x7fb9fc004b40 comp rx=0 tx=0).stop 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 shutdown_connections 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb9d0078e00 0x7fb9d007b2c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fba0015d220 0x7fba0015c070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fba000c92f0 0x7fba001e64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 --2- 10.20.193.10:0/3253164384 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fba00074920 0x7fba001e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 >> 10.20.193.10:0/3253164384 conn(0x7fba000c9d80 msgr2=0x7fba0006b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 shutdown_connections 2026-02-17T12:01:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 -- 10.20.193.10:0/3253164384 wait complete. 2026-02-17T12:01:04.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.732+0000 7fba083f5640 1 librados: shutdown 2026-02-17T12:01:04.742 INFO:teuthology.orchestra.run.trial010.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2026-02-17T12:01:03.810097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438232,"kb_used_data":6808,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511208,"statfs":{"total":1546188226560,"available":1545739476992,"internally_reserved":0,"allocated":6971392,"data_stored":3471254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25500,"internal_metadata":441424996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001575"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:07.916577+0000","last_change":"2026-02-17T11:55:57.532493+0000","last_active":"2026-02-17T11:58:07.916577+0000","last_peered":"2026-02-17T11:58:07.916577+0000","last_clean":"2026-02-17T11:58:07.916577+0000","last_became_active":"2026-02-17T11:55:55.658594+0000","last_became_peered":"2026-02-17T11:55:55.658594+0000","last_unstale":"2026-02-17T11:58:07.916577+0000","last_undegraded":"2026-02-17T11:58:07.916577+0000","last_fullsized":"2026-02-17T11:58:07.916577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:26:38.378508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042345316000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:06.393337+0000","last_change":"2026-02-17T11:55:57.587525+0000","last_active":"2026-02-17T11:58:06.393337+0000","last_peered":"2026-02-17T11:58:06.393337+0000","last_clean":"2026-02-17T11:58:06.393337+0000","last_became_active":"2026-02-17T11:55:55.781344+0000","last_became_peered":"2026-02-17T11:55:55.781344+0000","last_unstale":"2026-02-17T11:58:06.393337+0000","last_undegraded":"2026-02-17T11:58:06.393337+0000","last_fullsized":"2026-02-17T11:58:06.393337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:52.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037397883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:02.969298+0000","last_change":"2026-02-17T11:55:57.503086+0000","last_active":"2026-02-17T11:58:02.969298+0000","last_peered":"2026-02-17T11:58:02.969298+0000","last_clean":"2026-02-17T11:58:02.969298+0000","last_became_active":"2026-02-17T11:55:55.451241+0000","last_became_peered":"2026-02-17T11:55:55.451241+0000","last_unstale":"2026-02-17T11:58:02.969298+0000","last_undegraded":"2026-02-17T11:58:02.969298+0000","last_fullsized":"2026-02-17T11:58:02.969298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:35:03.971846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037882574000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:03.012781+0000","last_change":"2026-02-17T11:55:57.580958+0000","last_active":"2026-02-17T11:58:03.012781+0000","last_peered":"2026-02-17T11:58:03.012781+0000","last_clean":"2026-02-17T11:58:03.012781+0000","last_became_active":"2026-02-17T11:55:55.648482+0000","last_became_peered":"2026-02-17T11:55:55.648482+0000","last_unstale":"2026-02-17T11:58:03.012781+0000","last_undegraded":"2026-02-17T11:58:03.012781+0000","last_fullsized":"2026-02-17T11:58:03.012781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:44:03.363850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037738756999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:02.524969+0000","last_change":"2026-02-17T11:55:57.569398+0000","last_active":"2026-02-17T11:58:02.524969+0000","last_peered":"2026-02-17T11:58:02.524969+0000","last_clean":"2026-02-17T11:58:02.524969+0000","last_became_active":"2026-02-17T11:55:55.640831+0000","last_became_peered":"2026-02-17T11:55:55.640831+0000","last_unstale":"2026-02-17T11:58:02.524969+0000","last_undegraded":"2026-02-17T11:58:02.524969+0000","last_fullsized":"2026-02-17T11:58:02.524969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:53:48.237641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056907020000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,12],"acting":[2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:00.462505+0000","last_change":"2026-02-17T11:55:57.578304+0000","last_active":"2026-02-17T11:58:00.462505+0000","last_peered":"2026-02-17T11:58:00.462505+0000","last_clean":"2026-02-17T11:58:00.462505+0000","last_became_active":"2026-02-17T11:55:55.453952+0000","last_became_peered":"2026-02-17T11:55:55.453952+0000","last_unstale":"2026-02-17T11:58:00.462505+0000","last_undegraded":"2026-02-17T11:58:00.462505+0000","last_fullsized":"2026-02-17T11:58:00.462505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:34:50.379105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034638460000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:57:57.522955+0000","last_change":"2026-02-17T11:55:57.561696+0000","last_active":"2026-02-17T11:57:57.522955+0000","last_peered":"2026-02-17T11:57:57.522955+0000","last_clean":"2026-02-17T11:57:57.522955+0000","last_became_active":"2026-02-17T11:55:55.508618+0000","last_became_peered":"2026-02-17T11:55:55.508618+0000","last_unstale":"2026-02-17T11:57:57.522955+0000","last_undegraded":"2026-02-17T11:57:57.522955+0000","last_fullsized":"2026-02-17T11:57:57.522955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:29:21.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055960348,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"32'1","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:03.767027+0000","last_change":"2026-02-17T11:55:57.580322+0000","last_active":"2026-02-17T11:58:03.767027+0000","last_peered":"2026-02-17T11:58:03.767027+0000","last_clean":"2026-02-17T11:58:03.767027+0000","last_became_active":"2026-02-17T11:55:55.408633+0000","last_became_peered":"2026-02-17T11:55:55.408633+0000","last_unstale":"2026-02-17T11:58:03.767027+0000","last_undegraded":"2026-02-17T11:58:03.767027+0000","last_fullsized":"2026-02-17T11:58:03.767027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:37:04.068558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027166316999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"29'32","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:57:43.759185+0000","last_change":"2026-02-17T11:55:50.153568+0000","last_active":"2026-02-17T11:57:43.759185+0000","last_peered":"2026-02-17T11:57:43.759185+0000","last_clean":"2026-02-17T11:57:43.759185+0000","last_became_active":"2026-02-17T11:55:49.807188+0000","last_became_peered":"2026-02-17T11:55:49.807188+0000","last_unstale":"2026-02-17T11:57:43.759185+0000","last_undegraded":"2026-02-17T11:57:43.759185+0000","last_fullsized":"2026-02-17T11:57:43.759185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_clean_scrub_stamp":"2026-02-17T11:55:42.183447+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:38:58.356098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[2,4,5,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":28,"seq":120259084352,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,5,6,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":28,"seq":120259084354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313284,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":22,"seq":94489280580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,6,7,8,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":25,"seq":107374182466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,4,5,6,7,8,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":24,"seq":103079215171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":24,"seq":103079215170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[2,4,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":27,"seq":115964117060,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,5,6,7,8,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,3,5,6,7,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":27,"seq":115964117061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":27,"seq":115964117063,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":27,"seq":115964117060,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,2,4,6,7,8,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":27,"seq":115964117062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,2,3,4,5,7,9,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:01:04.743 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T12:01:04.744 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:01:04.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.809+0000 7fef551a8640 10 monclient: get_monmap_and_config 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.809+0000 7fef551a8640 10 monclient: build_initial_monmap 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.809+0000 7fef551a8640 10 monclient: monmap: 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:04.811028+0000 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:04.811028+0000 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 1 Processor -- start 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 1 -- start start 2026-02-17T12:01:04.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 10 monclient: init 2026-02-17T12:01:04.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 10 monclient: _add_conns ranks=[0,1,3,4,5,2] 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fef5015d220 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fef500c92f0 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fef50153d60 0x7fef5015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 10 monclient(hunting): picked mon.noname-a con 0x7fef50153d60 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef500c58a0 con 0x7fef5015d220 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef500c55c0 con 0x7fef500c92f0 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fef500c7e20 con 0x7fef50153d60 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.810+0000 7fef551a8640 10 monclient(hunting): authenticate will time out at 1334.532725s 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4f577640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fef50153d60 0x7fef5015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4e575640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fef500c92f0 0x7fef50153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37712/0 (socket says 10.20.193.10:37712) 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4e575640 1 -- 10.20.193.10:0/3228801142 learned_addr learned my addr 10.20.193.10:0/3228801142 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4f577640 10 monclient(hunting): get_auth_request con 0x7fef50153d60 auth_method 0 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.811+0000 7fef4f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.812+0000 7fef4f577640 10 monclient(hunting): handle_auth_done global_id 5082 payload 274 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.812+0000 7fef4f577640 1 -- 10.20.193.10:0/3228801142 >> v1:10.20.193.71:6789/0 conn(0x7fef500c92f0 legacy=0x7fef50153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.812+0000 7fef4f577640 1 -- 10.20.193.10:0/3228801142 >> v1:10.20.193.10:6789/0 conn(0x7fef5015d220 legacy=0x7fef500c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.812+0000 7fef4f577640 10 monclient: _finish_hunting 0 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.812+0000 7fef4f577640 1 monclient: found mon.noname-a 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.812+0000 7fef4f577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.812+0000 7fef4f577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.812+0000 7fef4f577640 1 -- 10.20.193.10:0/3228801142 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef500c8100 con 0x7fef50153d60 2026-02-17T12:01:04.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.813+0000 7fef4f577640 1 --2- 10.20.193.10:0/3228801142 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef50153d60 0x7fef5015d600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fef40009dc0 tx=0x7fef4002f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915b1cac2404ae5c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 1 -- 10.20.193.10:0/3228801142 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4003c070 con 0x7fef50153d60 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 10 monclient: dump: 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 10 monclient: _finish_auth 0 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 10 monclient: _check_auth_tickets 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 1 -- 10.20.193.10:0/3228801142 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef40037440 con 0x7fef50153d60 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 5 monclient: authenticate success, global_id 5082 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 1 -- 10.20.193.10:0/3228801142 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40037810 con 0x7fef50153d60 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef4dd74640 10 monclient: dump: 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:04.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 4 set_mon_vals no callback set 2026-02-17T12:01:04.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 10 monclient: shutdown 2026-02-17T12:01:04.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:04.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 1 -- 10.20.193.10:0/3228801142 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef50153d60 msgr2=0x7fef5015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 1 --2- 10.20.193.10:0/3228801142 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef50153d60 0x7fef5015d600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fef40009dc0 tx=0x7fef4002f230 comp rx=0 tx=0).stop 2026-02-17T12:01:04.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 1 -- 10.20.193.10:0/3228801142 shutdown_connections 2026-02-17T12:01:04.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 1 --2- 10.20.193.10:0/3228801142 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef50153d60 0x7fef5015d600 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 1 -- 10.20.193.10:0/3228801142 >> 10.20.193.10:0/3228801142 conn(0x7fef500c9d80 msgr2=0x7fef500ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:04.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 1 -- 10.20.193.10:0/3228801142 shutdown_connections 2026-02-17T12:01:04.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.816+0000 7fef551a8640 1 -- 10.20.193.10:0/3228801142 wait complete. 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 10 monclient: build_initial_monmap 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 10 monclient: monmap: 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 1 librados: starting msgr at 2026-02-17T12:01:04.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 1 librados: starting objecter 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 1 Processor -- start 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 1 -- start start 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 1 librados: setting wanted keys 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 1 librados: calling monclient init 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 10 monclient: init 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.817+0000 7fef551a8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef500c92f0 0x7fef500724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 10 monclient(hunting): picked mon.noname-a con 0x7fef500c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fef50153d60 0x7fef5014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 10 monclient(hunting): picked mon.noname-b con 0x7fef50153d60 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef5015d220 0x7fef50073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 10 monclient(hunting): picked mon.noname-c con 0x7fef5015d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fef50074920 con 0x7fef500c92f0 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fef500c86c0 con 0x7fef50153d60 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef50074aa0 con 0x7fef5015d220 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef551a8640 10 monclient(hunting): authenticate will time out at 1334.540040s 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef500c92f0 0x7fef500724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4e575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fef50153d60 0x7fef5014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef500c92f0 0x7fef500724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44694/0 (socket says 10.20.193.10:44694) 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 1 -- 10.20.193.10:0/3492080546 learned_addr learned my addr 10.20.193.10:0/3492080546 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 10 monclient(hunting): get_auth_request con 0x7fef500c92f0 auth_method 0 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4f577640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef5015d220 0x7fef50073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4e575640 10 monclient(hunting): get_auth_request con 0x7fef50153d60 auth_method 0 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4f577640 10 monclient(hunting): get_auth_request con 0x7fef5015d220 auth_method 0 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.818+0000 7fef4f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.819+0000 7fef4f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 10 monclient(hunting): handle_auth_done global_id 5085 payload 824 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 1 -- 10.20.193.10:0/3492080546 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef5015d220 msgr2=0x7fef50073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef5015d220 0x7fef50073f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 1 -- 10.20.193.10:0/3492080546 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fef50153d60 msgr2=0x7fef5014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fef50153d60 0x7fef5014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 10 monclient: _finish_hunting 0 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 1 monclient: found mon.noname-a 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.820+0000 7fef4ed76640 1 -- 10.20.193.10:0/3492080546 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef501f5b30 con 0x7fef500c92f0 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.821+0000 7fef4ed76640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef500c92f0 0x7fef500724d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fef4400b4d0 tx=0x7fef4400b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.821+0000 7fef2f7fe640 10 client.?.objecter ms_handle_connect 0x7fef500c92f0 2026-02-17T12:01:04.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.821+0000 7fef2f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:04.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 1 -- 10.20.193.10:0/3492080546 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44004480 con 0x7fef500c92f0 2026-02-17T12:01:04.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:04.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 10 monclient: dump: 2026-02-17T12:01:04.825 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 1 -- 10.20.193.10:0/3492080546 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef44015070 con 0x7fef500c92f0 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 1 -- 10.20.193.10:0/3492080546 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44002920 con 0x7fef500c92f0 2026-02-17T12:01:04.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef2f7fe640 10 monclient: dump: 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef4d573640 4 set_mon_vals no callback set 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef551a8640 5 monclient: authenticate success, global_id 5085 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef551a8640 10 monclient: _renew_subs 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.822+0000 7fef551a8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef50072b80 con 0x7fef500c92f0 2026-02-17T12:01:04.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 10 client.5085.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:04.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 10 monclient: _renew_subs 2026-02-17T12:01:04.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef50073140 con 0x7fef500c92f0 2026-02-17T12:01:04.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 1 librados: init done 2026-02-17T12:01:04.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:04.828 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.823+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5015d600 con 0x7fef500c92f0 2026-02-17T12:01:04.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.834+0000 7fef2f7fe640 1 -- 10.20.193.10:0/3492080546 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fef44002ac0 con 0x7fef500c92f0 2026-02-17T12:01:04.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.835+0000 7fef2f7fe640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fef1c078e00 0x7fef1c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:04.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.835+0000 7fef4e575640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fef1c078e00 0x7fef1c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:04.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.835+0000 7fef4e575640 10 monclient: get_auth_request con 0x7fef1c078e00 auth_method 0 2026-02-17T12:01:04.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.835+0000 7fef2f7fe640 10 client.5085.objecter ms_handle_connect 0x7fef1c078e00 2026-02-17T12:01:04.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.835+0000 7fef4e575640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fef1c078e00 0x7fef1c07b2c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fef500c5e40 tx=0x7fef38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:04.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.937+0000 7fef2f7fe640 1 -- 10.20.193.10:0/3492080546 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fef4405e1e0 con 0x7fef500c92f0 2026-02-17T12:01:04.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.937+0000 7fef2f7fe640 10 client.5085.objecter ms_dispatch2 0x7fef50000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:04.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.937+0000 7fef2f7fe640 3 client.5085.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:04.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.937+0000 7fef2f7fe640 3 client.5085.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:04.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.937+0000 7fef2f7fe640 20 client.5085.objecter dump_active .. 0 homeless 2026-02-17T12:01:04.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.937+0000 7fef2f7fe640 1 -- 10.20.193.10:0/3492080546 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fef440621a0 con 0x7fef500c92f0 2026-02-17T12:01:04.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.937+0000 7fef2f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:04.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:04.937+0000 7fef2f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:05.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.019+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef50076740 con 0x7fef1c078e00 2026-02-17T12:01:05.022 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.020+0000 7fef2f7fe640 1 -- 10.20.193.10:0/3492080546 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44249 (secure 0 0 0) 0x7fef50076740 con 0x7fef1c078e00 2026-02-17T12:01:05.022 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:01:05.023 INFO:teuthology.orchestra.run.trial010.stderr:dumped all 2026-02-17T12:01:05.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 10 librados: watch_flush enter 2026-02-17T12:01:05.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 10 librados: watch_flush exit 2026-02-17T12:01:05.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 20 client.5085.objecter shutdown clearing up homeless session... 2026-02-17T12:01:05.023 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 10 client.5085.objecter successfully canceled tick 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fef1c078e00 msgr2=0x7fef1c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fef1c078e00 0x7fef1c07b2c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fef500c5e40 tx=0x7fef38009040 comp rx=0 tx=0).stop 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 10 monclient: shutdown 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef500c92f0 msgr2=0x7fef500724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef500c92f0 0x7fef500724d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fef4400b4d0 tx=0x7fef4400b9a0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 shutdown_connections 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fef1c078e00 0x7fef1c07b2c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef5015d220 0x7fef50073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fef50153d60 0x7fef5014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 --2- 10.20.193.10:0/3492080546 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fef500c92f0 0x7fef500724d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 >> 10.20.193.10:0/3492080546 conn(0x7fef500c9d80 msgr2=0x7fef50153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 shutdown_connections 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 -- 10.20.193.10:0/3492080546 wait complete. 2026-02-17T12:01:05.024 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.021+0000 7fef551a8640 1 librados: shutdown 2026-02-17T12:01:05.031 INFO:teuthology.orchestra.run.trial010.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2026-02-17T12:01:03.810097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438232,"kb_used_data":6808,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511208,"statfs":{"total":1546188226560,"available":1545739476992,"internally_reserved":0,"allocated":6971392,"data_stored":3471254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25500,"internal_metadata":441424996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001575"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:07.916577+0000","last_change":"2026-02-17T11:55:57.532493+0000","last_active":"2026-02-17T11:58:07.916577+0000","last_peered":"2026-02-17T11:58:07.916577+0000","last_clean":"2026-02-17T11:58:07.916577+0000","last_became_active":"2026-02-17T11:55:55.658594+0000","last_became_peered":"2026-02-17T11:55:55.658594+0000","last_unstale":"2026-02-17T11:58:07.916577+0000","last_undegraded":"2026-02-17T11:58:07.916577+0000","last_fullsized":"2026-02-17T11:58:07.916577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:26:38.378508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042345316000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:06.393337+0000","last_change":"2026-02-17T11:55:57.587525+0000","last_active":"2026-02-17T11:58:06.393337+0000","last_peered":"2026-02-17T11:58:06.393337+0000","last_clean":"2026-02-17T11:58:06.393337+0000","last_became_active":"2026-02-17T11:55:55.781344+0000","last_became_peered":"2026-02-17T11:55:55.781344+0000","last_unstale":"2026-02-17T11:58:06.393337+0000","last_undegraded":"2026-02-17T11:58:06.393337+0000","last_fullsized":"2026-02-17T11:58:06.393337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:52.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037397883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:02.969298+0000","last_change":"2026-02-17T11:55:57.503086+0000","last_active":"2026-02-17T11:58:02.969298+0000","last_peered":"2026-02-17T11:58:02.969298+0000","last_clean":"2026-02-17T11:58:02.969298+0000","last_became_active":"2026-02-17T11:55:55.451241+0000","last_became_peered":"2026-02-17T11:55:55.451241+0000","last_unstale":"2026-02-17T11:58:02.969298+0000","last_undegraded":"2026-02-17T11:58:02.969298+0000","last_fullsized":"2026-02-17T11:58:02.969298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:35:03.971846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037882574000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:03.012781+0000","last_change":"2026-02-17T11:55:57.580958+0000","last_active":"2026-02-17T11:58:03.012781+0000","last_peered":"2026-02-17T11:58:03.012781+0000","last_clean":"2026-02-17T11:58:03.012781+0000","last_became_active":"2026-02-17T11:55:55.648482+0000","last_became_peered":"2026-02-17T11:55:55.648482+0000","last_unstale":"2026-02-17T11:58:03.012781+0000","last_undegraded":"2026-02-17T11:58:03.012781+0000","last_fullsized":"2026-02-17T11:58:03.012781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:44:03.363850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037738756999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:02.524969+0000","last_change":"2026-02-17T11:55:57.569398+0000","last_active":"2026-02-17T11:58:02.524969+0000","last_peered":"2026-02-17T11:58:02.524969+0000","last_clean":"2026-02-17T11:58:02.524969+0000","last_became_active":"2026-02-17T11:55:55.640831+0000","last_became_peered":"2026-02-17T11:55:55.640831+0000","last_unstale":"2026-02-17T11:58:02.524969+0000","last_undegraded":"2026-02-17T11:58:02.524969+0000","last_fullsized":"2026-02-17T11:58:02.524969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:53:48.237641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056907020000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,12],"acting":[2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:00.462505+0000","last_change":"2026-02-17T11:55:57.578304+0000","last_active":"2026-02-17T11:58:00.462505+0000","last_peered":"2026-02-17T11:58:00.462505+0000","last_clean":"2026-02-17T11:58:00.462505+0000","last_became_active":"2026-02-17T11:55:55.453952+0000","last_became_peered":"2026-02-17T11:55:55.453952+0000","last_unstale":"2026-02-17T11:58:00.462505+0000","last_undegraded":"2026-02-17T11:58:00.462505+0000","last_fullsized":"2026-02-17T11:58:00.462505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:34:50.379105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034638460000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:57:57.522955+0000","last_change":"2026-02-17T11:55:57.561696+0000","last_active":"2026-02-17T11:57:57.522955+0000","last_peered":"2026-02-17T11:57:57.522955+0000","last_clean":"2026-02-17T11:57:57.522955+0000","last_became_active":"2026-02-17T11:55:55.508618+0000","last_became_peered":"2026-02-17T11:55:55.508618+0000","last_unstale":"2026-02-17T11:57:57.522955+0000","last_undegraded":"2026-02-17T11:57:57.522955+0000","last_fullsized":"2026-02-17T11:57:57.522955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:29:21.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055960348,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"32'1","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:03.767027+0000","last_change":"2026-02-17T11:55:57.580322+0000","last_active":"2026-02-17T11:58:03.767027+0000","last_peered":"2026-02-17T11:58:03.767027+0000","last_clean":"2026-02-17T11:58:03.767027+0000","last_became_active":"2026-02-17T11:55:55.408633+0000","last_became_peered":"2026-02-17T11:55:55.408633+0000","last_unstale":"2026-02-17T11:58:03.767027+0000","last_undegraded":"2026-02-17T11:58:03.767027+0000","last_fullsized":"2026-02-17T11:58:03.767027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:37:04.068558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027166316999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"29'32","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:57:43.759185+0000","last_change":"2026-02-17T11:55:50.153568+0000","last_active":"2026-02-17T11:57:43.759185+0000","last_peered":"2026-02-17T11:57:43.759185+0000","last_clean":"2026-02-17T11:57:43.759185+0000","last_became_active":"2026-02-17T11:55:49.807188+0000","last_became_peered":"2026-02-17T11:55:49.807188+0000","last_unstale":"2026-02-17T11:57:43.759185+0000","last_undegraded":"2026-02-17T11:57:43.759185+0000","last_fullsized":"2026-02-17T11:57:43.759185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_clean_scrub_stamp":"2026-02-17T11:55:42.183447+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:38:58.356098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[2,4,5,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":28,"seq":120259084352,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,5,6,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":28,"seq":120259084354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313284,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":22,"seq":94489280580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,6,7,8,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":25,"seq":107374182466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,4,5,6,7,8,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":24,"seq":103079215171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":24,"seq":103079215170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[2,4,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":27,"seq":115964117060,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,5,6,7,8,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,3,5,6,7,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":27,"seq":115964117061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":27,"seq":115964117063,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":27,"seq":115964117060,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,2,4,6,7,8,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":27,"seq":115964117062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,2,3,4,5,7,9,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:01:05.033 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:01:05.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.098+0000 7f50100b8640 10 monclient: get_monmap_and_config 2026-02-17T12:01:05.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.098+0000 7f50100b8640 10 monclient: build_initial_monmap 2026-02-17T12:01:05.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.098+0000 7f50100b8640 10 monclient: monmap: 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:05.099445+0000 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:05.099445+0000 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:05.101 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:05.102 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:05.102 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:05.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.098+0000 7f50100b8640 1 Processor -- start 2026-02-17T12:01:05.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.098+0000 7f50100b8640 1 -- start start 2026-02-17T12:01:05.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.098+0000 7f50100b8640 10 monclient: init 2026-02-17T12:01:05.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:05.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 10 monclient: _add_conns ranks=[2,5,4,0,1,3] 2026-02-17T12:01:05.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f500815d220 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:05.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f50080c92f0 0x7f500815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 10 monclient(hunting): picked mon.noname-c con 0x7f50080c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:05.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5008074920 0x7f5008153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 10 monclient(hunting): picked mon.noname-b con 0x7f5008074920 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:05.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50080c58a0 con 0x7f500815d220 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f50080c55c0 con 0x7f5008074920 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f50080c7e20 con 0x7f50080c92f0 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f50100b8640 10 monclient(hunting): authenticate will time out at 1334.821150s 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f500e62e640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5008074920 0x7f5008153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f500d62c640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f50080c92f0 0x7f500815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f500e62e640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5008074920 0x7f5008153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59320/0 (socket says 10.20.193.10:59320) 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f500e62e640 1 -- 10.20.193.10:0/3496131059 learned_addr learned my addr 10.20.193.10:0/3496131059 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f500e62e640 10 monclient(hunting): get_auth_request con 0x7f5008074920 auth_method 0 2026-02-17T12:01:05.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f500e62e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f500e62e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f500e62e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.099+0000 7f500de2d640 1 --1- 10.20.193.10:0/3496131059 >> v1:10.20.193.153:6789/0 conn(0x7f500815d220 0x7f50080c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:57430/0 (socket says 10.20.193.10:57430) 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500d62c640 10 monclient(hunting): get_auth_request con 0x7f50080c92f0 auth_method 0 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500d62c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500d62c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500d62c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500e62e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500e62e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500e62e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500d62c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:05.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500d62c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.100+0000 7f500d62c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.101+0000 7f500e62e640 10 monclient(hunting): handle_auth_done global_id 5113 payload 274 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.101+0000 7f500e62e640 1 -- 10.20.193.10:0/3496131059 >> v2:10.20.193.153:3300/0 conn(0x7f50080c92f0 msgr2=0x7f500815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.101+0000 7f500e62e640 1 --2- 10.20.193.10:0/3496131059 >> v2:10.20.193.153:3300/0 conn(0x7f50080c92f0 0x7f500815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.101+0000 7f500e62e640 1 -- 10.20.193.10:0/3496131059 >> v1:10.20.193.153:6789/0 conn(0x7f500815d220 legacy=0x7f50080c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.101+0000 7f500e62e640 10 monclient: _finish_hunting 0 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.101+0000 7f500e62e640 1 monclient: found mon.noname-b 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.101+0000 7f500e62e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.101+0000 7f500e62e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.101+0000 7f500e62e640 1 -- 10.20.193.10:0/3496131059 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50080c8100 con 0x7f5008074920 2026-02-17T12:01:05.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.102+0000 7f500e62e640 1 --2- 10.20.193.10:0/3496131059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5008074920 0x7f5008153650 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5004009e50 tx=0x7f500402f2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e16fd8a1664a10f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:05.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 1 -- 10.20.193.10:0/3496131059 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500402fd60 con 0x7f5008074920 2026-02-17T12:01:05.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:05.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:05.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 10 monclient: dump: 2026-02-17T12:01:05.115 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:05.115 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 10 monclient: _finish_auth 0 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 10 monclient: _check_auth_tickets 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:05.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 5 monclient: authenticate success, global_id 5113 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 1 -- 10.20.193.10:0/3496131059 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50040373f0 con 0x7f5008074920 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 1 -- 10.20.193.10:0/3496131059 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50040377c0 con 0x7f5008074920 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 4 set_mon_vals no callback set 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f500ce2b640 10 monclient: dump: 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:05.117 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 10 monclient: shutdown 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 -- 10.20.193.10:0/3496131059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5008074920 msgr2=0x7f5008153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 --2- 10.20.193.10:0/3496131059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5008074920 0x7f5008153650 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5004009e50 tx=0x7f500402f2a0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 -- 10.20.193.10:0/3496131059 shutdown_connections 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 --2- 10.20.193.10:0/3496131059 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5008074920 0x7f5008153650 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 --2- 10.20.193.10:0/3496131059 >> v2:10.20.193.153:3300/0 conn(0x7f50080c92f0 0x7f500815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 -- 10.20.193.10:0/3496131059 >> 10.20.193.10:0/3496131059 conn(0x7f50080c9d80 msgr2=0x7f50080ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 -- 10.20.193.10:0/3496131059 shutdown_connections 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 -- 10.20.193.10:0/3496131059 wait complete. 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 10 monclient: build_initial_monmap 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 10 monclient: monmap: 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:05.119 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 librados: starting msgr at 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 librados: starting objecter 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 Processor -- start 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 -- start start 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 librados: setting wanted keys 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 1 librados: calling monclient init 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.104+0000 7f50100b8640 10 monclient: init 2026-02-17T12:01:05.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5008074920 0x7f500814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient(hunting): picked mon.noname-a con 0x7f5008074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f50080c92f0 0x7f500814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient(hunting): picked mon.noname-b con 0x7f50080c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f500815d220 0x7f50081f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient(hunting): picked mon.noname-c con 0x7f500815d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5008074d70 con 0x7f5008074920 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f50080c86c0 con 0x7f50080c92f0 2026-02-17T12:01:05.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5008153b90 con 0x7f500815d220 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f50100b8640 10 monclient(hunting): authenticate will time out at 1334.827386s 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500d62c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f50080c92f0 0x7f500814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500e62e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f500815d220 0x7f50081f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500de2d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5008074920 0x7f500814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500d62c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f50080c92f0 0x7f500814aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59334/0 (socket says 10.20.193.10:59334) 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500d62c640 1 -- 10.20.193.10:0/2682929561 learned_addr learned my addr 10.20.193.10:0/2682929561 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500d62c640 10 monclient(hunting): get_auth_request con 0x7f50080c92f0 auth_method 0 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500d62c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500d62c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500d62c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500de2d640 10 monclient(hunting): get_auth_request con 0x7f5008074920 auth_method 0 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500de2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500de2d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500de2d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500e62e640 10 monclient(hunting): get_auth_request con 0x7f500815d220 auth_method 0 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500e62e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500e62e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.105+0000 7f500e62e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.106+0000 7f500d62c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.106+0000 7f500d62c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.106+0000 7f500d62c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.106+0000 7f500e62e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:05.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.106+0000 7f500e62e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.106+0000 7f500e62e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.106+0000 7f500de2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.106+0000 7f500de2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.106+0000 7f500de2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 10 monclient(hunting): handle_auth_done global_id 5116 payload 824 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 1 -- 10.20.193.10:0/2682929561 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f500815d220 msgr2=0x7f50081f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f500815d220 0x7f50081f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 1 -- 10.20.193.10:0/2682929561 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5008074920 msgr2=0x7f500814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5008074920 0x7f500814d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 10 monclient: _finish_hunting 0 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 1 monclient: found mon.noname-b 2026-02-17T12:01:05.124 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.107+0000 7f500d62c640 1 -- 10.20.193.10:0/2682929561 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500814b9a0 con 0x7f50080c92f0 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.108+0000 7f500d62c640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f50080c92f0 0x7f500814aff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00ebe0 tx=0x7f4ffc00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.108+0000 7f4ff67fc640 10 client.?.objecter ms_handle_connect 0x7f50080c92f0 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.108+0000 7f4ff67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f4ff67fc640 1 -- 10.20.193.10:0/2682929561 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc017070 con 0x7f50080c92f0 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f4ff67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f4ff67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f4ff67fc640 10 monclient: dump: 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:05.125 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f4ff67fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f4ff67fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f4ff67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f50100b8640 5 monclient: authenticate success, global_id 5116 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f50100b8640 10 monclient: _renew_subs 2026-02-17T12:01:05.126 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f50100b8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50081f5090 con 0x7f50080c92f0 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f50100b8640 10 client.5116.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f50100b8640 10 monclient: _renew_subs 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f50100b8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50081f5650 con 0x7f50080c92f0 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.109+0000 7f50100b8640 1 librados: init done 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f4ff67fc640 1 -- 10.20.193.10:0/2682929561 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00cc40 con 0x7f50080c92f0 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f4ff67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f4ff67fc640 1 -- 10.20.193.10:0/2682929561 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc021060 con 0x7f50080c92f0 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f4ff67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f4ff67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:05.127 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f4ff67fc640 10 monclient: dump: 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f4ff7fff640 4 set_mon_vals no callback set 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f50100b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:05.128 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f50100b8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:05.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f50100b8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:05.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.110+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5008153f20 con 0x7f50080c92f0 2026-02-17T12:01:05.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.121+0000 7f4ff67fc640 1 -- 10.20.193.10:0/2682929561 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f4ffc026480 con 0x7f50080c92f0 2026-02-17T12:01:05.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.122+0000 7f4ff67fc640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4fd8078e00 0x7f4fd807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:05.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.122+0000 7f500de2d640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4fd8078e00 0x7f4fd807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:05.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.122+0000 7f500de2d640 10 monclient: get_auth_request con 0x7f4fd8078e00 auth_method 0 2026-02-17T12:01:05.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.122+0000 7f500de2d640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4fd8078e00 0x7f4fd807b2c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8002770 tx=0x7f4ff8007f40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:05.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.122+0000 7f4ff67fc640 10 client.5116.objecter ms_handle_connect 0x7f4fd8078e00 2026-02-17T12:01:05.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.124+0000 7f4ff67fc640 1 -- 10.20.193.10:0/2682929561 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f4ffc05e5d0 con 0x7f50080c92f0 2026-02-17T12:01:05.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.124+0000 7f4ff67fc640 10 client.5116.objecter ms_dispatch2 0x7f5008000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:05.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.124+0000 7f4ff67fc640 3 client.5116.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:05.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.124+0000 7f4ff67fc640 3 client.5116.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:05.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.124+0000 7f4ff67fc640 20 client.5116.objecter dump_active .. 0 homeless 2026-02-17T12:01:05.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.229+0000 7f4ff67fc640 1 -- 10.20.193.10:0/2682929561 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4ffc062590 con 0x7f50080c92f0 2026-02-17T12:01:05.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.229+0000 7f4ff67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:05.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.229+0000 7f4ff67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:05.316 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.314+0000 7f50100b8640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:01:05.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.314+0000 7f50100b8640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:01:05.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.314+0000 7f50100b8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:05.317 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.314+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50080c9b60 con 0x7f50080c92f0 2026-02-17T12:01:05.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.333+0000 7f4ff67fc640 1 -- 10.20.193.10:0/2682929561 <== mon.1 v2:10.20.193.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+24609 (secure 0 0 0) 0x7f4ffc066890 con 0x7f50080c92f0 2026-02-17T12:01:05.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.333+0000 7f4ff67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:01:05.335 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.333+0000 7f4ff67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:05.336 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:01:05.336 INFO:teuthology.orchestra.run.trial010.stdout:{"epoch":35,"fsid":"e6846c4e-39d4-4411-a0f7-efd9dc941974","created":"2026-02-17T11:54:00.988490+0000","modified":"2026-02-17T11:56:04.806371+0000","last_up_change":"2026-02-17T11:55:49.992320+0000","last_in_change":"2026-02-17T11:54:07.442553+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:55:41.943431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:55:53.205060+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"482785ad-8055-4bcf-9dbe-dab7f981cdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6826","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6827","nonce":311345990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6828","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6829","nonce":311345990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6832","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6833","nonce":311345990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6830","nonce":311345990},{"type":"v1","addr":"10.20.193.10:6831","nonce":311345990}]},"public_addr":"10.20.193.10:6827/311345990","cluster_addr":"10.20.193.10:6829/311345990","heartbeat_back_addr":"10.20.193.10:6833/311345990","heartbeat_front_addr":"10.20.193.10:6831/311345990","state":["exists","up"]},{"osd":1,"uuid":"b7e7bb47-4367-42c9-b270-1d89a95aa623","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6808","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6809","nonce":168831009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6810","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6811","nonce":168831009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6814","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6815","nonce":168831009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6812","nonce":168831009},{"type":"v1","addr":"10.20.193.71:6813","nonce":168831009}]},"public_addr":"10.20.193.71:6809/168831009","cluster_addr":"10.20.193.71:6811/168831009","heartbeat_back_addr":"10.20.193.71:6815/168831009","heartbeat_front_addr":"10.20.193.71:6813/168831009","state":["exists","up"]},{"osd":2,"uuid":"0fce833d-0717-49d4-bb32-03b00db04b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6817","nonce":4180566480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6819","nonce":4180566480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6823","nonce":4180566480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4180566480},{"type":"v1","addr":"10.20.193.153:6821","nonce":4180566480}]},"public_addr":"10.20.193.153:6817/4180566480","cluster_addr":"10.20.193.153:6819/4180566480","heartbeat_back_addr":"10.20.193.153:6823/4180566480","heartbeat_front_addr":"10.20.193.153:6821/4180566480","state":["exists","up"]},{"osd":3,"uuid":"1ad8c0ab-f8b5-4f10-bf2c-6115d87bc308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6816","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6817","nonce":2117394394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6818","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6819","nonce":2117394394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6822","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6823","nonce":2117394394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6820","nonce":2117394394},{"type":"v1","addr":"10.20.193.174:6821","nonce":2117394394}]},"public_addr":"10.20.193.174:6817/2117394394","cluster_addr":"10.20.193.174:6819/2117394394","heartbeat_back_addr":"10.20.193.174:6823/2117394394","heartbeat_front_addr":"10.20.193.174:6821/2117394394","state":["exists","up"]},{"osd":4,"uuid":"00e2ed99-4b2a-4a76-a0fd-c801a3cdb5df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6810","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6811","nonce":4049638616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6812","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6813","nonce":4049638616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6816","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6817","nonce":4049638616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6814","nonce":4049638616},{"type":"v1","addr":"10.20.193.10:6815","nonce":4049638616}]},"public_addr":"10.20.193.10:6811/4049638616","cluster_addr":"10.20.193.10:6813/4049638616","heartbeat_back_addr":"10.20.193.10:6817/4049638616","heartbeat_front_addr":"10.20.193.10:6815/4049638616","state":["exists","up"]},{"osd":5,"uuid":"dcc94db0-1519-4aab-9197-6b1f5899aed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6816","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6817","nonce":1474787626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6818","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6819","nonce":1474787626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6822","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6823","nonce":1474787626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6820","nonce":1474787626},{"type":"v1","addr":"10.20.193.71:6821","nonce":1474787626}]},"public_addr":"10.20.193.71:6817/1474787626","cluster_addr":"10.20.193.71:6819/1474787626","heartbeat_back_addr":"10.20.193.71:6823/1474787626","heartbeat_front_addr":"10.20.193.71:6821/1474787626","state":["exists","up"]},{"osd":6,"uuid":"0a7bc116-9ef2-4d90-814d-a0696ce39061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6824","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6825","nonce":3203696878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6826","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6827","nonce":3203696878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6830","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6831","nonce":3203696878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6828","nonce":3203696878},{"type":"v1","addr":"10.20.193.153:6829","nonce":3203696878}]},"public_addr":"10.20.193.153:6825/3203696878","cluster_addr":"10.20.193.153:6827/3203696878","heartbeat_back_addr":"10.20.193.153:6831/3203696878","heartbeat_front_addr":"10.20.193.153:6829/3203696878","state":["exists","up"]},{"osd":7,"uuid":"9e17de9b-371b-4026-bc9b-4e78fec69fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6808","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6809","nonce":561251262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6810","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6811","nonce":561251262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6814","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6815","nonce":561251262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6812","nonce":561251262},{"type":"v1","addr":"10.20.193.174:6813","nonce":561251262}]},"public_addr":"10.20.193.174:6809/561251262","cluster_addr":"10.20.193.174:6811/561251262","heartbeat_back_addr":"10.20.193.174:6815/561251262","heartbeat_front_addr":"10.20.193.174:6813/561251262","state":["exists","up"]},{"osd":8,"uuid":"14df3312-ffe0-4f33-a7ba-99e0d5be5c4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6818","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6819","nonce":1997295941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6820","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6821","nonce":1997295941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6824","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6825","nonce":1997295941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6822","nonce":1997295941},{"type":"v1","addr":"10.20.193.10:6823","nonce":1997295941}]},"public_addr":"10.20.193.10:6819/1997295941","cluster_addr":"10.20.193.10:6821/1997295941","heartbeat_back_addr":"10.20.193.10:6825/1997295941","heartbeat_front_addr":"10.20.193.10:6823/1997295941","state":["exists","up"]},{"osd":9,"uuid":"560b59a5-3dbd-4d78-9e91-9901e6279b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6800","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6801","nonce":1369683666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6802","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6803","nonce":1369683666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6806","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6807","nonce":1369683666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6804","nonce":1369683666},{"type":"v1","addr":"10.20.193.71:6805","nonce":1369683666}]},"public_addr":"10.20.193.71:6801/1369683666","cluster_addr":"10.20.193.71:6803/1369683666","heartbeat_back_addr":"10.20.193.71:6807/1369683666","heartbeat_front_addr":"10.20.193.71:6805/1369683666","state":["exists","up"]},{"osd":10,"uuid":"aee1b762-3d01-4115-bd92-a25c7afec8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6800","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6801","nonce":22479275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6802","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6803","nonce":22479275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6806","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6807","nonce":22479275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6804","nonce":22479275},{"type":"v1","addr":"10.20.193.153:6805","nonce":22479275}]},"public_addr":"10.20.193.153:6801/22479275","cluster_addr":"10.20.193.153:6803/22479275","heartbeat_back_addr":"10.20.193.153:6807/22479275","heartbeat_front_addr":"10.20.193.153:6805/22479275","state":["exists","up"]},{"osd":11,"uuid":"8b001f4d-596c-4631-b515-9aec2693c1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6800","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6801","nonce":4034633078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6802","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6803","nonce":4034633078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6806","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6807","nonce":4034633078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6804","nonce":4034633078},{"type":"v1","addr":"10.20.193.174:6805","nonce":4034633078}]},"public_addr":"10.20.193.174:6801/4034633078","cluster_addr":"10.20.193.174:6803/4034633078","heartbeat_back_addr":"10.20.193.174:6807/4034633078","heartbeat_front_addr":"10.20.193.174:6805/4034633078","state":["exists","up"]},{"osd":12,"uuid":"da87b3aa-2536-4e8c-8da7-c8f87f630ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6802","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6803","nonce":2920105256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6804","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6805","nonce":2920105256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6808","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6809","nonce":2920105256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.10:6806","nonce":2920105256},{"type":"v1","addr":"10.20.193.10:6807","nonce":2920105256}]},"public_addr":"10.20.193.10:6803/2920105256","cluster_addr":"10.20.193.10:6805/2920105256","heartbeat_back_addr":"10.20.193.10:6809/2920105256","heartbeat_front_addr":"10.20.193.10:6807/2920105256","state":["exists","up"]},{"osd":13,"uuid":"47edcc4b-fb7d-4437-8e7b-8a121bd5bd14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6824","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6825","nonce":1119039635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6826","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6827","nonce":1119039635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6830","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6831","nonce":1119039635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.71:6828","nonce":1119039635},{"type":"v1","addr":"10.20.193.71:6829","nonce":1119039635}]},"public_addr":"10.20.193.71:6825/1119039635","cluster_addr":"10.20.193.71:6827/1119039635","heartbeat_back_addr":"10.20.193.71:6831/1119039635","heartbeat_front_addr":"10.20.193.71:6829/1119039635","state":["exists","up"]},{"osd":14,"uuid":"ac2266e7-8a26-458a-b92f-ce0ffe2653eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6808","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6809","nonce":3794015163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6810","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6811","nonce":3794015163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6814","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6815","nonce":3794015163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6812","nonce":3794015163},{"type":"v1","addr":"10.20.193.153:6813","nonce":3794015163}]},"public_addr":"10.20.193.153:6809/3794015163","cluster_addr":"10.20.193.153:6811/3794015163","heartbeat_back_addr":"10.20.193.153:6815/3794015163","heartbeat_front_addr":"10.20.193.153:6813/3794015163","state":["exists","up"]},{"osd":15,"uuid":"8c03b537-2fae-4904-8422-b083b92f2dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6824","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6825","nonce":3564494722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6826","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6827","nonce":3564494722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6830","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6831","nonce":3564494722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.174:6828","nonce":3564494722},{"type":"v1","addr":"10.20.193.174:6829","nonce":3564494722}]},"public_addr":"10.20.193.174:6825/3564494722","cluster_addr":"10.20.193.174:6827/3564494722","heartbeat_back_addr":"10.20.193.174:6831/3564494722","heartbeat_front_addr":"10.20.193.174:6829/3564494722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.360736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.381048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.960607+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:42.224431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.663427+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.986296+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.607032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.107139+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:38.853441+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.425353+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:40.674962+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.372465+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:39.295380+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.299793+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:41.045566+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:55:42.253940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:01:05.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 10 librados: watch_flush enter 2026-02-17T12:01:05.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 10 librados: watch_flush exit 2026-02-17T12:01:05.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 20 client.5116.objecter shutdown clearing up homeless session... 2026-02-17T12:01:05.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 10 client.5116.objecter successfully canceled tick 2026-02-17T12:01:05.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4fd8078e00 msgr2=0x7f4fd807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4fd8078e00 0x7f4fd807b2c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8002770 tx=0x7f4ff8007f40 comp rx=0 tx=0).stop 2026-02-17T12:01:05.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 10 monclient: shutdown 2026-02-17T12:01:05.338 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f50080c92f0 msgr2=0x7f500814aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.334+0000 7f50100b8640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f50080c92f0 0x7f500814aff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00ebe0 tx=0x7f4ffc00c520 comp rx=0 tx=0).stop 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.335+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 shutdown_connections 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.335+0000 7f50100b8640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4fd8078e00 0x7f4fd807b2c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.335+0000 7f50100b8640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f500815d220 0x7f50081f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.335+0000 7f50100b8640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f50080c92f0 0x7f500814aff0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.335+0000 7f50100b8640 1 --2- 10.20.193.10:0/2682929561 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5008074920 0x7f500814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.335+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 >> 10.20.193.10:0/2682929561 conn(0x7f50080c9d80 msgr2=0x7f500806b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.335+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 shutdown_connections 2026-02-17T12:01:05.339 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.335+0000 7f50100b8640 1 -- 10.20.193.10:0/2682929561 wait complete. 2026-02-17T12:01:05.340 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:05.335+0000 7f50100b8640 1 librados: shutdown 2026-02-17T12:01:06.347 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T12:01:06.347 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:06.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.416+0000 7f4765af2640 10 monclient: get_monmap_and_config 2026-02-17T12:01:06.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.416+0000 7f4765af2640 10 monclient: build_initial_monmap 2026-02-17T12:01:06.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.416+0000 7f4765af2640 10 monclient: monmap: 2026-02-17T12:01:06.418 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:06.418 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.418 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:06.417800+0000 2026-02-17T12:01:06.418 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:06.417800+0000 2026-02-17T12:01:06.418 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:06.419 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.419 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:06.419 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:06.419 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:06.419 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:06.419 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:06.419 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:06.419 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.416+0000 7f4765af2640 1 Processor -- start 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 1 -- start start 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 10 monclient: init 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 10 monclient: _add_conns ranks=[2,0,1,4,5,3] 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4760150300 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47601506e0 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f47600c4780 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47600c55e0 con 0x7f47601506e0 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47600c5300 con 0x7f47600c4780 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4760159c80 con 0x7f4760150300 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:06.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.417+0000 7f4765af2640 10 monclient(hunting): authenticate will time out at 1336.139552s 2026-02-17T12:01:06.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.418+0000 7f475effd640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f47601506e0 0x7f476015d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44786/0 (socket says 10.20.193.10:44786) 2026-02-17T12:01:06.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.418+0000 7f475effd640 1 -- 10.20.193.10:0/2959916785 learned_addr learned my addr 10.20.193.10:0/2959916785 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:06.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100531714 0 0) 0x7f4750002920 con 0x7f47601506e0 2026-02-17T12:01:06.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): _negotiate 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): my global_id is 5091 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4744003620 con 0x7f47601506e0 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173414047 0 0) 0x7f47600c5300 con 0x7f47600c4780 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): _negotiate 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): my global_id is 5119 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4750002920 con 0x7f47600c4780 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2187988363 0 0) 0x7f4760159c80 con 0x7f4760150300 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): _negotiate 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 10 monclient(hunting): my global_id is 5141 2026-02-17T12:01:06.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.419+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47600c5300 con 0x7f4760150300 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 <== mon.0 v1:10.20.193.10:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1790611349 0 0) 0x7f4744003620 con 0x7f47601506e0 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 >> v1:10.20.193.153:6789/0 conn(0x7f4760150300 legacy=0x7f476006fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 >> v1:10.20.193.71:6789/0 conn(0x7f47600c4780 legacy=0x7f47600c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.10:6789/0 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 --> v1:10.20.193.10:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4760159f60 con 0x7f47601506e0 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 <== mon.0 v1:10.20.193.10:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7f47500030d0 con 0x7f47601506e0 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient: dump: 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.424 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] but i'm connected to v1:10.20.193.10:6789/0, reconnecting 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 >> v1:10.20.193.10:6789/0 conn(0x7f47601506e0 legacy=0x7f476015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4744003fe0 0x7f4744004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient(hunting): picked mon.a con 0x7f4744003fe0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4744004e40 0x7f47440052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient(hunting): picked mon.c con 0x7f4744004e40 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f474400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient(hunting): picked mon.b con 0x7f4744009ab0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f474400c490 con 0x7f4744003fe0 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f474400c640 con 0x7f4744009ab0 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f474400c840 con 0x7f4744004e40 2026-02-17T12:01:06.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:06.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.421+0000 7f475e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:01:06.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475effd640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4744004e40 0x7f47440052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.426 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475ffff640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f474400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475f7fe640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4744003fe0 0x7f4744004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475effd640 10 monclient(hunting): get_auth_request con 0x7f4744004e40 auth_method 0 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475effd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475ffff640 10 monclient(hunting): get_auth_request con 0x7f4744009ab0 auth_method 0 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475ffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:06.427 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475f7fe640 10 monclient(hunting): get_auth_request con 0x7f4744003fe0 auth_method 0 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.422+0000 7f475f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.423+0000 7f475f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.423+0000 7f475f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.423+0000 7f475f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.423+0000 7f475ffff640 10 monclient(hunting): handle_auth_done global_id 5091 payload 293 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.423+0000 7f475ffff640 1 -- 10.20.193.10:0/2959916785 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4744004e40 msgr2=0x7f47440052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.423+0000 7f475ffff640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4744004e40 0x7f47440052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 1 -- 10.20.193.10:0/2959916785 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4744003fe0 msgr2=0x7f4744004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f4744003fe0 0x7f4744004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 1 monclient: found mon.b 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 1 -- 10.20.193.10:0/2959916785 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4744003620 con 0x7f4744009ab0 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f4765af2640 5 monclient: authenticate success, global_id 5091 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f4765af2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 1 -- 10.20.193.10:0/2959916785 reap_dead start 2026-02-17T12:01:06.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.424+0000 7f475ffff640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f474400bea0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f475400c320 tx=0x7f475402f630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=967653730aea5e1f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47540038d0 con 0x7f4744009ab0 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 10 monclient: dump: 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f4765af2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4754003c70 con 0x7f4744009ab0 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 1 -- 10.20.193.10:0/2959916785 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754005310 con 0x7f4744009ab0 2026-02-17T12:01:06.431 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f475e7fc640 10 monclient: dump: 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f4765af2640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f4765af2640 4 set_mon_vals no callback set 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.426+0000 7f4765af2640 10 monclient: shutdown 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 -- 10.20.193.10:0/2959916785 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 msgr2=0x7f474400bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f474400bea0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f475400c320 tx=0x7f475402f630 comp rx=0 tx=0).stop 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 -- 10.20.193.10:0/2959916785 shutdown_connections 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 --2- 10.20.193.10:0/2959916785 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f474400bea0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 -- 10.20.193.10:0/2959916785 >> 10.20.193.10:0/2959916785 conn(0x7f47600cd560 msgr2=0x7f47600cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 -- 10.20.193.10:0/2959916785 shutdown_connections 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 -- 10.20.193.10:0/2959916785 wait complete. 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 10 monclient: build_initial_monmap 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 10 monclient: monmap: 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:06.432 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 librados: starting msgr at 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 librados: starting objecter 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 Processor -- start 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 -- start start 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 librados: setting wanted keys 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 1 librados: calling monclient init 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.427+0000 7f4765af2640 10 monclient: init 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f47601f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient(hunting): picked mon.noname-b con 0x7f4744009ab0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f47600bfe90 0x7f47601f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient(hunting): picked mon.noname-c con 0x7f47600bfe90 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f47601f66a0 0x7f47601f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient(hunting): picked mon.noname-a con 0x7f47601f66a0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f47600c4bf0 con 0x7f47601f66a0 2026-02-17T12:01:06.433 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f476015a520 con 0x7f4744009ab0 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f47600c4d70 con 0x7f47600bfe90 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f4765af2640 10 monclient(hunting): authenticate will time out at 1336.150420s 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475ffff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f47601f66a0 0x7f47601f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475f7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f47601f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475effd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f47600bfe90 0x7f47601f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475f7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f47601f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59362/0 (socket says 10.20.193.10:59362) 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475f7fe640 1 -- 10.20.193.10:0/1122814151 learned_addr learned my addr 10.20.193.10:0/1122814151 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475f7fe640 10 monclient(hunting): get_auth_request con 0x7f4744009ab0 auth_method 0 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475ffff640 10 monclient(hunting): get_auth_request con 0x7f47601f66a0 auth_method 0 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.428+0000 7f475ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475effd640 10 monclient(hunting): get_auth_request con 0x7f47600bfe90 auth_method 0 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.429+0000 7f475effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 10 monclient(hunting): handle_auth_done global_id 5122 payload 824 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 1 -- 10.20.193.10:0/1122814151 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f47600bfe90 msgr2=0x7f47601f7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f47600bfe90 0x7f47601f7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 1 -- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f47601f66a0 msgr2=0x7f47601f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f47601f66a0 0x7f47601f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 1 monclient: found mon.noname-b 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.430+0000 7f475f7fe640 1 -- 10.20.193.10:0/1122814151 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47601f80b0 con 0x7f4744009ab0 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.431+0000 7f475f7fe640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f47601f5110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f474c00ec20 tx=0x7f474c00c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.431+0000 7f473bfff640 10 client.?.objecter ms_handle_connect 0x7f4744009ab0 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.431+0000 7f473bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f473bfff640 1 -- 10.20.193.10:0/1122814151 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c00ee40 con 0x7f4744009ab0 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f473bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f473bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f473bfff640 10 monclient: dump: 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.436 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f473bfff640 10 monclient: _finish_auth 0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f473bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f473bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 5 monclient: authenticate success, global_id 5122 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 10 monclient: _renew_subs 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47601f4b60 con 0x7f4744009ab0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 10 client.5122.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 10 monclient: _renew_subs 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47600bf0d0 con 0x7f4744009ab0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 1 librados: init done 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 10 client.5122.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 15 client.5122.objecter _session_command_op_assign -1 1 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 20 client.5122.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 10 client.5122.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.432+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f476006fe00 con 0x7f4744009ab0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.433+0000 7f473bfff640 1 -- 10.20.193.10:0/1122814151 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476006fe00 con 0x7f4744009ab0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.433+0000 7f473bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.433+0000 7f473bfff640 1 -- 10.20.193.10:0/1122814151 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c00cce0 con 0x7f4744009ab0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.433+0000 7f473bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.433+0000 7f473bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.433+0000 7f475dffb640 4 set_mon_vals no callback set 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.433+0000 7f473bfff640 10 monclient: dump: 2026-02-17T12:01:06.437 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.438 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.438 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.438 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.438 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.438 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.438 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.438 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.438 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.438 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.445+0000 7f473bfff640 1 -- 10.20.193.10:0/1122814151 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f474c014070 con 0x7f4744009ab0 2026-02-17T12:01:06.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.445+0000 7f473bfff640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4730078e30 0x7f473007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.446+0000 7f475effd640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4730078e30 0x7f473007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.446+0000 7f475effd640 10 monclient: get_auth_request con 0x7f4730078e30 auth_method 0 2026-02-17T12:01:06.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.446+0000 7f473bfff640 10 client.5122.objecter ms_handle_connect 0x7f4730078e30 2026-02-17T12:01:06.447 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.446+0000 7f475effd640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4730078e30 0x7f473007b2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f47600c0ea0 tx=0x7f4750007aa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.447+0000 7f473bfff640 1 -- 10.20.193.10:0/1122814151 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f474c097b50 con 0x7f4744009ab0 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.447+0000 7f473bfff640 10 client.5122.objecter ms_dispatch2 0x7f4760000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.447+0000 7f473bfff640 3 client.5122.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.447+0000 7f473bfff640 3 client.5122.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 10 client.5122.objecter checking command 1 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7f4730081310 0x7f4730083730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 20 client.5122.objecter _get_session s=0x7f4730080c40 osd=0 3 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 20 client.5122.objecter put_session s=0x7f4730080c40 osd=0 3 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 15 client.5122.objecter _session_command_op_remove -1 1 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 20 client.5122.objecter _get_session s=0x7f4730080c40 osd=0 3 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 20 client.5122.objecter get_session s=0x7f4730080c40 osd=0 3 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 15 client.5122.objecter _session_command_op_assign 0 1 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 20 client.5122.objecter put_session s=0x7f4730080c40 osd=0 4 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 10 client.5122.objecter _send_command 1 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 1 -- 10.20.193.10:0/1122814151 --> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f474c028e50 con 0x7f4730081310 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 20 client.5122.objecter dump_active .. 0 homeless 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 1 -- 10.20.193.10:0/1122814151 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f474c05e590 con 0x7f4744009ab0 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f473bfff640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:06.450 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f475ffff640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7f4730081310 0x7f4730083730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.448+0000 7f475ffff640 10 monclient: get_auth_request con 0x7f4730081310 auth_method 0 2026-02-17T12:01:06.451 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.450+0000 7f473bfff640 10 client.5122.objecter ms_handle_connect 0x7f4730081310 2026-02-17T12:01:06.452 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.450+0000 7f475ffff640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7f4730081310 0x7f4730083730 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.460+0000 7f473bfff640 1 -- 10.20.193.10:0/1122814151 <== osd.0 v2:10.20.193.10:6826/311345990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f474c028e50 con 0x7f4730081310 2026-02-17T12:01:06.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.460+0000 7f473bfff640 10 client.5122.objecter ms_dispatch2 0x7f4760000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:06.461 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.460+0000 7f473bfff640 10 client.5122.objecter _finish_command 1 = system:0 2026-02-17T12:01:06.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.460+0000 7f473bfff640 20 client.5122.objecter put_session s=0x7f4730080c40 osd=0 4 2026-02-17T12:01:06.462 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.460+0000 7f473bfff640 15 client.5122.objecter _session_command_op_remove 0 1 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 10 client.5122.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 15 client.5122.objecter _session_command_op_assign -1 2 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 20 client.5122.objecter _get_session s=0x7f4730080c40 osd=0 3 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 20 client.5122.objecter put_session s=0x7f4730080c40 osd=0 3 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 20 client.5122.objecter _get_session s=0x7f4730080c40 osd=0 3 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 15 client.5122.objecter _session_command_op_remove -1 2 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 20 client.5122.objecter get_session s=0x7f4730080c40 osd=0 3 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 15 client.5122.objecter _session_command_op_assign 0 2 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 20 client.5122.objecter put_session s=0x7f4730080c40 osd=0 4 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 10 client.5122.objecter _send_command 2 2026-02-17T12:01:06.468 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.466+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 --> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f47600c9650 con 0x7f4730081310 2026-02-17T12:01:06.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.472+0000 7f473bfff640 1 -- 10.20.193.10:0/1122814151 <== osd.0 v2:10.20.193.10:6826/311345990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f47600c9650 con 0x7f4730081310 2026-02-17T12:01:06.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.472+0000 7f473bfff640 10 client.5122.objecter ms_dispatch2 0x7f4760000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:06.474 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.472+0000 7f473bfff640 10 client.5122.objecter _finish_command 2 = system:0 2026-02-17T12:01:06.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.472+0000 7f473bfff640 20 client.5122.objecter put_session s=0x7f4730080c40 osd=0 4 2026-02-17T12:01:06.475 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.472+0000 7f473bfff640 15 client.5122.objecter _session_command_op_remove 0 2 2026-02-17T12:01:06.475 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:06.475 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:06.475 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:06.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 10 librados: watch_flush enter 2026-02-17T12:01:06.476 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 10 librados: watch_flush exit 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 10 client.5122.objecter close_session for osd.0 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7f4730081310 msgr2=0x7f4730083730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6826/311345990,v1:10.20.193.10:6827/311345990] conn(0x7f4730081310 0x7f4730083730 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 20 client.5122.objecter put_session s=0x7f4730080c40 osd=0 1 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 20 client.5122.objecter shutdown clearing up homeless session... 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 10 client.5122.objecter successfully canceled tick 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4730078e30 msgr2=0x7f473007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4730078e30 0x7f473007b2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f47600c0ea0 tx=0x7f4750007aa0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 10 monclient: shutdown 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 msgr2=0x7f47601f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 --2- 10.20.193.10:0/1122814151 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f4744009ab0 0x7f47601f5110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f474c00ec20 tx=0x7f474c00c4b0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f475ffff640 1 -- 10.20.193.10:0/1122814151 reap_dead start 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 shutdown_connections 2026-02-17T12:01:06.477 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 >> 10.20.193.10:0/1122814151 conn(0x7f47600cd560 msgr2=0x7f47600c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:06.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 shutdown_connections 2026-02-17T12:01:06.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 -- 10.20.193.10:0/1122814151 wait complete. 2026-02-17T12:01:06.478 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.473+0000 7f4765af2640 1 librados: shutdown 2026-02-17T12:01:06.483 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T12:01:06.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.551+0000 7f179a05b640 10 monclient: get_monmap_and_config 2026-02-17T12:01:06.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.551+0000 7f179a05b640 10 monclient: build_initial_monmap 2026-02-17T12:01:06.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.551+0000 7f179a05b640 10 monclient: monmap: 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:06.552368+0000 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:06.552368+0000 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:06.554 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:06.555 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.551+0000 7f179a05b640 1 Processor -- start 2026-02-17T12:01:06.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.551+0000 7f179a05b640 1 -- start start 2026-02-17T12:01:06.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.551+0000 7f179a05b640 10 monclient: init 2026-02-17T12:01:06.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:06.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 10 monclient: _add_conns ranks=[4,3,0,1,5,2] 2026-02-17T12:01:06.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1794152660 0x7f179415a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 10 monclient(hunting): picked mon.noname-b con 0x7f1794152660 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f1794152a40 0x7f179415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 10 monclient(hunting): picked mon.noname-a con 0x7f1794152a40 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f17940c8dd0 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17940c71e0 con 0x7f17940c8dd0 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f17940c77a0 con 0x7f1794152a40 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f17940c74c0 con 0x7f1794152660 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f179a05b640 10 monclient(hunting): authenticate will time out at 1336.274152s 2026-02-17T12:01:06.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f1792ffd640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f1794152a40 0x7f179415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f17937fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1794152660 0x7f179415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f17937fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f1794152660 0x7f179415a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59364/0 (socket says 10.20.193.10:59364) 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f17937fe640 1 -- 10.20.193.10:0/2932370885 learned_addr learned my addr 10.20.193.10:0/2932370885 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f17937fe640 10 monclient(hunting): get_auth_request con 0x7f1794152660 auth_method 0 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f17937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f17937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f17937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f1792ffd640 10 monclient(hunting): get_auth_request con 0x7f1794152a40 auth_method 0 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f1792ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f1792ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.552+0000 7f1792ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f1792ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f1792ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f1792ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 10 monclient(hunting): handle_auth_done global_id 5125 payload 274 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 1 -- 10.20.193.10:0/2932370885 >> v2:10.20.193.10:3300/0 conn(0x7f1794152a40 msgr2=0x7f179415ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 1 --2- 10.20.193.10:0/2932370885 >> v2:10.20.193.10:3300/0 conn(0x7f1794152a40 0x7f179415ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 1 -- 10.20.193.10:0/2932370885 >> v1:10.20.193.10:6789/0 conn(0x7f17940c8dd0 legacy=0x7f17940c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 1 monclient: found mon.noname-b 2026-02-17T12:01:06.560 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:06.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.553+0000 7f17937fe640 1 -- 10.20.193.10:0/2932370885 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1794159e40 con 0x7f1794152660 2026-02-17T12:01:06.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.554+0000 7f17937fe640 1 --2- 10.20.193.10:0/2932370885 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1794152660 0x7f179415a920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f17941563f0 tx=0x7f178002eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bafda04bd65a06f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 1 -- 10.20.193.10:0/2932370885 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178003c070 con 0x7f1794152660 2026-02-17T12:01:06.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.567 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 10 monclient: dump: 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.568 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 1 -- 10.20.193.10:0/2932370885 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178002fb20 con 0x7f1794152660 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 5 monclient: authenticate success, global_id 5125 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 1 -- 10.20.193.10:0/2932370885 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780037440 con 0x7f1794152660 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 4 set_mon_vals no callback set 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.569 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f17927fc640 10 monclient: dump: 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.570 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 10 monclient: shutdown 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 1 -- 10.20.193.10:0/2932370885 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1794152660 msgr2=0x7f179415a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 1 --2- 10.20.193.10:0/2932370885 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1794152660 0x7f179415a920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f17941563f0 tx=0x7f178002eeb0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 1 -- 10.20.193.10:0/2932370885 shutdown_connections 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 1 --2- 10.20.193.10:0/2932370885 >> v2:10.20.193.10:3300/0 conn(0x7f1794152a40 0x7f179415ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 1 --2- 10.20.193.10:0/2932370885 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1794152660 0x7f179415a920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 1 -- 10.20.193.10:0/2932370885 >> 10.20.193.10:0/2932370885 conn(0x7f17940c9d80 msgr2=0x7f17940ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 1 -- 10.20.193.10:0/2932370885 shutdown_connections 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.556+0000 7f179a05b640 1 -- 10.20.193.10:0/2932370885 wait complete. 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.557+0000 7f179a05b640 10 monclient: build_initial_monmap 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.557+0000 7f179a05b640 10 monclient: monmap: 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:06.571 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.557+0000 7f179a05b640 1 librados: starting msgr at 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.557+0000 7f179a05b640 1 librados: starting objecter 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.557+0000 7f179a05b640 1 Processor -- start 2026-02-17T12:01:06.572 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.557+0000 7f179a05b640 1 -- start start 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.557+0000 7f179a05b640 1 librados: setting wanted keys 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.557+0000 7f179a05b640 1 librados: calling monclient init 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.557+0000 7f179a05b640 10 monclient: init 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f17940c8dd0 0x7f1794148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient(hunting): picked mon.noname-a con 0x7f17940c8dd0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1794152660 0x7f1794157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient(hunting): picked mon.noname-b con 0x7f1794152660 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1794152a40 0x7f17941f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient(hunting): picked mon.noname-c con 0x7f1794152a40 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.573 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f17940c5cd0 con 0x7f17940c8dd0 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f179415a400 con 0x7f1794152660 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f17940c5e50 con 0x7f1794152a40 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f179a05b640 10 monclient(hunting): authenticate will time out at 1336.280233s 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f17940c8dd0 0x7f1794148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1792ffd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1794152660 0x7f1794157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f17940c8dd0 0x7f1794148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44750/0 (socket says 10.20.193.10:44750) 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 1 -- 10.20.193.10:0/1765506008 learned_addr learned my addr 10.20.193.10:0/1765506008 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:06.574 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 10 monclient(hunting): get_auth_request con 0x7f17940c8dd0 auth_method 0 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1792ffd640 10 monclient(hunting): get_auth_request con 0x7f1794152660 auth_method 0 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1792ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1792ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1792ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1793fff640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1794152a40 0x7f17941f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f17937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1793fff640 10 monclient(hunting): get_auth_request con 0x7f1794152a40 auth_method 0 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1793fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1793fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1793fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1792ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1792ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.558+0000 7f1792ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.559+0000 7f1793fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.559+0000 7f1793fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.559+0000 7f1793fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 10 monclient(hunting): handle_auth_done global_id 5100 payload 824 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 1 -- 10.20.193.10:0/1765506008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1794152a40 msgr2=0x7f17941f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1794152a40 0x7f17941f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.576 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 1 -- 10.20.193.10:0/1765506008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1794152660 msgr2=0x7f1794157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1794152660 0x7f1794157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 1 monclient: found mon.noname-a 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.560+0000 7f17937fe640 1 -- 10.20.193.10:0/1765506008 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1794156ac0 con 0x7f17940c8dd0 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.561+0000 7f17937fe640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f17940c8dd0 0x7f1794148ba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1780009a40 tx=0x7f17800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.561+0000 7f176ffff640 10 client.?.objecter ms_handle_connect 0x7f17940c8dd0 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.561+0000 7f176ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 1 -- 10.20.193.10:0/1765506008 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780044070 con 0x7f17940c8dd0 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.577 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 10 monclient: dump: 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:06.578 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 1 -- 10.20.193.10:0/1765506008 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780040410 con 0x7f17940c8dd0 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f179a05b640 5 monclient: authenticate success, global_id 5100 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f179a05b640 10 monclient: _renew_subs 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f179a05b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1794156da0 con 0x7f17940c8dd0 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 1 -- 10.20.193.10:0/1765506008 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178003c040 con 0x7f17940c8dd0 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f176ffff640 10 monclient: dump: 2026-02-17T12:01:06.579 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f1791ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f179a05b640 10 client.5100.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f179a05b640 10 monclient: _renew_subs 2026-02-17T12:01:06.580 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f179a05b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:06.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1794157360 con 0x7f17940c8dd0 2026-02-17T12:01:06.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.562+0000 7f179a05b640 1 librados: init done 2026-02-17T12:01:06.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.563+0000 7f179a05b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:06.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.563+0000 7f179a05b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:06.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.563+0000 7f179a05b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:06.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.563+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17940c91b0 con 0x7f17940c8dd0 2026-02-17T12:01:06.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.575+0000 7f176ffff640 1 -- 10.20.193.10:0/1765506008 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f178003f050 con 0x7f17940c8dd0 2026-02-17T12:01:06.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.575+0000 7f176ffff640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1764078e50 0x7f176407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.575+0000 7f1792ffd640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1764078e50 0x7f176407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.575+0000 7f1792ffd640 10 monclient: get_auth_request con 0x7f1764078e50 auth_method 0 2026-02-17T12:01:06.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.575+0000 7f176ffff640 10 client.5100.objecter ms_handle_connect 0x7f1764078e50 2026-02-17T12:01:06.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.575+0000 7f1792ffd640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1764078e50 0x7f176407b310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f17941f1700 tx=0x7f1784009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.577+0000 7f176ffff640 1 -- 10.20.193.10:0/1765506008 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f1780082d10 con 0x7f17940c8dd0 2026-02-17T12:01:06.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.577+0000 7f176ffff640 10 client.5100.objecter ms_dispatch2 0x7f1794000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:06.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.577+0000 7f176ffff640 3 client.5100.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:06.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.577+0000 7f176ffff640 3 client.5100.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:06.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.577+0000 7f176ffff640 20 client.5100.objecter dump_active .. 0 homeless 2026-02-17T12:01:06.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.678+0000 7f176ffff640 1 -- 10.20.193.10:0/1765506008 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1780086cd0 con 0x7f17940c8dd0 2026-02-17T12:01:06.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.678+0000 7f176ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:06.680 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.678+0000 7f176ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:06.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.763+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f179415c980 con 0x7f1764078e50 2026-02-17T12:01:06.765 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.763+0000 7f176ffff640 1 -- 10.20.193.10:0/1765506008 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f179415c980 con 0x7f1764078e50 2026-02-17T12:01:06.765 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T12:01:06.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 10 librados: watch_flush enter 2026-02-17T12:01:06.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 10 librados: watch_flush exit 2026-02-17T12:01:06.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 20 client.5100.objecter shutdown clearing up homeless session... 2026-02-17T12:01:06.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 10 client.5100.objecter successfully canceled tick 2026-02-17T12:01:06.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1764078e50 msgr2=0x7f176407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1764078e50 0x7f176407b310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f17941f1700 tx=0x7f1784009290 comp rx=0 tx=0).stop 2026-02-17T12:01:06.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 10 monclient: shutdown 2026-02-17T12:01:06.768 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f17940c8dd0 msgr2=0x7f1794148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f17940c8dd0 0x7f1794148ba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1780009a40 tx=0x7f17800047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 shutdown_connections 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f1764078e50 0x7f176407b310 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1794152a40 0x7f17941f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f1794152660 0x7f1794157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 --2- 10.20.193.10:0/1765506008 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f17940c8dd0 0x7f1794148ba0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 >> 10.20.193.10:0/1765506008 conn(0x7f17940c9d80 msgr2=0x7f179414f300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 shutdown_connections 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 -- 10.20.193.10:0/1765506008 wait complete. 2026-02-17T12:01:06.769 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.765+0000 7f179a05b640 1 librados: shutdown 2026-02-17T12:01:06.776 INFO:tasks.ceph:Scrubbing osd.4 2026-02-17T12:01:06.776 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.846+0000 7fc2c6a0c640 10 monclient: get_monmap_and_config 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.846+0000 7fc2c6a0c640 10 monclient: build_initial_monmap 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.846+0000 7fc2c6a0c640 10 monclient: monmap: 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:06.848068+0000 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:06.848068+0000 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.849 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:06.850 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:06.850 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:06.850 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:06.850 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:06.850 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:06.850 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 1 Processor -- start 2026-02-17T12:01:06.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 1 -- start start 2026-02-17T12:01:06.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 10 monclient: init 2026-02-17T12:01:06.860 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 10 monclient: _add_conns ranks=[0,2,4,1,3,5] 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc2c0150300 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc2c01506e0 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fc2c00c4780 0x7fc2c00c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 10 monclient(hunting): picked mon.noname-b con 0x7fc2c00c4780 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c00c55e0 con 0x7fc2c0150300 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c00c5300 con 0x7fc2c01506e0 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc2c0159c80 con 0x7fc2c00c4780 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:06.861 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.847+0000 7fc2c6a0c640 10 monclient(hunting): authenticate will time out at 1336.569806s 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2bffff640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7fc2c0150300 0x7fc2c006fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44802/0 (socket says 10.20.193.10:44802) 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2bffff640 1 -- 10.20.193.10:0/3171548048 learned_addr learned my addr 10.20.193.10:0/3171548048 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2c4f82640 1 --2- 10.20.193.10:0/3171548048 >> v2:10.20.193.71:3300/0 conn(0x7fc2c00c4780 0x7fc2c00c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2c4f82640 10 monclient(hunting): get_auth_request con 0x7fc2c00c4780 auth_method 0 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2c4f82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2c4f82640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2c4f82640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2c4f82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2c4f82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.848+0000 7fc2c4f82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 1 -- 10.20.193.10:0/3171548048 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2617411944 0 0) 0x7fc2ac002920 con 0x7fc2c0150300 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 10 monclient(hunting): _negotiate 2026-02-17T12:01:06.862 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 10 monclient(hunting): my global_id is 5103 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 1 -- 10.20.193.10:0/3171548048 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2a4003620 con 0x7fc2c0150300 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 1 -- 10.20.193.10:0/3171548048 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164518062 0 0) 0x7fc2c00c5300 con 0x7fc2c01506e0 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 10 monclient(hunting): _negotiate 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 10 monclient(hunting): my global_id is 5150 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2beffd640 1 -- 10.20.193.10:0/3171548048 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2ac002920 con 0x7fc2c01506e0 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2c4f82640 10 monclient(hunting): handle_auth_done global_id 5131 payload 274 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2c4f82640 1 -- 10.20.193.10:0/3171548048 >> v1:10.20.193.153:6789/0 conn(0x7fc2c01506e0 legacy=0x7fc2c015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2c4f82640 1 -- 10.20.193.10:0/3171548048 >> v1:10.20.193.10:6789/0 conn(0x7fc2c0150300 legacy=0x7fc2c006fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2c4f82640 10 monclient: _finish_hunting 0 2026-02-17T12:01:06.863 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2c4f82640 1 monclient: found mon.noname-b 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2c4f82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2c4f82640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.849+0000 7fc2c4f82640 1 -- 10.20.193.10:0/3171548048 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c0159f60 con 0x7fc2c00c4780 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.850+0000 7fc2c4f82640 1 --2- 10.20.193.10:0/3171548048 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 0x7fc2c00c4bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009d90 tx=0x7fc2b402f2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f63d9e84b6341c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.851+0000 7fc2beffd640 1 -- 10.20.193.10:0/3171548048 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b403c070 con 0x7fc2c00c4780 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.851+0000 7fc2beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.851+0000 7fc2beffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.851+0000 7fc2beffd640 10 monclient: dump: 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.864 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.851+0000 7fc2beffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.851+0000 7fc2beffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.851+0000 7fc2beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.851+0000 7fc2c6a0c640 5 monclient: authenticate success, global_id 5131 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.851+0000 7fc2c6a0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:06.865 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2beffd640 1 -- 10.20.193.10:0/3171548048 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b4037440 con 0x7fc2c00c4780 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2beffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2beffd640 1 -- 10.20.193.10:0/3171548048 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b40377f0 con 0x7fc2c00c4780 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2beffd640 10 monclient: dump: 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.866 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 4 set_mon_vals no callback set 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 10 monclient: shutdown 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/3171548048 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 msgr2=0x7fc2c00c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 1 --2- 10.20.193.10:0/3171548048 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 0x7fc2c00c4bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009d90 tx=0x7fc2b402f2c0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/3171548048 shutdown_connections 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 1 --2- 10.20.193.10:0/3171548048 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 0x7fc2c00c4bf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/3171548048 >> 10.20.193.10:0/3171548048 conn(0x7fc2c00cd560 msgr2=0x7fc2c00cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/3171548048 shutdown_connections 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.852+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/3171548048 wait complete. 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient: build_initial_monmap 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient: monmap: 2026-02-17T12:01:06.867 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 librados: starting msgr at 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 librados: starting objecter 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 Processor -- start 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 -- start start 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 librados: setting wanted keys 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 librados: calling monclient init 2026-02-17T12:01:06.868 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient: init 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 0x7fc2c014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient(hunting): picked mon.noname-b con 0x7fc2c00c4780 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc2c0150300 0x7fc2c01e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient(hunting): picked mon.noname-c con 0x7fc2c0150300 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc2c01506e0 0x7fc2c0157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient(hunting): picked mon.noname-a con 0x7fc2c01506e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0070510 con 0x7fc2c01506e0 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c015a520 con 0x7fc2c00c4780 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c015d770 con 0x7fc2c0150300 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:06.869 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2c6a0c640 10 monclient(hunting): authenticate will time out at 1336.575709s 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.853+0000 7fc2bffff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 0x7fc2c014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2c4f82640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc2c01506e0 0x7fc2c0157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bffff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 0x7fc2c014d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59398/0 (socket says 10.20.193.10:59398) 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bffff640 1 -- 10.20.193.10:0/857388744 learned_addr learned my addr 10.20.193.10:0/857388744 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bffff640 10 monclient(hunting): get_auth_request con 0x7fc2c00c4780 auth_method 0 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2c4f82640 10 monclient(hunting): get_auth_request con 0x7fc2c01506e0 auth_method 0 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2c4f82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2c4f82640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2c4f82640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bf7fe640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc2c0150300 0x7fc2c01e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.870 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bf7fe640 10 monclient(hunting): get_auth_request con 0x7fc2c0150300 auth_method 0 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2c4f82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2c4f82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2c4f82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.854+0000 7fc2bf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 10 monclient(hunting): handle_auth_done global_id 5134 payload 824 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 1 -- 10.20.193.10:0/857388744 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc2c0150300 msgr2=0x7fc2c01e53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc2c0150300 0x7fc2c01e53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 1 -- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc2c01506e0 msgr2=0x7fc2c0157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc2c01506e0 0x7fc2c0157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 1 monclient: found mon.noname-b 2026-02-17T12:01:06.871 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.855+0000 7fc2bffff640 1 -- 10.20.193.10:0/857388744 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c01e5930 con 0x7fc2c00c4780 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.856+0000 7fc2bffff640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 0x7fc2c014d0b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00c730 tx=0x7fc2ac00cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.856+0000 7fc2bcff9640 10 client.?.objecter ms_handle_connect 0x7fc2c00c4780 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.856+0000 7fc2bcff9640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2bcff9640 1 -- 10.20.193.10:0/857388744 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac017070 con 0x7fc2c00c4780 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2bcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2bcff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2bcff9640 10 monclient: dump: 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.872 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2bcff9640 10 monclient: _finish_auth 0 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2bcff9640 10 monclient: _check_auth_tickets 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2bcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2c6a0c640 5 monclient: authenticate success, global_id 5134 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2c6a0c640 10 monclient: _renew_subs 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2c6a0c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c01f40c0 con 0x7fc2c00c4780 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2c6a0c640 10 client.5134.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2c6a0c640 10 monclient: _renew_subs 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2c6a0c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c01f4680 con 0x7fc2c00c4780 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.857+0000 7fc2c6a0c640 1 librados: init done 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2c6a0c640 10 client.5134.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2c6a0c640 15 client.5134.objecter _session_command_op_assign -1 1 2026-02-17T12:01:06.873 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2c6a0c640 20 client.5134.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2c6a0c640 10 client.5134.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2c6a0c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2c0070de0 con 0x7fc2c00c4780 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2bcff9640 1 -- 10.20.193.10:0/857388744 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c0070de0 con 0x7fc2c00c4780 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2bcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2bcff9640 1 -- 10.20.193.10:0/857388744 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac021060 con 0x7fc2c00c4780 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2bcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2bcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2be7fc640 4 set_mon_vals no callback set 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.858+0000 7fc2bcff9640 10 monclient: dump: 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.874 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.875 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.875 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.875 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.870+0000 7fc2bcff9640 1 -- 10.20.193.10:0/857388744 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc2ac007070 con 0x7fc2c00c4780 2026-02-17T12:01:06.876 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.870+0000 7fc2bcff9640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc290078e00 0x7fc29007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.870+0000 7fc2bf7fe640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc290078e00 0x7fc29007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.871+0000 7fc2bf7fe640 10 monclient: get_auth_request con 0x7fc290078e00 auth_method 0 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.871+0000 7fc2bcff9640 10 client.5134.objecter ms_handle_connect 0x7fc290078e00 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.871+0000 7fc2bf7fe640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc290078e00 0x7fc29007b2c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0158d80 tx=0x7fc2b0003d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 1 -- 10.20.193.10:0/857388744 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc2ac097330 con 0x7fc2c00c4780 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 10 client.5134.objecter ms_dispatch2 0x7fc2c0000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 3 client.5134.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 3 client.5134.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 10 client.5134.objecter checking command 1 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fc2900812e0 0x7fc290083700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 20 client.5134.objecter _get_session s=0x7fc290080c10 osd=4 3 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 20 client.5134.objecter put_session s=0x7fc290080c10 osd=4 3 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 15 client.5134.objecter _session_command_op_remove -1 1 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 20 client.5134.objecter _get_session s=0x7fc290080c10 osd=4 3 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 20 client.5134.objecter get_session s=0x7fc290080c10 osd=4 3 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 15 client.5134.objecter _session_command_op_assign 4 1 2026-02-17T12:01:06.877 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 20 client.5134.objecter put_session s=0x7fc290080c10 osd=4 4 2026-02-17T12:01:06.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 10 client.5134.objecter _send_command 1 2026-02-17T12:01:06.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 1 -- 10.20.193.10:0/857388744 --> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2ac014ec0 con 0x7fc2900812e0 2026-02-17T12:01:06.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 20 client.5134.objecter dump_active .. 0 homeless 2026-02-17T12:01:06.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 1 -- 10.20.193.10:0/857388744 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc2ac05df00 con 0x7fc2c00c4780 2026-02-17T12:01:06.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2bcff9640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:06.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2c4f82640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fc2900812e0 0x7fc290083700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.872+0000 7fc2c4f82640 10 monclient: get_auth_request con 0x7fc2900812e0 auth_method 0 2026-02-17T12:01:06.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.874+0000 7fc2c4f82640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fc2900812e0 0x7fc290083700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.878 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.874+0000 7fc2bcff9640 10 client.5134.objecter ms_handle_connect 0x7fc2900812e0 2026-02-17T12:01:06.885 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.884+0000 7fc2bcff9640 1 -- 10.20.193.10:0/857388744 <== osd.4 v2:10.20.193.10:6810/4049638616 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc2ac014ec0 con 0x7fc2900812e0 2026-02-17T12:01:06.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.884+0000 7fc2bcff9640 10 client.5134.objecter ms_dispatch2 0x7fc2c0000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:06.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.884+0000 7fc2bcff9640 10 client.5134.objecter _finish_command 1 = system:0 2026-02-17T12:01:06.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.884+0000 7fc2bcff9640 20 client.5134.objecter put_session s=0x7fc290080c10 osd=4 4 2026-02-17T12:01:06.886 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.884+0000 7fc2bcff9640 15 client.5134.objecter _session_command_op_remove 4 1 2026-02-17T12:01:06.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 10 client.5134.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:06.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 15 client.5134.objecter _session_command_op_assign -1 2 2026-02-17T12:01:06.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 20 client.5134.objecter _get_session s=0x7fc290080c10 osd=4 3 2026-02-17T12:01:06.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 20 client.5134.objecter put_session s=0x7fc290080c10 osd=4 3 2026-02-17T12:01:06.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 20 client.5134.objecter _get_session s=0x7fc290080c10 osd=4 3 2026-02-17T12:01:06.892 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 15 client.5134.objecter _session_command_op_remove -1 2 2026-02-17T12:01:06.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 20 client.5134.objecter get_session s=0x7fc290080c10 osd=4 3 2026-02-17T12:01:06.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 15 client.5134.objecter _session_command_op_assign 4 2 2026-02-17T12:01:06.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 20 client.5134.objecter put_session s=0x7fc290080c10 osd=4 4 2026-02-17T12:01:06.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 10 client.5134.objecter _send_command 2 2026-02-17T12:01:06.893 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.890+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 --> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc2c014db20 con 0x7fc2900812e0 2026-02-17T12:01:06.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2bcff9640 1 -- 10.20.193.10:0/857388744 <== osd.4 v2:10.20.193.10:6810/4049638616 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc2c014db20 con 0x7fc2900812e0 2026-02-17T12:01:06.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2bcff9640 10 client.5134.objecter ms_dispatch2 0x7fc2c0000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:06.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2bcff9640 10 client.5134.objecter _finish_command 2 = system:0 2026-02-17T12:01:06.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2bcff9640 20 client.5134.objecter put_session s=0x7fc290080c10 osd=4 4 2026-02-17T12:01:06.900 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2bcff9640 15 client.5134.objecter _session_command_op_remove 4 2 2026-02-17T12:01:06.901 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:06.901 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:06.901 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:06.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 10 librados: watch_flush enter 2026-02-17T12:01:06.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 10 librados: watch_flush exit 2026-02-17T12:01:06.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 10 client.5134.objecter close_session for osd.4 2026-02-17T12:01:06.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fc2900812e0 msgr2=0x7fc290083700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6810/4049638616,v1:10.20.193.10:6811/4049638616] conn(0x7fc2900812e0 0x7fc290083700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 20 client.5134.objecter put_session s=0x7fc290080c10 osd=4 1 2026-02-17T12:01:06.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 20 client.5134.objecter shutdown clearing up homeless session... 2026-02-17T12:01:06.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 10 client.5134.objecter successfully canceled tick 2026-02-17T12:01:06.903 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc290078e00 msgr2=0x7fc29007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc290078e00 0x7fc29007b2c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0158d80 tx=0x7fc2b0003d50 comp rx=0 tx=0).stop 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 10 monclient: shutdown 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 msgr2=0x7fc2c014d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 --2- 10.20.193.10:0/857388744 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc2c00c4780 0x7fc2c014d0b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00c730 tx=0x7fc2ac00cc00 comp rx=0 tx=0).stop 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c4f82640 1 -- 10.20.193.10:0/857388744 reap_dead start 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 shutdown_connections 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 >> 10.20.193.10:0/857388744 conn(0x7fc2c00cd560 msgr2=0x7fc2c014dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 shutdown_connections 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 -- 10.20.193.10:0/857388744 wait complete. 2026-02-17T12:01:06.904 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.898+0000 7fc2c6a0c640 1 librados: shutdown 2026-02-17T12:01:06.908 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-17T12:01:06.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.974+0000 7f6668961640 10 monclient: get_monmap_and_config 2026-02-17T12:01:06.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.974+0000 7f6668961640 10 monclient: build_initial_monmap 2026-02-17T12:01:06.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.974+0000 7f6668961640 10 monclient: monmap: 2026-02-17T12:01:06.977 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:06.977 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.977 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:06.976019+0000 2026-02-17T12:01:06.977 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:06.976019+0000 2026-02-17T12:01:06.977 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 1 Processor -- start 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 1 -- start start 2026-02-17T12:01:06.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient: init 2026-02-17T12:01:06.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:06.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient: _add_conns ranks=[3,4,1,5,0,2] 2026-02-17T12:01:06.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f666015d220 0x7f666015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient(hunting): picked mon.noname-a con 0x7f666015d220 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:06.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6660074920 0x7f66600c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient(hunting): picked mon.noname-b con 0x7f6660074920 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:06.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f66600c9120 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66600c95b0 con 0x7f66600c9120 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f66600c58a0 con 0x7f666015d220 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f66600c55c0 con 0x7f6660074920 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.975+0000 7f6668961640 10 monclient(hunting): authenticate will time out at 1336.697756s 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f66666d6640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f666015d220 0x7f666015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6665ed5640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6660074920 0x7f66600c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6666ed7640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f66600c9120 0x7f6660153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37730/0 (socket says 10.20.193.10:37730) 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6666ed7640 1 -- 10.20.193.10:0/1775349802 learned_addr learned my addr 10.20.193.10:0/1775349802 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:06.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6665ed5640 10 monclient(hunting): get_auth_request con 0x7f6660074920 auth_method 0 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6665ed5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6665ed5640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6665ed5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f66666d6640 10 monclient(hunting): get_auth_request con 0x7f666015d220 auth_method 0 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f66666d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f66666d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f66666d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f66666d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f66666d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f66666d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6665ed5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:06.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6665ed5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.976+0000 7f6665ed5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.977+0000 7f66666d6640 10 monclient(hunting): handle_auth_done global_id 5109 payload 274 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.977+0000 7f66666d6640 1 -- 10.20.193.10:0/1775349802 >> v2:10.20.193.71:3300/0 conn(0x7f6660074920 msgr2=0x7f66600c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.977+0000 7f66666d6640 1 --2- 10.20.193.10:0/1775349802 >> v2:10.20.193.71:3300/0 conn(0x7f6660074920 0x7f66600c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.977+0000 7f66666d6640 1 -- 10.20.193.10:0/1775349802 >> v1:10.20.193.71:6789/0 conn(0x7f66600c9120 legacy=0x7f6660153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.977+0000 7f66666d6640 10 monclient: _finish_hunting 0 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.977+0000 7f66666d6640 1 monclient: found mon.noname-a 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.977+0000 7f66666d6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.977+0000 7f66666d6640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.977+0000 7f66666d6640 1 -- 10.20.193.10:0/1775349802 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66600c7e20 con 0x7f666015d220 2026-02-17T12:01:06.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.978+0000 7f66666d6640 1 --2- 10.20.193.10:0/1775349802 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 0x7f666015d600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66540098a0 tx=0x7f665402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118b338f4d9fa9b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:06.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 1 -- 10.20.193.10:0/1775349802 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665403c070 con 0x7f666015d220 2026-02-17T12:01:06.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 10 monclient: dump: 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 10 monclient: _finish_auth 0 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 10 monclient: _check_auth_tickets 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 1 -- 10.20.193.10:0/1775349802 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665402fae0 con 0x7f666015d220 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f6668961640 5 monclient: authenticate success, global_id 5109 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 1 -- 10.20.193.10:0/1775349802 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654037440 con 0x7f666015d220 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f66656d4640 10 monclient: dump: 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:06.994 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.995 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:06.995 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:06.995 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.995 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:06.995 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:06.995 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:06.995 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f6668961640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.980+0000 7f6668961640 4 set_mon_vals no callback set 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 10 monclient: shutdown 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 1 -- 10.20.193.10:0/1775349802 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 msgr2=0x7f666015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 1 --2- 10.20.193.10:0/1775349802 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 0x7f666015d600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66540098a0 tx=0x7f665402ee10 comp rx=0 tx=0).stop 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 1 -- 10.20.193.10:0/1775349802 shutdown_connections 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 1 --2- 10.20.193.10:0/1775349802 >> v2:10.20.193.71:3300/0 conn(0x7f6660074920 0x7f66600c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 1 --2- 10.20.193.10:0/1775349802 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 0x7f666015d600 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 1 -- 10.20.193.10:0/1775349802 >> 10.20.193.10:0/1775349802 conn(0x7f66600c9d80 msgr2=0x7f66600ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 1 -- 10.20.193.10:0/1775349802 shutdown_connections 2026-02-17T12:01:06.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 1 -- 10.20.193.10:0/1775349802 wait complete. 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 10 monclient: build_initial_monmap 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.981+0000 7f6668961640 10 monclient: monmap: 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:06.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 librados: starting msgr at 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 librados: starting objecter 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 Processor -- start 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 -- start start 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 librados: setting wanted keys 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 librados: calling monclient init 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient: init 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6660074920 0x7f6660148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient(hunting): picked mon.noname-c con 0x7f6660074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f66600c9120 0x7f66601f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient(hunting): picked mon.noname-b con 0x7f66600c9120 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 0x7f66601f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient(hunting): picked mon.noname-a con 0x7f666015d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f66600c86c0 con 0x7f666015d220 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f66600c83e0 con 0x7f66600c9120 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6660074d70 con 0x7f6660074920 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6668961640 10 monclient(hunting): authenticate will time out at 1336.704658s 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.982+0000 7f6666ed7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 0x7f66601f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6665ed5640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f66600c9120 0x7f66601f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:06.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6666ed7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 0x7f66601f6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44778/0 (socket says 10.20.193.10:44778) 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6666ed7640 1 -- 10.20.193.10:0/3372889230 learned_addr learned my addr 10.20.193.10:0/3372889230 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6666ed7640 10 monclient(hunting): get_auth_request con 0x7f666015d220 auth_method 0 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6666ed7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6666ed7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6666ed7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6665ed5640 10 monclient(hunting): get_auth_request con 0x7f66600c9120 auth_method 0 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6665ed5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6665ed5640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6665ed5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f66666d6640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6660074920 0x7f6660148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f66666d6640 10 monclient(hunting): get_auth_request con 0x7f6660074920 auth_method 0 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f66666d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f66666d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f66666d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6665ed5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6665ed5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6665ed5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6666ed7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6666ed7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f6666ed7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f66666d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f66666d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.983+0000 7f66666d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 10 monclient(hunting): handle_auth_done global_id 5112 payload 824 2026-02-17T12:01:07.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 1 -- 10.20.193.10:0/3372889230 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6660074920 msgr2=0x7f6660148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6660074920 0x7f6660148970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 1 -- 10.20.193.10:0/3372889230 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f66600c9120 msgr2=0x7f66601f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f66600c9120 0x7f66601f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 10 monclient: _finish_hunting 0 2026-02-17T12:01:07.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 1 monclient: found mon.noname-a 2026-02-17T12:01:07.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:07.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:07.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.984+0000 7f6666ed7640 1 -- 10.20.193.10:0/3372889230 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66601f7ee0 con 0x7f666015d220 2026-02-17T12:01:07.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.985+0000 7f6666ed7640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 0x7f66601f6a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c730 tx=0x7f664c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.985+0000 7f665affd640 10 client.?.objecter ms_handle_connect 0x7f666015d220 2026-02-17T12:01:07.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.985+0000 7f665affd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:07.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 1 -- 10.20.193.10:0/3372889230 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c017070 con 0x7f666015d220 2026-02-17T12:01:07.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:07.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 10 monclient: dump: 2026-02-17T12:01:07.004 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.004 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.004 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.004 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.004 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.004 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.004 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.004 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.005 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.005 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 10 monclient: _finish_auth 0 2026-02-17T12:01:07.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:07.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:07.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 1 -- 10.20.193.10:0/3372889230 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c005bb0 con 0x7f666015d220 2026-02-17T12:01:07.005 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6668961640 5 monclient: authenticate success, global_id 5112 2026-02-17T12:01:07.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6668961640 10 monclient: _renew_subs 2026-02-17T12:01:07.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6668961640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:07.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66601f5160 con 0x7f666015d220 2026-02-17T12:01:07.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:07.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 1 -- 10.20.193.10:0/3372889230 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c007070 con 0x7f666015d220 2026-02-17T12:01:07.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6664ed3640 4 set_mon_vals no callback set 2026-02-17T12:01:07.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:07.006 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f665affd640 10 monclient: dump: 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.007 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6668961640 10 client.5112.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:07.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6668961640 10 monclient: _renew_subs 2026-02-17T12:01:07.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6668961640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:07.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66601f5720 con 0x7f666015d220 2026-02-17T12:01:07.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.987+0000 7f6668961640 1 librados: init done 2026-02-17T12:01:07.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.988+0000 7f6668961640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.988+0000 7f6668961640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.988+0000 7f6668961640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:07.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:06.988+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66600c8be0 con 0x7f666015d220 2026-02-17T12:01:07.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.000+0000 7f665affd640 1 -- 10.20.193.10:0/3372889230 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f664c007210 con 0x7f666015d220 2026-02-17T12:01:07.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.000+0000 7f665affd640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6638078e50 0x7f663807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.000+0000 7f66666d6640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6638078e50 0x7f663807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.000+0000 7f66666d6640 10 monclient: get_auth_request con 0x7f6638078e50 auth_method 0 2026-02-17T12:01:07.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.001+0000 7f66666d6640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6638078e50 0x7f663807b310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6654039000 tx=0x7f6654033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.001+0000 7f665affd640 10 client.5112.objecter ms_handle_connect 0x7f6638078e50 2026-02-17T12:01:07.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.001+0000 7f665affd640 1 -- 10.20.193.10:0/3372889230 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f664c05d290 con 0x7f666015d220 2026-02-17T12:01:07.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.001+0000 7f665affd640 10 client.5112.objecter ms_dispatch2 0x7f6660000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:07.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.001+0000 7f665affd640 3 client.5112.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:07.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.001+0000 7f665affd640 3 client.5112.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:07.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.002+0000 7f665affd640 20 client.5112.objecter dump_active .. 0 homeless 2026-02-17T12:01:07.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.103+0000 7f665affd640 1 -- 10.20.193.10:0/3372889230 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f664c022080 con 0x7f666015d220 2026-02-17T12:01:07.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.103+0000 7f665affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.103+0000 7f665affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:07.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.185+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f66601f4f10 con 0x7f6638078e50 2026-02-17T12:01:07.187 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.185+0000 7f665affd640 1 -- 10.20.193.10:0/3372889230 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f66601f4f10 con 0x7f6638078e50 2026-02-17T12:01:07.188 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 4 to deep-scrub 2026-02-17T12:01:07.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 10 librados: watch_flush enter 2026-02-17T12:01:07.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 10 librados: watch_flush exit 2026-02-17T12:01:07.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 20 client.5112.objecter shutdown clearing up homeless session... 2026-02-17T12:01:07.189 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 10 client.5112.objecter successfully canceled tick 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6638078e50 msgr2=0x7f663807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6638078e50 0x7f663807b310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6654039000 tx=0x7f6654033000 comp rx=0 tx=0).stop 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 10 monclient: shutdown 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 msgr2=0x7f66601f6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 0x7f66601f6a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c730 tx=0x7f664c00cc00 comp rx=0 tx=0).stop 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 shutdown_connections 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6638078e50 0x7f663807b310 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f666015d220 0x7f66601f6a20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f66600c9120 0x7f66601f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 --2- 10.20.193.10:0/3372889230 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6660074920 0x7f6660148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.190 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 >> 10.20.193.10:0/3372889230 conn(0x7f66600c9d80 msgr2=0x7f666014dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:07.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 shutdown_connections 2026-02-17T12:01:07.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 -- 10.20.193.10:0/3372889230 wait complete. 2026-02-17T12:01:07.191 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.186+0000 7f6668961640 1 librados: shutdown 2026-02-17T12:01:07.197 INFO:tasks.ceph:Scrubbing osd.8 2026-02-17T12:01:07.197 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:07.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.268+0000 7efc7bed3640 10 monclient: get_monmap_and_config 2026-02-17T12:01:07.270 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.268+0000 7efc7bed3640 10 monclient: build_initial_monmap 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.268+0000 7efc7bed3640 10 monclient: monmap: 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:07.269535+0000 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:07.269535+0000 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:07.271 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:07.272 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:07.272 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:07.272 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.268+0000 7efc7bed3640 1 Processor -- start 2026-02-17T12:01:07.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.268+0000 7efc7bed3640 1 -- start start 2026-02-17T12:01:07.272 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.268+0000 7efc7bed3640 10 monclient: init 2026-02-17T12:01:07.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:07.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 10 monclient: _add_conns ranks=[2,4,0,1,3,5] 2026-02-17T12:01:07.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7efc74150300 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:07.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7efc741506e0 0x7efc7415d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 10 monclient(hunting): picked mon.noname-b con 0x7efc741506e0 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:07.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efc7415d5a0 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:07.275 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc740c55e0 con 0x7efc7415d5a0 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc740c5300 con 0x7efc74150300 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7efc74159c80 con 0x7efc741506e0 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7bed3640 10 monclient(hunting): authenticate will time out at 1336.991356s 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc79447640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7efc741506e0 0x7efc7415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7a449640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7efc7415d5a0 0x7efc740c4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44816/0 (socket says 10.20.193.10:44816) 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc7a449640 1 -- 10.20.193.10:0/1391898937 learned_addr learned my addr 10.20.193.10:0/1391898937 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc79447640 10 monclient(hunting): get_auth_request con 0x7efc741506e0 auth_method 0 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc79447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.276 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc79447640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.269+0000 7efc79447640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.270+0000 7efc79447640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.270+0000 7efc79447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.270+0000 7efc79447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc78c46640 1 -- 10.20.193.10:0/1391898937 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22732657 0 0) 0x7efc740c5300 con 0x7efc74150300 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc78c46640 10 monclient(hunting): _negotiate 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc78c46640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc78c46640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc78c46640 10 monclient(hunting): my global_id is 5159 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc78c46640 1 -- 10.20.193.10:0/1391898937 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc5c003620 con 0x7efc74150300 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc79447640 10 monclient(hunting): handle_auth_done global_id 5146 payload 274 2026-02-17T12:01:07.277 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc79447640 1 -- 10.20.193.10:0/1391898937 >> v1:10.20.193.153:6789/0 conn(0x7efc74150300 legacy=0x7efc7406fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc79447640 1 -- 10.20.193.10:0/1391898937 >> v1:10.20.193.10:6789/0 conn(0x7efc7415d5a0 legacy=0x7efc740c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc79447640 10 monclient: _finish_hunting 0 2026-02-17T12:01:07.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc79447640 1 monclient: found mon.noname-b 2026-02-17T12:01:07.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc79447640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:07.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc79447640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.271+0000 7efc79447640 1 -- 10.20.193.10:0/1391898937 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc74159f60 con 0x7efc741506e0 2026-02-17T12:01:07.278 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.272+0000 7efc79447640 1 --2- 10.20.193.10:0/1391898937 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc741506e0 0x7efc7415d060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efc680098a0 tx=0x7efc6802ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c615d7666fb034b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 1 -- 10.20.193.10:0/1391898937 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6803c070 con 0x7efc741506e0 2026-02-17T12:01:07.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:07.285 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 10 monclient: dump: 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.286 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 10 monclient: _finish_auth 0 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 10 monclient: _check_auth_tickets 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 1 -- 10.20.193.10:0/1391898937 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6802fc10 con 0x7efc741506e0 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 1 -- 10.20.193.10:0/1391898937 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68037440 con 0x7efc741506e0 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc7bed3640 5 monclient: authenticate success, global_id 5146 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc7bed3640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc7bed3640 4 set_mon_vals no callback set 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.273+0000 7efc78c46640 10 monclient: dump: 2026-02-17T12:01:07.287 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 10 monclient: shutdown 2026-02-17T12:01:07.288 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 1 -- 10.20.193.10:0/1391898937 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc741506e0 msgr2=0x7efc7415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 1 --2- 10.20.193.10:0/1391898937 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc741506e0 0x7efc7415d060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efc680098a0 tx=0x7efc6802ef00 comp rx=0 tx=0).stop 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 1 -- 10.20.193.10:0/1391898937 shutdown_connections 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 1 --2- 10.20.193.10:0/1391898937 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc741506e0 0x7efc7415d060 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 1 -- 10.20.193.10:0/1391898937 >> 10.20.193.10:0/1391898937 conn(0x7efc740cd560 msgr2=0x7efc740cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 1 -- 10.20.193.10:0/1391898937 shutdown_connections 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 1 -- 10.20.193.10:0/1391898937 wait complete. 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 10 monclient: build_initial_monmap 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.274+0000 7efc7bed3640 10 monclient: monmap: 2026-02-17T12:01:07.289 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 librados: starting msgr at 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 librados: starting objecter 2026-02-17T12:01:07.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 Processor -- start 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 -- start start 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 librados: setting wanted keys 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 librados: calling monclient init 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient: init 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efc74150300 0x7efc7414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient(hunting): picked mon.noname-a con 0x7efc74150300 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efc741506e0 0x7efc74157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient(hunting): picked mon.noname-c con 0x7efc741506e0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc7415d5a0 0x7efc74157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.291 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient(hunting): picked mon.noname-b con 0x7efc7415d5a0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7efc74070510 con 0x7efc74150300 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7efc7415a520 con 0x7efc7415d5a0 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7efc740c4e90 con 0x7efc741506e0 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7bed3640 10 monclient(hunting): authenticate will time out at 1336.997598s 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc79c48640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efc74150300 0x7efc7414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc7a449640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc7415d5a0 0x7efc74157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.275+0000 7efc79447640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efc741506e0 0x7efc74157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.292 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc7a449640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc7415d5a0 0x7efc74157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59436/0 (socket says 10.20.193.10:59436) 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc7a449640 1 -- 10.20.193.10:0/1047957622 learned_addr learned my addr 10.20.193.10:0/1047957622 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc7a449640 10 monclient(hunting): get_auth_request con 0x7efc7415d5a0 auth_method 0 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc7a449640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc7a449640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc7a449640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79c48640 10 monclient(hunting): get_auth_request con 0x7efc74150300 auth_method 0 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79c48640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79c48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79447640 10 monclient(hunting): get_auth_request con 0x7efc741506e0 auth_method 0 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.293 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79447640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79447640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc7a449640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc7a449640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc7a449640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79c48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79c48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79c48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79447640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.276+0000 7efc79447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 10 monclient(hunting): handle_auth_done global_id 5149 payload 824 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 1 -- 10.20.193.10:0/1047957622 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efc741506e0 msgr2=0x7efc74157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.294 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efc741506e0 0x7efc74157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 1 -- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efc74150300 msgr2=0x7efc7414beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efc74150300 0x7efc7414beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 10 monclient: _finish_hunting 0 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 1 monclient: found mon.noname-b 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc7a449640 1 -- 10.20.193.10:0/1047957622 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7415bd30 con 0x7efc7415d5a0 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.277+0000 7efc79447640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efc741506e0 0x7efc74157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.278+0000 7efc7a449640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc7415d5a0 0x7efc74157eb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efc7000cb50 tx=0x7efc7000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.295 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.278+0000 7efc627fc640 10 client.?.objecter ms_handle_connect 0x7efc7415d5a0 2026-02-17T12:01:07.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.278+0000 7efc627fc640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:07.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 1 -- 10.20.193.10:0/1047957622 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70017070 con 0x7efc7415d5a0 2026-02-17T12:01:07.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:07.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 10 monclient: dump: 2026-02-17T12:01:07.296 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.296 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.296 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.296 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 1 -- 10.20.193.10:0/1047957622 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7000ad50 con 0x7efc7415d5a0 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc7bed3640 5 monclient: authenticate success, global_id 5149 2026-02-17T12:01:07.297 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc7bed3640 10 monclient: _renew_subs 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc7bed3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7415c010 con 0x7efc7415d5a0 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 1 -- 10.20.193.10:0/1047957622 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70012600 con 0x7efc7415d5a0 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc627fc640 10 monclient: dump: 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.298 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc63fff640 4 set_mon_vals no callback set 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc7bed3640 10 client.5149.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc7bed3640 10 monclient: _renew_subs 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc7bed3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7415c5d0 con 0x7efc7415d5a0 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.280+0000 7efc7bed3640 1 librados: init done 2026-02-17T12:01:07.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.281+0000 7efc7bed3640 10 client.5149.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.281+0000 7efc7bed3640 15 client.5149.objecter _session_command_op_assign -1 1 2026-02-17T12:01:07.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.281+0000 7efc7bed3640 20 client.5149.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:07.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.281+0000 7efc7bed3640 10 client.5149.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:07.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.281+0000 7efc7bed3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.281+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc7415d060 con 0x7efc7415d5a0 2026-02-17T12:01:07.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.292+0000 7efc627fc640 1 -- 10.20.193.10:0/1047957622 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7efc7001b3b0 con 0x7efc7415d5a0 2026-02-17T12:01:07.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.292+0000 7efc627fc640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efc44078e00 0x7efc4407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.302 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.292+0000 7efc79c48640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efc44078e00 0x7efc4407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.292+0000 7efc79c48640 10 monclient: get_auth_request con 0x7efc44078e00 auth_method 0 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 10 client.5149.objecter ms_handle_connect 0x7efc44078e00 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc79c48640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efc44078e00 0x7efc4407b2c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc64007fd0 tx=0x7efc64007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 1 -- 10.20.193.10:0/1047957622 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7efc70097cc0 con 0x7efc7415d5a0 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 10 client.5149.objecter ms_dispatch2 0x7efc74000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 3 client.5149.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 3 client.5149.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 10 client.5149.objecter checking command 1 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7efc44081340 0x7efc44083760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 20 client.5149.objecter _get_session s=0x7efc44080c70 osd=8 3 2026-02-17T12:01:07.303 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 20 client.5149.objecter put_session s=0x7efc44080c70 osd=8 3 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 15 client.5149.objecter _session_command_op_remove -1 1 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 20 client.5149.objecter _get_session s=0x7efc44080c70 osd=8 3 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 20 client.5149.objecter get_session s=0x7efc44080c70 osd=8 3 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 15 client.5149.objecter _session_command_op_assign 8 1 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 20 client.5149.objecter put_session s=0x7efc44080c70 osd=8 4 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 10 client.5149.objecter _send_command 1 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 1 -- 10.20.193.10:0/1047957622 --> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc44083e30 con 0x7efc44081340 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 20 client.5149.objecter dump_active .. 0 homeless 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc79447640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7efc44081340 0x7efc44083760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc79447640 10 monclient: get_auth_request con 0x7efc44081340 auth_method 0 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 1 -- 10.20.193.10:0/1047957622 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efc7005e780 con 0x7efc7415d5a0 2026-02-17T12:01:07.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.293+0000 7efc627fc640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:07.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.295+0000 7efc627fc640 10 client.5149.objecter ms_handle_connect 0x7efc44081340 2026-02-17T12:01:07.305 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.295+0000 7efc79447640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7efc44081340 0x7efc44083760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.305+0000 7efc627fc640 1 -- 10.20.193.10:0/1047957622 <== osd.8 v2:10.20.193.10:6818/1997295941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7efc44083e30 con 0x7efc44081340 2026-02-17T12:01:07.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.305+0000 7efc627fc640 10 client.5149.objecter ms_dispatch2 0x7efc74000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:07.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.305+0000 7efc627fc640 10 client.5149.objecter _finish_command 1 = system:0 2026-02-17T12:01:07.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.305+0000 7efc627fc640 20 client.5149.objecter put_session s=0x7efc44080c70 osd=8 4 2026-02-17T12:01:07.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.305+0000 7efc627fc640 15 client.5149.objecter _session_command_op_remove 8 1 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 10 client.5149.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 15 client.5149.objecter _session_command_op_assign -1 2 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 20 client.5149.objecter _get_session s=0x7efc44080c70 osd=8 3 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 20 client.5149.objecter put_session s=0x7efc44080c70 osd=8 3 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 20 client.5149.objecter _get_session s=0x7efc44080c70 osd=8 3 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 15 client.5149.objecter _session_command_op_remove -1 2 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 20 client.5149.objecter get_session s=0x7efc44080c70 osd=8 3 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 15 client.5149.objecter _session_command_op_assign 8 2 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 20 client.5149.objecter put_session s=0x7efc44080c70 osd=8 4 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 10 client.5149.objecter _send_command 2 2026-02-17T12:01:07.313 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.311+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 --> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efc74157490 con 0x7efc44081340 2026-02-17T12:01:07.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.317+0000 7efc627fc640 1 -- 10.20.193.10:0/1047957622 <== osd.8 v2:10.20.193.10:6818/1997295941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efc74157490 con 0x7efc44081340 2026-02-17T12:01:07.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.317+0000 7efc627fc640 10 client.5149.objecter ms_dispatch2 0x7efc74000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:07.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.317+0000 7efc627fc640 10 client.5149.objecter _finish_command 2 = system:0 2026-02-17T12:01:07.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.317+0000 7efc627fc640 20 client.5149.objecter put_session s=0x7efc44080c70 osd=8 4 2026-02-17T12:01:07.319 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.317+0000 7efc627fc640 15 client.5149.objecter _session_command_op_remove 8 2 2026-02-17T12:01:07.319 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:07.319 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:07.319 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:07.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 10 librados: watch_flush enter 2026-02-17T12:01:07.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 10 librados: watch_flush exit 2026-02-17T12:01:07.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 10 client.5149.objecter close_session for osd.8 2026-02-17T12:01:07.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7efc44081340 msgr2=0x7efc44083760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6818/1997295941,v1:10.20.193.10:6819/1997295941] conn(0x7efc44081340 0x7efc44083760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.321 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 20 client.5149.objecter put_session s=0x7efc44080c70 osd=8 1 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 20 client.5149.objecter shutdown clearing up homeless session... 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 10 client.5149.objecter successfully canceled tick 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efc44078e00 msgr2=0x7efc4407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efc44078e00 0x7efc4407b2c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc64007fd0 tx=0x7efc64007dc0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 10 monclient: shutdown 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc7415d5a0 msgr2=0x7efc74157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 --2- 10.20.193.10:0/1047957622 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efc7415d5a0 0x7efc74157eb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efc7000cb50 tx=0x7efc7000a430 comp rx=0 tx=0).stop 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7a449640 1 -- 10.20.193.10:0/1047957622 reap_dead start 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 shutdown_connections 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 >> 10.20.193.10:0/1047957622 conn(0x7efc740cd560 msgr2=0x7efc7414e670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:07.322 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 shutdown_connections 2026-02-17T12:01:07.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 -- 10.20.193.10:0/1047957622 wait complete. 2026-02-17T12:01:07.323 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.318+0000 7efc7bed3640 1 librados: shutdown 2026-02-17T12:01:07.328 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-17T12:01:07.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.395+0000 7f6daa16a640 10 monclient: get_monmap_and_config 2026-02-17T12:01:07.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.395+0000 7f6daa16a640 10 monclient: build_initial_monmap 2026-02-17T12:01:07.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.395+0000 7f6daa16a640 10 monclient: monmap: 2026-02-17T12:01:07.396 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:07.396271+0000 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:07.396271+0000 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.395+0000 7f6daa16a640 1 Processor -- start 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.395+0000 7f6daa16a640 1 -- start start 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.395+0000 7f6daa16a640 10 monclient: init 2026-02-17T12:01:07.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 10 monclient: _add_conns ranks=[0,5,4,2,1,3] 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6da415d220 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6da40c92f0 0x7f6da415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 10 monclient(hunting): picked mon.noname-c con 0x7f6da40c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f6da4074920 0x7f6da4153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 10 monclient(hunting): picked mon.noname-b con 0x7f6da4074920 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da40c58a0 con 0x7f6da415d220 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6da40c55c0 con 0x7f6da4074920 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6da40c7e20 con 0x7f6da40c92f0 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6daa16a640 10 monclient(hunting): authenticate will time out at 1337.118067s 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da37fe640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f6da415d220 0x7f6da40c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44832/0 (socket says 10.20.193.10:44832) 2026-02-17T12:01:07.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da37fe640 1 -- 10.20.193.10:0/1158840035 learned_addr learned my addr 10.20.193.10:0/1158840035 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da2ffd640 1 --2- 10.20.193.10:0/1158840035 >> v2:10.20.193.153:3300/0 conn(0x7f6da40c92f0 0x7f6da415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da3fff640 1 --2- 10.20.193.10:0/1158840035 >> v2:10.20.193.71:3300/0 conn(0x7f6da4074920 0x7f6da4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da2ffd640 10 monclient(hunting): get_auth_request con 0x7f6da40c92f0 auth_method 0 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da3fff640 10 monclient(hunting): get_auth_request con 0x7f6da4074920 auth_method 0 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.396+0000 7f6da2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da2ffd640 10 monclient(hunting): handle_auth_done global_id 5165 payload 274 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da2ffd640 1 -- 10.20.193.10:0/1158840035 >> v2:10.20.193.71:3300/0 conn(0x7f6da4074920 msgr2=0x7f6da4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da2ffd640 1 --2- 10.20.193.10:0/1158840035 >> v2:10.20.193.71:3300/0 conn(0x7f6da4074920 0x7f6da4153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da2ffd640 1 -- 10.20.193.10:0/1158840035 >> v1:10.20.193.10:6789/0 conn(0x7f6da415d220 legacy=0x7f6da40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:07.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da2ffd640 1 monclient: found mon.noname-c 2026-02-17T12:01:07.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:07.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da2ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:07.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.397+0000 7f6da2ffd640 1 -- 10.20.193.10:0/1158840035 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da40c8100 con 0x7f6da40c92f0 2026-02-17T12:01:07.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.398+0000 7f6da2ffd640 1 --2- 10.20.193.10:0/1158840035 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 0x7f6da415d600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d940098a0 tx=0x7f6d9402ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b33353f890d13456 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 1 -- 10.20.193.10:0/1158840035 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9403c070 con 0x7f6da40c92f0 2026-02-17T12:01:07.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:07.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 10 monclient: dump: 2026-02-17T12:01:07.405 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.405 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.405 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.405 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 1 -- 10.20.193.10:0/1158840035 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9402fae0 con 0x7f6da40c92f0 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 1 -- 10.20.193.10:0/1158840035 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94037440 con 0x7f6da40c92f0 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 5 monclient: authenticate success, global_id 5165 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 4 set_mon_vals no callback set 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:07.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6da27fc640 10 monclient: dump: 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 10 monclient: shutdown 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 1 -- 10.20.193.10:0/1158840035 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 msgr2=0x7f6da415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 1 --2- 10.20.193.10:0/1158840035 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 0x7f6da415d600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d940098a0 tx=0x7f6d9402ee10 comp rx=0 tx=0).stop 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 1 -- 10.20.193.10:0/1158840035 shutdown_connections 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 1 --2- 10.20.193.10:0/1158840035 >> v2:10.20.193.71:3300/0 conn(0x7f6da4074920 0x7f6da4153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 1 --2- 10.20.193.10:0/1158840035 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 0x7f6da415d600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 1 -- 10.20.193.10:0/1158840035 >> 10.20.193.10:0/1158840035 conn(0x7f6da40c9d80 msgr2=0x7f6da40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.400+0000 7f6daa16a640 1 -- 10.20.193.10:0/1158840035 shutdown_connections 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 1 -- 10.20.193.10:0/1158840035 wait complete. 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 10 monclient: build_initial_monmap 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 10 monclient: monmap: 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 1 librados: starting msgr at 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 1 librados: starting objecter 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 1 Processor -- start 2026-02-17T12:01:07.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 1 -- start start 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 1 librados: setting wanted keys 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 1 librados: calling monclient init 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.401+0000 7f6daa16a640 10 monclient: init 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6da4074920 0x7f6da41f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient(hunting): picked mon.noname-a con 0x7f6da4074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 0x7f6da4073b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient(hunting): picked mon.noname-c con 0x7f6da40c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6da415d220 0x7f6da4070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient(hunting): picked mon.noname-b con 0x7f6da415d220 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f6da4074d70 con 0x7f6da4074920 2026-02-17T12:01:07.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40c86c0 con 0x7f6da415d220 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6da4153b90 con 0x7f6da40c92f0 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6daa16a640 10 monclient(hunting): authenticate will time out at 1337.124161s 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6da4074920 0x7f6da41f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da2ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 0x7f6da4073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6da4074920 0x7f6da41f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44792/0 (socket says 10.20.193.10:44792) 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 1 -- 10.20.193.10:0/993480400 learned_addr learned my addr 10.20.193.10:0/993480400 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 10 monclient(hunting): get_auth_request con 0x7f6da4074920 auth_method 0 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da2ffd640 10 monclient(hunting): get_auth_request con 0x7f6da40c92f0 auth_method 0 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da3fff640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6da415d220 0x7f6da4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.402+0000 7f6da37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da3fff640 10 monclient(hunting): get_auth_request con 0x7f6da415d220 auth_method 0 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.403+0000 7f6da3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 10 monclient(hunting): handle_auth_done global_id 5168 payload 824 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 1 -- 10.20.193.10:0/993480400 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6da415d220 msgr2=0x7f6da4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6da415d220 0x7f6da4070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 1 -- 10.20.193.10:0/993480400 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6da4074920 msgr2=0x7f6da41f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6da4074920 0x7f6da41f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 1 monclient: found mon.noname-c 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.404+0000 7f6da2ffd640 1 -- 10.20.193.10:0/993480400 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da4072a70 con 0x7f6da40c92f0 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.405+0000 7f6da2ffd640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 0x7f6da4073b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6da40c7fa0 tx=0x7f6d940047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.405+0000 7f6d7ffff640 10 client.?.objecter ms_handle_connect 0x7f6da40c92f0 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.405+0000 7f6d7ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 1 -- 10.20.193.10:0/993480400 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94046020 con 0x7f6da40c92f0 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 10 monclient: dump: 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.415 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 1 -- 10.20.193.10:0/993480400 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d94042670 con 0x7f6da40c92f0 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 1 -- 10.20.193.10:0/993480400 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9403c040 con 0x7f6da40c92f0 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6d7ffff640 10 monclient: dump: 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.416 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6da1ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 5 monclient: authenticate success, global_id 5168 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 10 monclient: _renew_subs 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da4072d50 con 0x7f6da40c92f0 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 10 client.5168.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 10 monclient: _renew_subs 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da4073310 con 0x7f6da40c92f0 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 1 librados: init done 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.417 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:07.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.407+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da40c5330 con 0x7f6da40c92f0 2026-02-17T12:01:07.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.418+0000 7f6d7ffff640 1 -- 10.20.193.10:0/993480400 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6d9404b440 con 0x7f6da40c92f0 2026-02-17T12:01:07.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.418+0000 7f6d7ffff640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d74078e00 0x7f6d7407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.418+0000 7f6da37fe640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d74078e00 0x7f6d7407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.418+0000 7f6da37fe640 10 monclient: get_auth_request con 0x7f6d74078e00 auth_method 0 2026-02-17T12:01:07.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.419+0000 7f6d7ffff640 10 client.5168.objecter ms_handle_connect 0x7f6d74078e00 2026-02-17T12:01:07.421 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.419+0000 7f6da37fe640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d74078e00 0x7f6d7407b2c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6d90002770 tx=0x7f6d90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.420+0000 7f6d7ffff640 1 -- 10.20.193.10:0/993480400 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f6d9402fa20 con 0x7f6da40c92f0 2026-02-17T12:01:07.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.420+0000 7f6d7ffff640 10 client.5168.objecter ms_dispatch2 0x7f6da4000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:07.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.420+0000 7f6d7ffff640 3 client.5168.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:07.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.420+0000 7f6d7ffff640 3 client.5168.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:07.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.420+0000 7f6d7ffff640 20 client.5168.objecter dump_active .. 0 homeless 2026-02-17T12:01:07.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.523+0000 7f6d7ffff640 1 -- 10.20.193.10:0/993480400 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6d94050080 con 0x7f6da40c92f0 2026-02-17T12:01:07.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.523+0000 7f6d7ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.523+0000 7f6d7ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:07.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.608+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7f6da4153f70 con 0x7f6d74078e00 2026-02-17T12:01:07.610 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.608+0000 7f6d7ffff640 1 -- 10.20.193.10:0/993480400 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6da4153f70 con 0x7f6d74078e00 2026-02-17T12:01:07.611 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 8 to deep-scrub 2026-02-17T12:01:07.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 10 librados: watch_flush enter 2026-02-17T12:01:07.612 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 10 librados: watch_flush exit 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 20 client.5168.objecter shutdown clearing up homeless session... 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 10 client.5168.objecter successfully canceled tick 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d74078e00 msgr2=0x7f6d7407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d74078e00 0x7f6d7407b2c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6d90002770 tx=0x7f6d90009040 comp rx=0 tx=0).stop 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 10 monclient: shutdown 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 msgr2=0x7f6da4073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 0x7f6da4073b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6da40c7fa0 tx=0x7f6d940047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 shutdown_connections 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6d74078e00 0x7f6d7407b2c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.613 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6da415d220 0x7f6da4070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6da40c92f0 0x7f6da4073b10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 --2- 10.20.193.10:0/993480400 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6da4074920 0x7f6da41f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 >> 10.20.193.10:0/993480400 conn(0x7f6da40c9d80 msgr2=0x7f6da406b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:07.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 shutdown_connections 2026-02-17T12:01:07.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 -- 10.20.193.10:0/993480400 wait complete. 2026-02-17T12:01:07.614 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.610+0000 7f6daa16a640 1 librados: shutdown 2026-02-17T12:01:07.620 INFO:tasks.ceph:Scrubbing osd.12 2026-02-17T12:01:07.621 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.688+0000 7fbe2161a640 10 monclient: get_monmap_and_config 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.688+0000 7fbe2161a640 10 monclient: build_initial_monmap 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.688+0000 7fbe2161a640 10 monclient: monmap: 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:07.689398+0000 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:07.689398+0000 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:07.690 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:07.691 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:07.691 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:07.691 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:07.691 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.688+0000 7fbe2161a640 1 Processor -- start 2026-02-17T12:01:07.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.688+0000 7fbe2161a640 1 -- start start 2026-02-17T12:01:07.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.688+0000 7fbe2161a640 10 monclient: init 2026-02-17T12:01:07.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:07.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 10 monclient: _add_conns ranks=[2,0,3,1,4,5] 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbe1c152870 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbe1c159e40 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fbe1c15f4c0 0x7fbe1c15f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 10 monclient(hunting): picked mon.noname-a con 0x7fbe1c15f4c0 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe1c15e040 con 0x7fbe1c159e40 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe1c15e320 con 0x7fbe1c152870 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fbe1c15ef30 con 0x7fbe1c15f4c0 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe2161a640 10 monclient(hunting): authenticate will time out at 1337.411461s 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe1b7fe640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fbe1c15f4c0 0x7fbe1c15f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe1affd640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fbe1c152870 0x7fbe1c074a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:57468/0 (socket says 10.20.193.10:57468) 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.689+0000 7fbe1affd640 1 -- 10.20.193.10:0/944692927 learned_addr learned my addr 10.20.193.10:0/944692927 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.690+0000 7fbe1b7fe640 10 monclient(hunting): get_auth_request con 0x7fbe1c15f4c0 auth_method 0 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.690+0000 7fbe1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.690+0000 7fbe1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.690+0000 7fbe1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.690+0000 7fbe1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.690+0000 7fbe1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.690+0000 7fbe1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe19ffb640 1 -- 10.20.193.10:0/944692927 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069018721 0 0) 0x7fbe1c15e320 con 0x7fbe1c152870 2026-02-17T12:01:07.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe19ffb640 10 monclient(hunting): _negotiate 2026-02-17T12:01:07.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe19ffb640 10 monclient(hunting): my global_id is 5171 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe19ffb640 1 -- 10.20.193.10:0/944692927 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe08003620 con 0x7fbe1c152870 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe1b7fe640 10 monclient(hunting): handle_auth_done global_id 5127 payload 274 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe1b7fe640 1 -- 10.20.193.10:0/944692927 >> v1:10.20.193.153:6789/0 conn(0x7fbe1c152870 legacy=0x7fbe1c074a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe1b7fe640 1 -- 10.20.193.10:0/944692927 >> v1:10.20.193.10:6789/0 conn(0x7fbe1c159e40 legacy=0x7fbe1c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe1b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe1b7fe640 1 monclient: found mon.noname-a 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe1b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.691+0000 7fbe1b7fe640 1 -- 10.20.193.10:0/944692927 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c15e600 con 0x7fbe1c15f4c0 2026-02-17T12:01:07.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.693+0000 7fbe1b7fe640 1 --2- 10.20.193.10:0/944692927 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c15f4c0 0x7fbe1c15f970 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009d90 tx=0x7fbe0c02f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f10e9fd82a2ba12 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 1 -- 10.20.193.10:0/944692927 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c03c070 con 0x7fbe1c15f4c0 2026-02-17T12:01:07.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:07.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 10 monclient: dump: 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 1 -- 10.20.193.10:0/944692927 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe0c037440 con 0x7fbe1c15f4c0 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 5 monclient: authenticate success, global_id 5127 2026-02-17T12:01:07.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 4 set_mon_vals no callback set 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 1 -- 10.20.193.10:0/944692927 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c037810 con 0x7fbe1c15f4c0 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe19ffb640 10 monclient: dump: 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.699 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 10 monclient: shutdown 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 1 -- 10.20.193.10:0/944692927 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c15f4c0 msgr2=0x7fbe1c15f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 1 --2- 10.20.193.10:0/944692927 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c15f4c0 0x7fbe1c15f970 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009d90 tx=0x7fbe0c02f1e0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 1 -- 10.20.193.10:0/944692927 shutdown_connections 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 1 --2- 10.20.193.10:0/944692927 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c15f4c0 0x7fbe1c15f970 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 1 -- 10.20.193.10:0/944692927 >> 10.20.193.10:0/944692927 conn(0x7fbe1c0ce290 msgr2=0x7fbe1c0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 1 -- 10.20.193.10:0/944692927 shutdown_connections 2026-02-17T12:01:07.700 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.695+0000 7fbe2161a640 1 -- 10.20.193.10:0/944692927 wait complete. 2026-02-17T12:01:07.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.696+0000 7fbe2161a640 10 monclient: build_initial_monmap 2026-02-17T12:01:07.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.696+0000 7fbe2161a640 10 monclient: monmap: 2026-02-17T12:01:07.703 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:07.703 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:07.703 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:07.703 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:07.703 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.696+0000 7fbe2161a640 1 librados: starting msgr at 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.696+0000 7fbe2161a640 1 librados: starting objecter 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.696+0000 7fbe2161a640 1 Processor -- start 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.696+0000 7fbe2161a640 1 -- start start 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.696+0000 7fbe2161a640 1 librados: setting wanted keys 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.696+0000 7fbe2161a640 1 librados: calling monclient init 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.696+0000 7fbe2161a640 10 monclient: init 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbe1c152870 0x7fbe1c1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient(hunting): picked mon.noname-b con 0x7fbe1c152870 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:07.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c159e40 0x7fbe1c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient(hunting): picked mon.noname-a con 0x7fbe1c159e40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbe1c15f4c0 0x7fbe1c1f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient(hunting): picked mon.noname-c con 0x7fbe1c15f4c0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c15ebc0 con 0x7fbe1c159e40 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c15feb0 con 0x7fbe1c152870 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c152c50 con 0x7fbe1c15f4c0 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe2161a640 10 monclient(hunting): authenticate will time out at 1337.419079s 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c159e40 0x7fbe1c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c159e40 0x7fbe1c150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44802/0 (socket says 10.20.193.10:44802) 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 1 -- 10.20.193.10:0/3657545603 learned_addr learned my addr 10.20.193.10:0/3657545603 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 10 monclient(hunting): get_auth_request con 0x7fbe1c159e40 auth_method 0 2026-02-17T12:01:07.705 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1affd640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbe1c152870 0x7fbe1c1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1b7fe640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbe1c15f4c0 0x7fbe1c1f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1affd640 10 monclient(hunting): get_auth_request con 0x7fbe1c152870 auth_method 0 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1b7fe640 10 monclient(hunting): get_auth_request con 0x7fbe1c15f4c0 auth_method 0 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.697+0000 7fbe1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.698+0000 7fbe1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.698+0000 7fbe1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.706 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.698+0000 7fbe1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.698+0000 7fbe1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.698+0000 7fbe1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.698+0000 7fbe1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 10 monclient(hunting): handle_auth_done global_id 5130 payload 824 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 1 -- 10.20.193.10:0/3657545603 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbe1c15f4c0 msgr2=0x7fbe1c1f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fbe1c15f4c0 0x7fbe1c1f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 1 -- 10.20.193.10:0/3657545603 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbe1c152870 msgr2=0x7fbe1c1571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fbe1c152870 0x7fbe1c1571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 1 monclient: found mon.noname-a 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.699+0000 7fbe1a7fc640 1 -- 10.20.193.10:0/3657545603 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c156440 con 0x7fbe1c159e40 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.700+0000 7fbe1a7fc640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c159e40 0x7fbe1c150d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400b580 tx=0x7fbe0400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.700+0000 7fbdfb7fe640 10 client.?.objecter ms_handle_connect 0x7fbe1c159e40 2026-02-17T12:01:07.707 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.700+0000 7fbdfb7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 1 -- 10.20.193.10:0/3657545603 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04004500 con 0x7fbe1c159e40 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 10 monclient: dump: 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.709 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 1 -- 10.20.193.10:0/3657545603 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe04014070 con 0x7fbe1c159e40 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 1 -- 10.20.193.10:0/3657545603 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04002920 con 0x7fbe1c159e40 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:07.710 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbdfb7fe640 10 monclient: dump: 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe197fa640 4 set_mon_vals no callback set 2026-02-17T12:01:07.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 5 monclient: authenticate success, global_id 5130 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 10 monclient: _renew_subs 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1c1f4890 con 0x7fbe1c159e40 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 10 client.5130.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 10 monclient: _renew_subs 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1c156700 con 0x7fbe1c159e40 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 1 librados: init done 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 10 client.5130.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 15 client.5130.objecter _session_command_op_assign -1 1 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 20 client.5130.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:07.712 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 10 client.5130.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:07.713 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:07.713 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.702+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe1c069900 con 0x7fbe1c159e40 2026-02-17T12:01:07.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.714+0000 7fbdfb7fe640 1 -- 10.20.193.10:0/3657545603 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fbe04019460 con 0x7fbe1c159e40 2026-02-17T12:01:07.716 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.714+0000 7fbdfb7fe640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbde8078e50 0x7fbde807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.714+0000 7fbe1affd640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbde8078e50 0x7fbde807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.714+0000 7fbe1affd640 10 monclient: get_auth_request con 0x7fbde8078e50 auth_method 0 2026-02-17T12:01:07.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.714+0000 7fbdfb7fe640 10 client.5130.objecter ms_handle_connect 0x7fbde8078e50 2026-02-17T12:01:07.717 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.714+0000 7fbe1affd640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbde8078e50 0x7fbde807b310 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe10007b60 tx=0x7fbe10007ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 1 -- 10.20.193.10:0/3657545603 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fbe0405dd00 con 0x7fbe1c159e40 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 10 client.5130.objecter ms_dispatch2 0x7fbe1c000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 3 client.5130.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 3 client.5130.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 10 client.5130.objecter checking command 1 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7fbde8081330 0x7fbde8083750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 20 client.5130.objecter _get_session s=0x7fbde8080c60 osd=12 3 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 20 client.5130.objecter put_session s=0x7fbde8080c60 osd=12 3 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 15 client.5130.objecter _session_command_op_remove -1 1 2026-02-17T12:01:07.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 20 client.5130.objecter _get_session s=0x7fbde8080c60 osd=12 3 2026-02-17T12:01:07.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 20 client.5130.objecter get_session s=0x7fbde8080c60 osd=12 3 2026-02-17T12:01:07.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 15 client.5130.objecter _session_command_op_assign 12 1 2026-02-17T12:01:07.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 20 client.5130.objecter put_session s=0x7fbde8080c60 osd=12 4 2026-02-17T12:01:07.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 10 client.5130.objecter _send_command 1 2026-02-17T12:01:07.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 1 -- 10.20.193.10:0/3657545603 --> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbde8083e20 con 0x7fbde8081330 2026-02-17T12:01:07.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbdfb7fe640 20 client.5130.objecter dump_active .. 0 homeless 2026-02-17T12:01:07.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbe1b7fe640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7fbde8081330 0x7fbde8083750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.716+0000 7fbe1b7fe640 10 monclient: get_auth_request con 0x7fbde8081330 auth_method 0 2026-02-17T12:01:07.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.717+0000 7fbdfb7fe640 1 -- 10.20.193.10:0/3657545603 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbe0405e0c0 con 0x7fbe1c159e40 2026-02-17T12:01:07.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.717+0000 7fbdfb7fe640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:07.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.718+0000 7fbe1b7fe640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7fbde8081330 0x7fbde8083750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.722 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.718+0000 7fbdfb7fe640 10 client.5130.objecter ms_handle_connect 0x7fbde8081330 2026-02-17T12:01:07.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.728+0000 7fbdfb7fe640 1 -- 10.20.193.10:0/3657545603 <== osd.12 v2:10.20.193.10:6802/2920105256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fbde8083e20 con 0x7fbde8081330 2026-02-17T12:01:07.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.728+0000 7fbdfb7fe640 10 client.5130.objecter ms_dispatch2 0x7fbe1c000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:07.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.728+0000 7fbdfb7fe640 10 client.5130.objecter _finish_command 1 = system:0 2026-02-17T12:01:07.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.728+0000 7fbdfb7fe640 20 client.5130.objecter put_session s=0x7fbde8080c60 osd=12 4 2026-02-17T12:01:07.730 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.728+0000 7fbdfb7fe640 15 client.5130.objecter _session_command_op_remove 12 1 2026-02-17T12:01:07.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 10 client.5130.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 15 client.5130.objecter _session_command_op_assign -1 2 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 20 client.5130.objecter _get_session s=0x7fbde8080c60 osd=12 3 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 20 client.5130.objecter put_session s=0x7fbde8080c60 osd=12 3 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 20 client.5130.objecter _get_session s=0x7fbde8080c60 osd=12 3 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 15 client.5130.objecter _session_command_op_remove -1 2 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 20 client.5130.objecter get_session s=0x7fbde8080c60 osd=12 3 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 15 client.5130.objecter _session_command_op_assign 12 2 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 20 client.5130.objecter put_session s=0x7fbde8080c60 osd=12 4 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 10 client.5130.objecter _send_command 2 2026-02-17T12:01:07.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.734+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 --> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe1c0cba40 con 0x7fbde8081330 2026-02-17T12:01:07.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbdfb7fe640 1 -- 10.20.193.10:0/3657545603 <== osd.12 v2:10.20.193.10:6802/2920105256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbe1c0cba40 con 0x7fbde8081330 2026-02-17T12:01:07.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbdfb7fe640 10 client.5130.objecter ms_dispatch2 0x7fbe1c000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:07.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbdfb7fe640 10 client.5130.objecter _finish_command 2 = system:0 2026-02-17T12:01:07.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbdfb7fe640 20 client.5130.objecter put_session s=0x7fbde8080c60 osd=12 4 2026-02-17T12:01:07.744 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbdfb7fe640 15 client.5130.objecter _session_command_op_remove 12 2 2026-02-17T12:01:07.745 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:07.745 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:07.745 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:07.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 10 librados: watch_flush enter 2026-02-17T12:01:07.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 10 librados: watch_flush exit 2026-02-17T12:01:07.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 10 client.5130.objecter close_session for osd.12 2026-02-17T12:01:07.746 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7fbde8081330 msgr2=0x7fbde8083750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6802/2920105256,v1:10.20.193.10:6803/2920105256] conn(0x7fbde8081330 0x7fbde8083750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 20 client.5130.objecter put_session s=0x7fbde8080c60 osd=12 1 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 20 client.5130.objecter shutdown clearing up homeless session... 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 10 client.5130.objecter successfully canceled tick 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbde8078e50 msgr2=0x7fbde807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fbde8078e50 0x7fbde807b310 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe10007b60 tx=0x7fbe10007ab0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 10 monclient: shutdown 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c159e40 msgr2=0x7fbe1c150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 --2- 10.20.193.10:0/3657545603 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fbe1c159e40 0x7fbe1c150d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400b580 tx=0x7fbe0400ba50 comp rx=0 tx=0).stop 2026-02-17T12:01:07.747 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe1b7fe640 1 -- 10.20.193.10:0/3657545603 reap_dead start 2026-02-17T12:01:07.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 shutdown_connections 2026-02-17T12:01:07.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 >> 10.20.193.10:0/3657545603 conn(0x7fbe1c0ce290 msgr2=0x7fbe1c06e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:07.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 shutdown_connections 2026-02-17T12:01:07.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 -- 10.20.193.10:0/3657545603 wait complete. 2026-02-17T12:01:07.748 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.742+0000 7fbe2161a640 1 librados: shutdown 2026-02-17T12:01:07.753 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-17T12:01:07.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.821+0000 7f9454ec4640 10 monclient: get_monmap_and_config 2026-02-17T12:01:07.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.821+0000 7f9454ec4640 10 monclient: build_initial_monmap 2026-02-17T12:01:07.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.821+0000 7f9454ec4640 10 monclient: monmap: 2026-02-17T12:01:07.823 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:07.823 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.823 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:07.822301+0000 2026-02-17T12:01:07.823 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:07.822301+0000 2026-02-17T12:01:07.823 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:07.823 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.824 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:07.824 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:07.824 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:07.824 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:07.824 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:07.824 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:07.824 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.821+0000 7f9454ec4640 1 Processor -- start 2026-02-17T12:01:07.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.821+0000 7f9454ec4640 1 -- start start 2026-02-17T12:01:07.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.821+0000 7f9454ec4640 10 monclient: init 2026-02-17T12:01:07.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:07.826 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 10 monclient: _add_conns ranks=[0,4,1,2,5,3] 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9450155e80 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9450074cd0 0x7f94500ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 10 monclient(hunting): picked mon.noname-b con 0x7f9450074cd0 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9450156260 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9450073520 con 0x7f9450155e80 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9450073800 con 0x7f9450156260 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f94500cd840 con 0x7f9450074cd0 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.822+0000 7f9454ec4640 10 monclient(hunting): authenticate will time out at 1337.544326s 2026-02-17T12:01:07.827 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.824+0000 7f944dd74640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f9450074cd0 0x7f94500ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.825+0000 7f944e575640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f9450155e80 0x7f94500745c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44846/0 (socket says 10.20.193.10:44846) 2026-02-17T12:01:07.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.825+0000 7f944e575640 1 -- 10.20.193.10:0/1430692155 learned_addr learned my addr 10.20.193.10:0/1430692155 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:07.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.825+0000 7f944dd74640 10 monclient(hunting): get_auth_request con 0x7f9450074cd0 auth_method 0 2026-02-17T12:01:07.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.825+0000 7f944dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.825+0000 7f944dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.825+0000 7f944dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.829 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.826+0000 7f944dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.826+0000 7f944dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.826+0000 7f944dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.827+0000 7f944dd74640 10 monclient(hunting): handle_auth_done global_id 5161 payload 274 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.827+0000 7f944dd74640 1 -- 10.20.193.10:0/1430692155 >> v1:10.20.193.71:6789/0 conn(0x7f9450156260 legacy=0x7f945015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.827+0000 7f944dd74640 1 -- 10.20.193.10:0/1430692155 >> v1:10.20.193.10:6789/0 conn(0x7f9450155e80 legacy=0x7f94500745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.827+0000 7f944dd74640 10 monclient: _finish_hunting 0 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.827+0000 7f944dd74640 1 monclient: found mon.noname-b 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.827+0000 7f944dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.827+0000 7f944dd74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.827+0000 7f944dd74640 1 -- 10.20.193.10:0/1430692155 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9450073ae0 con 0x7f9450074cd0 2026-02-17T12:01:07.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.829+0000 7f944dd74640 1 --2- 10.20.193.10:0/1430692155 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450074cd0 0x7f94500ccbc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94380098a0 tx=0x7f943802ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab0b56dc3ebc6c3b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 1 -- 10.20.193.10:0/1430692155 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943803c070 con 0x7f9450074cd0 2026-02-17T12:01:07.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 10 monclient: dump: 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 10 monclient: _finish_auth 0 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 10 monclient: _check_auth_tickets 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 1 -- 10.20.193.10:0/1430692155 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943802fad0 con 0x7f9450074cd0 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 5 monclient: authenticate success, global_id 5161 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 1 -- 10.20.193.10:0/1430692155 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438037440 con 0x7f9450074cd0 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 4 set_mon_vals no callback set 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f944d573640 10 monclient: dump: 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 10 monclient: shutdown 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 1 -- 10.20.193.10:0/1430692155 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450074cd0 msgr2=0x7f94500ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 1 --2- 10.20.193.10:0/1430692155 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450074cd0 0x7f94500ccbc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94380098a0 tx=0x7f943802ee10 comp rx=0 tx=0).stop 2026-02-17T12:01:07.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 1 -- 10.20.193.10:0/1430692155 shutdown_connections 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 1 --2- 10.20.193.10:0/1430692155 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450074cd0 0x7f94500ccbc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 1 -- 10.20.193.10:0/1430692155 >> 10.20.193.10:0/1430692155 conn(0x7f94500ce2b0 msgr2=0x7f94500ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 1 -- 10.20.193.10:0/1430692155 shutdown_connections 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.831+0000 7f9454ec4640 1 -- 10.20.193.10:0/1430692155 wait complete. 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient: build_initial_monmap 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient: monmap: 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 librados: starting msgr at 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 librados: starting objecter 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 Processor -- start 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 -- start start 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 librados: setting wanted keys 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 librados: calling monclient init 2026-02-17T12:01:07.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient: init 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9450074cd0 0x7f9450142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient(hunting): picked mon.noname-c con 0x7f9450074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9450155e80 0x7f94500c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient(hunting): picked mon.noname-a con 0x7f9450155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450156260 0x7f94500c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient(hunting): picked mon.noname-b con 0x7f9450156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f94500c4870 con 0x7f9450155e80 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94500740a0 con 0x7f9450156260 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f94500c49f0 con 0x7f9450074cd0 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f9454ec4640 10 monclient(hunting): authenticate will time out at 1337.554715s 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.832+0000 7f944ed76640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450156260 0x7f94500c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944ed76640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450156260 0x7f94500c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59488/0 (socket says 10.20.193.10:59488) 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944ed76640 1 -- 10.20.193.10:0/873170258 learned_addr learned my addr 10.20.193.10:0/873170258 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944ed76640 10 monclient(hunting): get_auth_request con 0x7f9450156260 auth_method 0 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944e575640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9450074cd0 0x7f9450142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944e575640 10 monclient(hunting): get_auth_request con 0x7f9450074cd0 auth_method 0 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:07.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.833+0000 7f944e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.834+0000 7f944ed76640 10 monclient(hunting): handle_auth_done global_id 5167 payload 824 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 1 -- 10.20.193.10:0/873170258 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9450074cd0 msgr2=0x7f9450142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9450074cd0 0x7f9450142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 1 -- 10.20.193.10:0/873170258 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9450155e80 msgr2=0x7f94500c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9450155e80 0x7f94500c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 10 monclient: _finish_hunting 0 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 1 monclient: found mon.noname-b 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 1 -- 10.20.193.10:0/873170258 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94500c9860 con 0x7f9450156260 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f944ed76640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450156260 0x7f94500c7150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f944000cbd0 tx=0x7f944000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f9436ffd640 10 client.?.objecter ms_handle_connect 0x7f9450156260 2026-02-17T12:01:07.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.835+0000 7f9436ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 1 -- 10.20.193.10:0/873170258 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944000ad50 con 0x7f9450156260 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 10 monclient: dump: 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 1 -- 10.20.193.10:0/873170258 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9440003a70 con 0x7f9450156260 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 1 -- 10.20.193.10:0/873170258 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440003e40 con 0x7f9450156260 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f944cd72640 4 set_mon_vals no callback set 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9436ffd640 10 monclient: dump: 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:07.839 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9454ec4640 5 monclient: authenticate success, global_id 5167 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9454ec4640 10 monclient: _renew_subs 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9454ec4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94500c9b40 con 0x7f9450156260 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9454ec4640 10 client.5167.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9454ec4640 10 monclient: _renew_subs 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9454ec4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94500ca100 con 0x7f9450156260 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.837+0000 7f9454ec4640 1 librados: init done 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.838+0000 7f9454ec4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.838+0000 7f9454ec4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.838+0000 7f9454ec4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:07.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.838+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94500745c0 con 0x7f9450156260 2026-02-17T12:01:07.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.849+0000 7f9436ffd640 1 -- 10.20.193.10:0/873170258 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f94400050d0 con 0x7f9450156260 2026-02-17T12:01:07.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.850+0000 7f9436ffd640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f941c078e50 0x7f941c07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:07.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.850+0000 7f944e575640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f941c078e50 0x7f941c07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:07.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.850+0000 7f944e575640 10 monclient: get_auth_request con 0x7f941c078e50 auth_method 0 2026-02-17T12:01:07.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.850+0000 7f9436ffd640 10 client.5167.objecter ms_handle_connect 0x7f941c078e50 2026-02-17T12:01:07.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.850+0000 7f944e575640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f941c078e50 0x7f941c07b310 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9444007d90 tx=0x7f9444007ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:07.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.851+0000 7f9436ffd640 1 -- 10.20.193.10:0/873170258 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f944005e6b0 con 0x7f9450156260 2026-02-17T12:01:07.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.851+0000 7f9436ffd640 10 client.5167.objecter ms_dispatch2 0x7f9450000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:07.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.851+0000 7f9436ffd640 3 client.5167.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:07.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.851+0000 7f9436ffd640 3 client.5167.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:07.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.851+0000 7f9436ffd640 20 client.5167.objecter dump_active .. 0 homeless 2026-02-17T12:01:07.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.953+0000 7f9436ffd640 1 -- 10.20.193.10:0/873170258 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9440062d70 con 0x7f9450156260 2026-02-17T12:01:07.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.953+0000 7f9436ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:07.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:07.953+0000 7f9436ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:08.036 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.035+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7f94501597b0 con 0x7f941c078e50 2026-02-17T12:01:08.037 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.035+0000 7f9436ffd640 1 -- 10.20.193.10:0/873170258 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f94501597b0 con 0x7f941c078e50 2026-02-17T12:01:08.037 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 12 to deep-scrub 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 10 librados: watch_flush enter 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 10 librados: watch_flush exit 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 20 client.5167.objecter shutdown clearing up homeless session... 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 10 client.5167.objecter successfully canceled tick 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f941c078e50 msgr2=0x7f941c07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f941c078e50 0x7f941c07b310 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9444007d90 tx=0x7f9444007ce0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 10 monclient: shutdown 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450156260 msgr2=0x7f94500c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450156260 0x7f94500c7150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f944000cbd0 tx=0x7f944000a430 comp rx=0 tx=0).stop 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 shutdown_connections 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f941c078e50 0x7f941c07b310 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9450156260 0x7f94500c7150 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9450155e80 0x7f94500c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 --2- 10.20.193.10:0/873170258 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9450074cd0 0x7f9450142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 >> 10.20.193.10:0/873170258 conn(0x7f94500ce2b0 msgr2=0x7f94501451a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 shutdown_connections 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 -- 10.20.193.10:0/873170258 wait complete. 2026-02-17T12:01:08.038 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.036+0000 7f9454ec4640 1 librados: shutdown 2026-02-17T12:01:08.046 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T12:01:08.046 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:08.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.112+0000 7fc06dd61640 10 monclient: get_monmap_and_config 2026-02-17T12:01:08.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.112+0000 7fc06dd61640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.112+0000 7fc06dd61640 10 monclient: monmap: 2026-02-17T12:01:08.115 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.115 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.115 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:08.114059+0000 2026-02-17T12:01:08.115 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:08.114059+0000 2026-02-17T12:01:08.115 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 1 Processor -- start 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 1 -- start start 2026-02-17T12:01:08.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 10 monclient: init 2026-02-17T12:01:08.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 10 monclient: _add_conns ranks=[1,0,3,4,5,2] 2026-02-17T12:01:08.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc068150300 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:08.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc0681506e0 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:08.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc0680c4780 0x7fc0680c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 10 monclient(hunting): picked mon.noname-a con 0x7fc0680c4780 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0680c55e0 con 0x7fc0681506e0 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0680c5300 con 0x7fc068150300 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fc068159c80 con 0x7fc0680c4780 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.113+0000 7fc06dd61640 10 monclient(hunting): authenticate will time out at 1337.835781s 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc0677fe640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fc068150300 0x7fc06806fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37746/0 (socket says 10.20.193.10:37746) 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc0677fe640 1 -- 10.20.193.10:0/2298339731 learned_addr learned my addr 10.20.193.10:0/2298339731 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc067fff640 1 --2- 10.20.193.10:0/2298339731 >> v2:10.20.193.10:3300/0 conn(0x7fc0680c4780 0x7fc0680c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc067fff640 10 monclient(hunting): get_auth_request con 0x7fc0680c4780 auth_method 0 2026-02-17T12:01:08.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc067fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc067fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc067fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc067fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc067fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.114+0000 7fc067fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc0667fc640 1 -- 10.20.193.10:0/2298339731 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535947988 0 0) 0x7fc0680c5300 con 0x7fc068150300 2026-02-17T12:01:08.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc0667fc640 10 monclient(hunting): _negotiate 2026-02-17T12:01:08.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc0667fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc0667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc0667fc640 10 monclient(hunting): my global_id is 5170 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc0667fc640 1 -- 10.20.193.10:0/2298339731 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc04c003620 con 0x7fc068150300 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc067fff640 10 monclient(hunting): handle_auth_done global_id 5133 payload 274 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc067fff640 1 -- 10.20.193.10:0/2298339731 >> v1:10.20.193.71:6789/0 conn(0x7fc068150300 legacy=0x7fc06806fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc067fff640 1 -- 10.20.193.10:0/2298339731 >> v1:10.20.193.10:6789/0 conn(0x7fc0681506e0 legacy=0x7fc06815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc067fff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc067fff640 1 monclient: found mon.noname-a 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc067fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc067fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.115+0000 7fc067fff640 1 -- 10.20.193.10:0/2298339731 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc068159f60 con 0x7fc0680c4780 2026-02-17T12:01:08.123 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.116+0000 7fc067fff640 1 --2- 10.20.193.10:0/2298339731 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0680c4780 0x7fc0680c4bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009d90 tx=0x7fc05c02f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68801f7dc55421c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 1 -- 10.20.193.10:0/2298339731 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c03c070 con 0x7fc0680c4780 2026-02-17T12:01:08.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:08.129 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 10 monclient: dump: 2026-02-17T12:01:08.129 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.129 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.129 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.129 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.129 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 1 -- 10.20.193.10:0/2298339731 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c037440 con 0x7fc0680c4780 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 5 monclient: authenticate success, global_id 5133 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:08.130 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 1 -- 10.20.193.10:0/2298339731 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c037810 con 0x7fc0680c4780 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 4 set_mon_vals no callback set 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc0667fc640 10 monclient: dump: 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.131 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 10 monclient: shutdown 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 1 -- 10.20.193.10:0/2298339731 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0680c4780 msgr2=0x7fc0680c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 1 --2- 10.20.193.10:0/2298339731 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0680c4780 0x7fc0680c4bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009d90 tx=0x7fc05c02f270 comp rx=0 tx=0).stop 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 1 -- 10.20.193.10:0/2298339731 shutdown_connections 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 1 --2- 10.20.193.10:0/2298339731 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0680c4780 0x7fc0680c4bf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 1 -- 10.20.193.10:0/2298339731 >> 10.20.193.10:0/2298339731 conn(0x7fc0680cd560 msgr2=0x7fc0680cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.132 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 1 -- 10.20.193.10:0/2298339731 shutdown_connections 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 1 -- 10.20.193.10:0/2298339731 wait complete. 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.119+0000 7fc06dd61640 10 monclient: monmap: 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:08.133 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 librados: starting msgr at 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 librados: starting objecter 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 Processor -- start 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 -- start start 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 librados: setting wanted keys 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 librados: calling monclient init 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient: init 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc0680c4780 0x7fc0681f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient(hunting): picked mon.noname-b con 0x7fc0680c4780 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:08.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc068150300 0x7fc06815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient(hunting): picked mon.noname-c con 0x7fc068150300 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0681506e0 0x7fc0680c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient(hunting): picked mon.noname-a con 0x7fc0681506e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc068070510 con 0x7fc0681506e0 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc06815a520 con 0x7fc0680c4780 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc06815d770 con 0x7fc068150300 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc06dd61640 10 monclient(hunting): authenticate will time out at 1337.842650s 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc067fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0681506e0 0x7fc0680c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.135 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.120+0000 7fc0677fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc0680c4780 0x7fc0681f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc067fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0681506e0 0x7fc0680c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44826/0 (socket says 10.20.193.10:44826) 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc067fff640 1 -- 10.20.193.10:0/1383500146 learned_addr learned my addr 10.20.193.10:0/1383500146 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc067fff640 10 monclient(hunting): get_auth_request con 0x7fc0681506e0 auth_method 0 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc067fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc067fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc067fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc0677fe640 10 monclient(hunting): get_auth_request con 0x7fc0680c4780 auth_method 0 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc0677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc0677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc0677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc066ffd640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc068150300 0x7fc06815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.136 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc067fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc067fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc067fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc066ffd640 10 monclient(hunting): get_auth_request con 0x7fc068150300 auth_method 0 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc066ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc066ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc066ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc0677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc0677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc0677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc066ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc066ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.121+0000 7fc066ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.137 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 10 monclient(hunting): handle_auth_done global_id 5136 payload 824 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 1 -- 10.20.193.10:0/1383500146 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc068150300 msgr2=0x7fc06815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc068150300 0x7fc06815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 1 -- 10.20.193.10:0/1383500146 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc0680c4780 msgr2=0x7fc0681f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc0680c4780 0x7fc0681f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 1 monclient: found mon.noname-a 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.122+0000 7fc067fff640 1 -- 10.20.193.10:0/1383500146 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06815ae80 con 0x7fc0681506e0 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.123+0000 7fc067fff640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0681506e0 0x7fc0680c3920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc05c03a040 tx=0x7fc05c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.123+0000 7fc043fff640 10 client.?.objecter ms_handle_connect 0x7fc0681506e0 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.123+0000 7fc043fff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:08.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 1 -- 10.20.193.10:0/1383500146 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c047020 con 0x7fc0681506e0 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 10 monclient: dump: 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.139 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 1 -- 10.20.193.10:0/1383500146 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c042670 con 0x7fc0681506e0 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc06dd61640 5 monclient: authenticate success, global_id 5136 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc06dd61640 10 monclient: _renew_subs 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc06dd61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06815b160 con 0x7fc0681506e0 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 1 -- 10.20.193.10:0/1383500146 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c03c040 con 0x7fc0681506e0 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.140 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc043fff640 10 monclient: dump: 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc065ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:08.141 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc06dd61640 10 client.5136.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc06dd61640 10 monclient: _renew_subs 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc06dd61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06815b720 con 0x7fc0681506e0 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.125+0000 7fc06dd61640 1 librados: init done 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.126+0000 7fc06dd61640 10 client.5136.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.126+0000 7fc06dd61640 15 client.5136.objecter _session_command_op_assign -1 1 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.126+0000 7fc06dd61640 20 client.5136.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.126+0000 7fc06dd61640 10 client.5136.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.126+0000 7fc06dd61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.142 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.126+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc06815ac30 con 0x7fc0681506e0 2026-02-17T12:01:08.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.137+0000 7fc043fff640 1 -- 10.20.193.10:0/1383500146 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc05c042a60 con 0x7fc0681506e0 2026-02-17T12:01:08.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.137+0000 7fc043fff640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc038078e00 0x7fc03807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.137+0000 7fc0677fe640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc038078e00 0x7fc03807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.137+0000 7fc0677fe640 10 monclient: get_auth_request con 0x7fc038078e00 auth_method 0 2026-02-17T12:01:08.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.137+0000 7fc043fff640 10 client.5136.objecter ms_handle_connect 0x7fc038078e00 2026-02-17T12:01:08.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.137+0000 7fc0677fe640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc038078e00 0x7fc03807b2c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc054007b60 tx=0x7fc054007ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 1 -- 10.20.193.10:0/1383500146 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc05c0bd8b0 con 0x7fc0681506e0 2026-02-17T12:01:08.145 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 10 client.5136.objecter ms_dispatch2 0x7fc068000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 3 client.5136.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 3 client.5136.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 10 client.5136.objecter checking command 1 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7fc0380812e0 0x7fc038083700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 20 client.5136.objecter _get_session s=0x7fc038080c10 osd=1 3 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 20 client.5136.objecter put_session s=0x7fc038080c10 osd=1 3 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 15 client.5136.objecter _session_command_op_remove -1 1 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 20 client.5136.objecter _get_session s=0x7fc038080c10 osd=1 3 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 20 client.5136.objecter get_session s=0x7fc038080c10 osd=1 3 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 15 client.5136.objecter _session_command_op_assign 1 1 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 20 client.5136.objecter put_session s=0x7fc038080c10 osd=1 4 2026-02-17T12:01:08.146 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 10 client.5136.objecter _send_command 1 2026-02-17T12:01:08.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 1 -- 10.20.193.10:0/1383500146 --> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc05c04de50 con 0x7fc0380812e0 2026-02-17T12:01:08.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 20 client.5136.objecter dump_active .. 0 homeless 2026-02-17T12:01:08.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 1 -- 10.20.193.10:0/1383500146 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc05c084370 con 0x7fc0681506e0 2026-02-17T12:01:08.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc043fff640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:08.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.138+0000 7fc066ffd640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7fc0380812e0 0x7fc038083700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.139+0000 7fc066ffd640 10 monclient: get_auth_request con 0x7fc0380812e0 auth_method 0 2026-02-17T12:01:08.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.140+0000 7fc043fff640 10 client.5136.objecter ms_handle_connect 0x7fc0380812e0 2026-02-17T12:01:08.147 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.140+0000 7fc066ffd640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7fc0380812e0 0x7fc038083700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.150+0000 7fc043fff640 1 -- 10.20.193.10:0/1383500146 <== osd.1 v2:10.20.193.71:6808/168831009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc05c04de50 con 0x7fc0380812e0 2026-02-17T12:01:08.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.150+0000 7fc043fff640 10 client.5136.objecter ms_dispatch2 0x7fc068000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:08.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.150+0000 7fc043fff640 10 client.5136.objecter _finish_command 1 = system:0 2026-02-17T12:01:08.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.150+0000 7fc043fff640 20 client.5136.objecter put_session s=0x7fc038080c10 osd=1 4 2026-02-17T12:01:08.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.150+0000 7fc043fff640 15 client.5136.objecter _session_command_op_remove 1 1 2026-02-17T12:01:08.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 10 client.5136.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:08.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 15 client.5136.objecter _session_command_op_assign -1 2 2026-02-17T12:01:08.158 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 20 client.5136.objecter _get_session s=0x7fc038080c10 osd=1 3 2026-02-17T12:01:08.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 20 client.5136.objecter put_session s=0x7fc038080c10 osd=1 3 2026-02-17T12:01:08.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 20 client.5136.objecter _get_session s=0x7fc038080c10 osd=1 3 2026-02-17T12:01:08.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 15 client.5136.objecter _session_command_op_remove -1 2 2026-02-17T12:01:08.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 20 client.5136.objecter get_session s=0x7fc038080c10 osd=1 3 2026-02-17T12:01:08.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 15 client.5136.objecter _session_command_op_assign 1 2 2026-02-17T12:01:08.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 20 client.5136.objecter put_session s=0x7fc038080c10 osd=1 4 2026-02-17T12:01:08.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 10 client.5136.objecter _send_command 2 2026-02-17T12:01:08.159 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.156+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 --> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc06815e1b0 con 0x7fc0380812e0 2026-02-17T12:01:08.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc043fff640 1 -- 10.20.193.10:0/1383500146 <== osd.1 v2:10.20.193.71:6808/168831009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc06815e1b0 con 0x7fc0380812e0 2026-02-17T12:01:08.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc043fff640 10 client.5136.objecter ms_dispatch2 0x7fc068000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:08.166 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc043fff640 10 client.5136.objecter _finish_command 2 = system:0 2026-02-17T12:01:08.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc043fff640 20 client.5136.objecter put_session s=0x7fc038080c10 osd=1 4 2026-02-17T12:01:08.167 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc043fff640 15 client.5136.objecter _session_command_op_remove 1 2 2026-02-17T12:01:08.167 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:08.167 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:08.167 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:08.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 10 librados: watch_flush enter 2026-02-17T12:01:08.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 10 librados: watch_flush exit 2026-02-17T12:01:08.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 10 client.5136.objecter close_session for osd.1 2026-02-17T12:01:08.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7fc0380812e0 msgr2=0x7fc038083700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.71:6808/168831009,v1:10.20.193.71:6809/168831009] conn(0x7fc0380812e0 0x7fc038083700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 20 client.5136.objecter put_session s=0x7fc038080c10 osd=1 1 2026-02-17T12:01:08.169 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 20 client.5136.objecter shutdown clearing up homeless session... 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 10 client.5136.objecter successfully canceled tick 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc038078e00 msgr2=0x7fc03807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc038078e00 0x7fc03807b2c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc054007b60 tx=0x7fc054007ab0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 10 monclient: shutdown 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0681506e0 msgr2=0x7fc0680c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 --2- 10.20.193.10:0/1383500146 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc0681506e0 0x7fc0680c3920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc05c03a040 tx=0x7fc05c004b40 comp rx=0 tx=0).stop 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc067fff640 1 -- 10.20.193.10:0/1383500146 reap_dead start 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 shutdown_connections 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 >> 10.20.193.10:0/1383500146 conn(0x7fc0680cd560 msgr2=0x7fc06806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.170 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 shutdown_connections 2026-02-17T12:01:08.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 -- 10.20.193.10:0/1383500146 wait complete. 2026-02-17T12:01:08.171 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.164+0000 7fc06dd61640 1 librados: shutdown 2026-02-17T12:01:08.173 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T12:01:08.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.240+0000 7f3d81ff8640 10 monclient: get_monmap_and_config 2026-02-17T12:01:08.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.240+0000 7f3d81ff8640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.240+0000 7f3d81ff8640 10 monclient: monmap: 2026-02-17T12:01:08.242 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.242 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.242 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:08.241579+0000 2026-02-17T12:01:08.242 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:08.241579+0000 2026-02-17T12:01:08.243 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.243 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.243 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:08.243 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:08.243 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:08.243 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:08.243 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:08.243 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:08.243 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.240+0000 7f3d81ff8640 1 Processor -- start 2026-02-17T12:01:08.245 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.240+0000 7f3d81ff8640 1 -- start start 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.240+0000 7f3d81ff8640 10 monclient: init 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 10 monclient: _add_conns ranks=[0,3,4,2,5,1] 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3d7c152660 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f3d7c15b030 0x7f3d7c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 10 monclient(hunting): picked mon.noname-a con 0x7f3d7c15b030 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f3d7c152a40 0x7f3d7c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 10 monclient(hunting): picked mon.noname-b con 0x7f3d7c152a40 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c0c71e0 con 0x7f3d7c152660 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f3d7c0c77a0 con 0x7f3d7c15b030 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3d7c0c74c0 con 0x7f3d7c152a40 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d81ff8640 10 monclient(hunting): authenticate will time out at 1337.963361s 2026-02-17T12:01:08.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d7bfff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f3d7c152a40 0x7f3d7c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d7b7fe640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f3d7c152660 0x7f3d7c15a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44866/0 (socket says 10.20.193.10:44866) 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d7b7fe640 1 -- 10.20.193.10:0/1672029384 learned_addr learned my addr 10.20.193.10:0/1672029384 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d7bfff640 10 monclient(hunting): get_auth_request con 0x7f3d7c152a40 auth_method 0 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d7bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.241+0000 7f3d7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.242+0000 7f3d7bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.242+0000 7f3d7bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.242+0000 7f3d7bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7affd640 1 --2- 10.20.193.10:0/1672029384 >> v2:10.20.193.10:3300/0 conn(0x7f3d7c15b030 0x7f3d7c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7bfff640 10 monclient(hunting): handle_auth_done global_id 5176 payload 274 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7bfff640 1 -- 10.20.193.10:0/1672029384 >> v2:10.20.193.10:3300/0 conn(0x7f3d7c15b030 msgr2=0x7f3d7c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7bfff640 1 --2- 10.20.193.10:0/1672029384 >> v2:10.20.193.10:3300/0 conn(0x7f3d7c15b030 0x7f3d7c0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7bfff640 1 -- 10.20.193.10:0/1672029384 >> v1:10.20.193.10:6789/0 conn(0x7f3d7c152660 legacy=0x7f3d7c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7bfff640 1 monclient: found mon.noname-b 2026-02-17T12:01:08.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7bfff640 1 -- 10.20.193.10:0/1672029384 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c159e40 con 0x7f3d7c152a40 2026-02-17T12:01:08.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7affd640 10 monclient: get_auth_request con 0x7f3d7c15b030 auth_method 0 2026-02-17T12:01:08.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.243+0000 7f3d7affd640 1 --2- 10.20.193.10:0/1672029384 >> v2:10.20.193.10:3300/0 conn(0x7f3d7c15b030 0x7f3d7c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:01:08.248 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.244+0000 7f3d7bfff640 1 --2- 10.20.193.10:0/1672029384 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 0x7f3d7c0c9310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c072150 tx=0x7f3d7002f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f50c3276156d4c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 1 -- 10.20.193.10:0/1672029384 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7003c070 con 0x7f3d7c152a40 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 10 monclient: dump: 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.252 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 1 -- 10.20.193.10:0/1672029384 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d70037440 con 0x7f3d7c152a40 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 5 monclient: authenticate success, global_id 5176 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 1 -- 10.20.193.10:0/1672029384 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70037810 con 0x7f3d7c152a40 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d7a7fc640 10 monclient: dump: 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.253 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 4 set_mon_vals no callback set 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 10 monclient: shutdown 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 1 -- 10.20.193.10:0/1672029384 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 msgr2=0x7f3d7c0c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 1 --2- 10.20.193.10:0/1672029384 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 0x7f3d7c0c9310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c072150 tx=0x7f3d7002f1c0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 1 -- 10.20.193.10:0/1672029384 shutdown_connections 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 1 --2- 10.20.193.10:0/1672029384 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 0x7f3d7c0c9310 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.254 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 1 --2- 10.20.193.10:0/1672029384 >> v2:10.20.193.10:3300/0 conn(0x7f3d7c15b030 0x7f3d7c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 1 -- 10.20.193.10:0/1672029384 >> 10.20.193.10:0/1672029384 conn(0x7f3d7c0c9d80 msgr2=0x7f3d7c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 1 -- 10.20.193.10:0/1672029384 shutdown_connections 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 1 -- 10.20.193.10:0/1672029384 wait complete. 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.246+0000 7f3d81ff8640 10 monclient: monmap: 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 librados: starting msgr at 2026-02-17T12:01:08.255 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 librados: starting objecter 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 Processor -- start 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 -- start start 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 librados: setting wanted keys 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 librados: calling monclient init 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient: init 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3d7c152660 0x7f3d7c1f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient(hunting): picked mon.noname-a con 0x7f3d7c152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 0x7f3d7c13e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient(hunting): picked mon.noname-b con 0x7f3d7c152a40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3d7c15b030 0x7f3d7c13eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient(hunting): picked mon.noname-c con 0x7f3d7c15b030 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0c7c80 con 0x7f3d7c152660 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c15a400 con 0x7f3d7c152a40 2026-02-17T12:01:08.256 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0c7e00 con 0x7f3d7c15b030 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d81ff8640 10 monclient(hunting): authenticate will time out at 1337.969642s 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d7b7fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3d7c152660 0x7f3d7c1f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.247+0000 7f3d7affd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 0x7f3d7c13e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7affd640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 0x7f3d7c13e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59508/0 (socket says 10.20.193.10:59508) 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7affd640 1 -- 10.20.193.10:0/322266367 learned_addr learned my addr 10.20.193.10:0/322266367 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7affd640 10 monclient(hunting): get_auth_request con 0x7f3d7c152a40 auth_method 0 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7bfff640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3d7c15b030 0x7f3d7c13eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7b7fe640 10 monclient(hunting): get_auth_request con 0x7f3d7c152660 auth_method 0 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.257 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7bfff640 10 monclient(hunting): get_auth_request con 0x7f3d7c15b030 auth_method 0 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.248+0000 7f3d7bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 10 monclient(hunting): handle_auth_done global_id 5179 payload 824 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 1 -- 10.20.193.10:0/322266367 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3d7c15b030 msgr2=0x7f3d7c13eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3d7c15b030 0x7f3d7c13eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 1 -- 10.20.193.10:0/322266367 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3d7c152660 msgr2=0x7f3d7c1f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3d7c152660 0x7f3d7c1f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 1 monclient: found mon.noname-b 2026-02-17T12:01:08.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.249+0000 7f3d7affd640 1 -- 10.20.193.10:0/322266367 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c156830 con 0x7f3d7c152a40 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.250+0000 7f3d7affd640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 0x7f3d7c13e660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00c820 tx=0x7f3d6c00ccf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.250+0000 7f3d57fff640 10 client.?.objecter ms_handle_connect 0x7f3d7c152a40 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.250+0000 7f3d57fff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 1 -- 10.20.193.10:0/322266367 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c015070 con 0x7f3d7c152a40 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 10 monclient: dump: 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.261 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 1 -- 10.20.193.10:0/322266367 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6c0079d0 con 0x7f3d7c152a40 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 1 -- 10.20.193.10:0/322266367 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c007da0 con 0x7f3d7c152a40 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d79ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d57fff640 10 monclient: dump: 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.262 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d81ff8640 5 monclient: authenticate success, global_id 5179 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d81ff8640 10 monclient: _renew_subs 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d81ff8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c156b10 con 0x7f3d7c152a40 2026-02-17T12:01:08.263 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d81ff8640 10 client.5179.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:08.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d81ff8640 10 monclient: _renew_subs 2026-02-17T12:01:08.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d81ff8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c073260 con 0x7f3d7c152a40 2026-02-17T12:01:08.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.252+0000 7f3d81ff8640 1 librados: init done 2026-02-17T12:01:08.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.253+0000 7f3d81ff8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.253+0000 7f3d81ff8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.253+0000 7f3d81ff8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.264 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.253+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7c069900 con 0x7f3d7c152a40 2026-02-17T12:01:08.266 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.264+0000 7f3d57fff640 1 -- 10.20.193.10:0/322266367 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f3d6c024480 con 0x7f3d7c152a40 2026-02-17T12:01:08.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.265+0000 7f3d57fff640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3d4c078e00 0x7f3d4c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.265+0000 7f3d7b7fe640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3d4c078e00 0x7f3d4c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.265+0000 7f3d7b7fe640 10 monclient: get_auth_request con 0x7f3d4c078e00 auth_method 0 2026-02-17T12:01:08.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.265+0000 7f3d7b7fe640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3d4c078e00 0x7f3d4c07b2c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d68002770 tx=0x7f3d68002930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.267 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.265+0000 7f3d57fff640 10 client.5179.objecter ms_handle_connect 0x7f3d4c078e00 2026-02-17T12:01:08.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.266+0000 7f3d57fff640 1 -- 10.20.193.10:0/322266367 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f3d6c05e1a0 con 0x7f3d7c152a40 2026-02-17T12:01:08.268 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.266+0000 7f3d57fff640 10 client.5179.objecter ms_dispatch2 0x7f3d7c000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:08.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.266+0000 7f3d57fff640 3 client.5179.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:08.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.266+0000 7f3d57fff640 3 client.5179.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:08.269 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.266+0000 7f3d57fff640 20 client.5179.objecter dump_active .. 0 homeless 2026-02-17T12:01:08.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.369+0000 7f3d57fff640 1 -- 10.20.193.10:0/322266367 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3d7c069900 con 0x7f3d7c152a40 2026-02-17T12:01:08.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.369+0000 7f3d57fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.369+0000 7f3d57fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:08.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.451+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3d7c156240 con 0x7f3d4c078e00 2026-02-17T12:01:08.453 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.451+0000 7f3d57fff640 1 -- 10.20.193.10:0/322266367 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d7c156240 con 0x7f3d4c078e00 2026-02-17T12:01:08.453 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 10 librados: watch_flush enter 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 10 librados: watch_flush exit 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 20 client.5179.objecter shutdown clearing up homeless session... 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 10 client.5179.objecter successfully canceled tick 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3d4c078e00 msgr2=0x7f3d4c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3d4c078e00 0x7f3d4c07b2c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d68002770 tx=0x7f3d68002930 comp rx=0 tx=0).stop 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 10 monclient: shutdown 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 msgr2=0x7f3d7c13e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 0x7f3d7c13e660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00c820 tx=0x7f3d6c00ccf0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 shutdown_connections 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f3d4c078e00 0x7f3d4c07b2c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3d7c15b030 0x7f3d7c13eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f3d7c152a40 0x7f3d7c13e660 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 --2- 10.20.193.10:0/322266367 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f3d7c152660 0x7f3d7c1f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 >> 10.20.193.10:0/322266367 conn(0x7f3d7c0c9d80 msgr2=0x7f3d7c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 shutdown_connections 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 -- 10.20.193.10:0/322266367 wait complete. 2026-02-17T12:01:08.454 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.452+0000 7f3d81ff8640 1 librados: shutdown 2026-02-17T12:01:08.461 INFO:tasks.ceph:Scrubbing osd.5 2026-02-17T12:01:08.461 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:08.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.529+0000 7fa6021ce640 10 monclient: get_monmap_and_config 2026-02-17T12:01:08.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.529+0000 7fa6021ce640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.529+0000 7fa6021ce640 10 monclient: monmap: 2026-02-17T12:01:08.532 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.532 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.532 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:08.530865+0000 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:08.530865+0000 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 1 Processor -- start 2026-02-17T12:01:08.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 1 -- start start 2026-02-17T12:01:08.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 10 monclient: init 2026-02-17T12:01:08.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 10 monclient: _add_conns ranks=[2,4,1,3,0,5] 2026-02-17T12:01:08.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa5fc159f20 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:08.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fa5fc15a300 0x7fa5fc0734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 10 monclient(hunting): picked mon.noname-b con 0x7fa5fc15a300 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa5fc073a00 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5fc072460 con 0x7fa5fc073a00 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5fc164580 con 0x7fa5fc159f20 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc072700 con 0x7fa5fc15a300 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.530+0000 7fa6021ce640 10 monclient(hunting): authenticate will time out at 1338.252695s 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.531+0000 7fa5fb7fe640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fa5fc159f20 0x7fa5fc160be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:57470/0 (socket says 10.20.193.10:57470) 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.531+0000 7fa5fb7fe640 1 -- 10.20.193.10:0/673344636 learned_addr learned my addr 10.20.193.10:0/673344636 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.531+0000 7fa5faffd640 1 --2- 10.20.193.10:0/673344636 >> v2:10.20.193.71:3300/0 conn(0x7fa5fc15a300 0x7fa5fc0734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.531+0000 7fa5faffd640 10 monclient(hunting): get_auth_request con 0x7fa5fc15a300 auth_method 0 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.531+0000 7fa5faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.531+0000 7fa5faffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.531+0000 7fa5faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.532+0000 7fa5faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.532+0000 7fa5faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.532+0000 7fa5faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.532+0000 7fa5fa7fc640 1 -- 10.20.193.10:0/673344636 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399914271 0 0) 0x7fa5fc164580 con 0x7fa5fc159f20 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.532+0000 7fa5fa7fc640 10 monclient(hunting): _negotiate 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.532+0000 7fa5fa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.532+0000 7fa5fa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.532+0000 7fa5fa7fc640 10 monclient(hunting): my global_id is 5186 2026-02-17T12:01:08.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.532+0000 7fa5fa7fc640 1 -- 10.20.193.10:0/673344636 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5e0003620 con 0x7fa5fc159f20 2026-02-17T12:01:08.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.533+0000 7fa5faffd640 10 monclient(hunting): handle_auth_done global_id 5182 payload 274 2026-02-17T12:01:08.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.533+0000 7fa5faffd640 1 -- 10.20.193.10:0/673344636 >> v1:10.20.193.153:6789/0 conn(0x7fa5fc159f20 legacy=0x7fa5fc160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.533+0000 7fa5faffd640 1 -- 10.20.193.10:0/673344636 >> v1:10.20.193.71:6789/0 conn(0x7fa5fc073a00 legacy=0x7fa5fc06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.533+0000 7fa5faffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.533+0000 7fa5faffd640 1 monclient: found mon.noname-b 2026-02-17T12:01:08.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.533+0000 7fa5faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.533+0000 7fa5faffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.533+0000 7fa5faffd640 1 -- 10.20.193.10:0/673344636 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc0729e0 con 0x7fa5fc15a300 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.536+0000 7fa5faffd640 1 --2- 10.20.193.10:0/673344636 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5fc15a300 0x7fa5fc0734c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0098a0 tx=0x7fa5ec02ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96dc8adff6d32b0a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 1 -- 10.20.193.10:0/673344636 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec03c070 con 0x7fa5fc15a300 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 10 monclient: dump: 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.545 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 1 -- 10.20.193.10:0/673344636 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ec02fc10 con 0x7fa5fc15a300 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 1 -- 10.20.193.10:0/673344636 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec037440 con 0x7fa5fc15a300 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 5 monclient: authenticate success, global_id 5182 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa5fa7fc640 10 monclient: dump: 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.547 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 4 set_mon_vals no callback set 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 10 monclient: shutdown 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 1 -- 10.20.193.10:0/673344636 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5fc15a300 msgr2=0x7fa5fc0734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 1 --2- 10.20.193.10:0/673344636 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5fc15a300 0x7fa5fc0734c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0098a0 tx=0x7fa5ec02ef00 comp rx=0 tx=0).stop 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 1 -- 10.20.193.10:0/673344636 shutdown_connections 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 1 --2- 10.20.193.10:0/673344636 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5fc15a300 0x7fa5fc0734c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 1 -- 10.20.193.10:0/673344636 >> 10.20.193.10:0/673344636 conn(0x7fa5fc0cd560 msgr2=0x7fa5fc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 1 -- 10.20.193.10:0/673344636 shutdown_connections 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 1 -- 10.20.193.10:0/673344636 wait complete. 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.538+0000 7fa6021ce640 10 monclient: monmap: 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:08.549 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 librados: starting msgr at 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 librados: starting objecter 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 Processor -- start 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 -- start start 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 librados: setting wanted keys 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 librados: calling monclient init 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient: init 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5fc073a00 0x7fa5fc1faf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.550 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient(hunting): picked mon.noname-b con 0x7fa5fc073a00 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa5fc159f20 0x7fa5fc1f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient(hunting): picked mon.noname-c con 0x7fa5fc159f20 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5fc15a300 0x7fa5fc1fa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient(hunting): picked mon.noname-a con 0x7fa5fc15a300 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc161650 con 0x7fa5fc15a300 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc072fa0 con 0x7fa5fc073a00 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc070200 con 0x7fa5fc159f20 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.551 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.539+0000 7fa6021ce640 10 monclient(hunting): authenticate will time out at 1338.261804s 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5fc073a00 0x7fa5fc1faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fbfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5fc15a300 0x7fa5fc1fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5faffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa5fc159f20 0x7fa5fc1f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5fc073a00 0x7fa5fc1faf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59524/0 (socket says 10.20.193.10:59524) 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 1 -- 10.20.193.10:0/1884356882 learned_addr learned my addr 10.20.193.10:0/1884356882 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 10 monclient(hunting): get_auth_request con 0x7fa5fc073a00 auth_method 0 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fbfff640 10 monclient(hunting): get_auth_request con 0x7fa5fc15a300 auth_method 0 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5faffd640 10 monclient(hunting): get_auth_request con 0x7fa5fc159f20 auth_method 0 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5faffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.540+0000 7fa5faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 10 monclient(hunting): handle_auth_done global_id 5145 payload 824 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 1 -- 10.20.193.10:0/1884356882 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa5fc159f20 msgr2=0x7fa5fc1f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fa5fc159f20 0x7fa5fc1f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 1 -- 10.20.193.10:0/1884356882 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5fc073a00 msgr2=0x7fa5fc1faf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fa5fc073a00 0x7fa5fc1faf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 1 monclient: found mon.noname-a 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.554 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.542+0000 7fa5fbfff640 1 -- 10.20.193.10:0/1884356882 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc1fb6f0 con 0x7fa5fc15a300 2026-02-17T12:01:08.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.543+0000 7fa5fbfff640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5fc15a300 0x7fa5fc1fa570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cb90 tx=0x7fa5f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.543+0000 7fa5d7fff640 10 client.?.objecter ms_handle_connect 0x7fa5fc15a300 2026-02-17T12:01:08.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.543+0000 7fa5d7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:08.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 1 -- 10.20.193.10:0/1884356882 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000ad50 con 0x7fa5fc15a300 2026-02-17T12:01:08.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:08.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 10 monclient: dump: 2026-02-17T12:01:08.557 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.557 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.558 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 1 -- 10.20.193.10:0/1884356882 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f0003a30 con 0x7fa5fc15a300 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 5 monclient: authenticate success, global_id 5145 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 10 monclient: _renew_subs 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc1fb9d0 con 0x7fa5fc15a300 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 1 -- 10.20.193.10:0/1884356882 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0003e00 con 0x7fa5fc15a300 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5d7fff640 10 monclient: dump: 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.559 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.560 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.560 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.560 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.560 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.560 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.560 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.560 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.560 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa5f9ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 10 client.5145.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 10 monclient: _renew_subs 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc1f7c60 con 0x7fa5fc15a300 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 1 librados: init done 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 10 client.5145.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 15 client.5145.objecter _session_command_op_assign -1 1 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 20 client.5145.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 10 client.5145.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:08.561 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.562 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.545+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5fc1f89a0 con 0x7fa5fc15a300 2026-02-17T12:01:08.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.558+0000 7fa5d7fff640 1 -- 10.20.193.10:0/1884356882 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fa5f00050d0 con 0x7fa5fc15a300 2026-02-17T12:01:08.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.558+0000 7fa5d7fff640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa5cc078e50 0x7fa5cc07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.558+0000 7fa5fb7fe640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa5cc078e50 0x7fa5cc07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.558+0000 7fa5fb7fe640 10 monclient: get_auth_request con 0x7fa5cc078e50 auth_method 0 2026-02-17T12:01:08.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.558+0000 7fa5d7fff640 10 client.5145.objecter ms_handle_connect 0x7fa5cc078e50 2026-02-17T12:01:08.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.558+0000 7fa5fb7fe640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa5cc078e50 0x7fa5cc07b310 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8005980 tx=0x7fa5e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 1 -- 10.20.193.10:0/1884356882 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fa5f005e590 con 0x7fa5fc15a300 2026-02-17T12:01:08.564 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 10 client.5145.objecter ms_dispatch2 0x7fa5fc000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 3 client.5145.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 3 client.5145.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 10 client.5145.objecter checking command 1 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7fa5cc081330 0x7fa5cc083750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 20 client.5145.objecter _get_session s=0x7fa5cc080c60 osd=5 3 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 20 client.5145.objecter put_session s=0x7fa5cc080c60 osd=5 3 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 15 client.5145.objecter _session_command_op_remove -1 1 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 20 client.5145.objecter _get_session s=0x7fa5cc080c60 osd=5 3 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 20 client.5145.objecter get_session s=0x7fa5cc080c60 osd=5 3 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 15 client.5145.objecter _session_command_op_assign 5 1 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 20 client.5145.objecter put_session s=0x7fa5cc080c60 osd=5 4 2026-02-17T12:01:08.565 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 10 client.5145.objecter _send_command 1 2026-02-17T12:01:08.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 1 -- 10.20.193.10:0/1884356882 --> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5f00058d0 con 0x7fa5cc081330 2026-02-17T12:01:08.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 20 client.5145.objecter dump_active .. 0 homeless 2026-02-17T12:01:08.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 1 -- 10.20.193.10:0/1884356882 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa5f005e950 con 0x7fa5fc15a300 2026-02-17T12:01:08.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.560+0000 7fa5d7fff640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:08.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.561+0000 7fa5faffd640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7fa5cc081330 0x7fa5cc083750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.561+0000 7fa5faffd640 10 monclient: get_auth_request con 0x7fa5cc081330 auth_method 0 2026-02-17T12:01:08.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.563+0000 7fa5faffd640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7fa5cc081330 0x7fa5cc083750 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.566 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.563+0000 7fa5d7fff640 10 client.5145.objecter ms_handle_connect 0x7fa5cc081330 2026-02-17T12:01:08.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.573+0000 7fa5d7fff640 1 -- 10.20.193.10:0/1884356882 <== osd.5 v2:10.20.193.71:6816/1474787626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fa5f00058d0 con 0x7fa5cc081330 2026-02-17T12:01:08.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.573+0000 7fa5d7fff640 10 client.5145.objecter ms_dispatch2 0x7fa5fc000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:08.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.573+0000 7fa5d7fff640 10 client.5145.objecter _finish_command 1 = system:0 2026-02-17T12:01:08.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.573+0000 7fa5d7fff640 20 client.5145.objecter put_session s=0x7fa5cc080c60 osd=5 4 2026-02-17T12:01:08.575 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.573+0000 7fa5d7fff640 15 client.5145.objecter _session_command_op_remove 5 1 2026-02-17T12:01:08.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 10 client.5145.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:08.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 15 client.5145.objecter _session_command_op_assign -1 2 2026-02-17T12:01:08.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 20 client.5145.objecter _get_session s=0x7fa5cc080c60 osd=5 3 2026-02-17T12:01:08.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 20 client.5145.objecter put_session s=0x7fa5cc080c60 osd=5 3 2026-02-17T12:01:08.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 20 client.5145.objecter _get_session s=0x7fa5cc080c60 osd=5 3 2026-02-17T12:01:08.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 15 client.5145.objecter _session_command_op_remove -1 2 2026-02-17T12:01:08.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 20 client.5145.objecter get_session s=0x7fa5cc080c60 osd=5 3 2026-02-17T12:01:08.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 15 client.5145.objecter _session_command_op_assign 5 2 2026-02-17T12:01:08.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 20 client.5145.objecter put_session s=0x7fa5cc080c60 osd=5 4 2026-02-17T12:01:08.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 10 client.5145.objecter _send_command 2 2026-02-17T12:01:08.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.579+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 --> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa5fc0734c0 con 0x7fa5cc081330 2026-02-17T12:01:08.589 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa5d7fff640 1 -- 10.20.193.10:0/1884356882 <== osd.5 v2:10.20.193.71:6816/1474787626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa5fc0734c0 con 0x7fa5cc081330 2026-02-17T12:01:08.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa5d7fff640 10 client.5145.objecter ms_dispatch2 0x7fa5fc000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:08.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa5d7fff640 10 client.5145.objecter _finish_command 2 = system:0 2026-02-17T12:01:08.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa5d7fff640 20 client.5145.objecter put_session s=0x7fa5cc080c60 osd=5 4 2026-02-17T12:01:08.590 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa5d7fff640 15 client.5145.objecter _session_command_op_remove 5 2 2026-02-17T12:01:08.591 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:08.591 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:08.591 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:08.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 10 librados: watch_flush enter 2026-02-17T12:01:08.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 10 librados: watch_flush exit 2026-02-17T12:01:08.594 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 10 client.5145.objecter close_session for osd.5 2026-02-17T12:01:08.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7fa5cc081330 msgr2=0x7fa5cc083750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.71:6816/1474787626,v1:10.20.193.71:6817/1474787626] conn(0x7fa5cc081330 0x7fa5cc083750 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 20 client.5145.objecter put_session s=0x7fa5cc080c60 osd=5 1 2026-02-17T12:01:08.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 20 client.5145.objecter shutdown clearing up homeless session... 2026-02-17T12:01:08.595 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 10 client.5145.objecter successfully canceled tick 2026-02-17T12:01:08.596 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa5cc078e50 msgr2=0x7fa5cc07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.596 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fa5cc078e50 0x7fa5cc07b310 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8005980 tx=0x7fa5e8009040 comp rx=0 tx=0).stop 2026-02-17T12:01:08.596 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 10 monclient: shutdown 2026-02-17T12:01:08.596 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.596 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5fc15a300 msgr2=0x7fa5fc1fa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 --2- 10.20.193.10:0/1884356882 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fa5fc15a300 0x7fa5fc1fa570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cb90 tx=0x7fa5f000a430 comp rx=0 tx=0).stop 2026-02-17T12:01:08.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa5fbfff640 1 -- 10.20.193.10:0/1884356882 reap_dead start 2026-02-17T12:01:08.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 shutdown_connections 2026-02-17T12:01:08.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 >> 10.20.193.10:0/1884356882 conn(0x7fa5fc0cd560 msgr2=0x7fa5fc153030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 shutdown_connections 2026-02-17T12:01:08.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 -- 10.20.193.10:0/1884356882 wait complete. 2026-02-17T12:01:08.597 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.587+0000 7fa6021ce640 1 librados: shutdown 2026-02-17T12:01:08.600 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-17T12:01:08.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.667+0000 7f2398df7640 10 monclient: get_monmap_and_config 2026-02-17T12:01:08.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.667+0000 7f2398df7640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.669 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.667+0000 7f2398df7640 10 monclient: monmap: 2026-02-17T12:01:08.669 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.669 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.669 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:08.668484+0000 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:08.668484+0000 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:08.670 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.667+0000 7f2398df7640 1 Processor -- start 2026-02-17T12:01:08.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.667+0000 7f2398df7640 1 -- start start 2026-02-17T12:01:08.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.667+0000 7f2398df7640 10 monclient: init 2026-02-17T12:01:08.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 10 monclient: _add_conns ranks=[4,0,2,3,1,5] 2026-02-17T12:01:08.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f2394155fd0 0x7f23940ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 10 monclient(hunting): picked mon.noname-b con 0x7f2394155fd0 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2394073b90 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f23940cd9c0 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23940cd240 con 0x7f2394073b90 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23940cbb80 con 0x7f23940cd9c0 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2394160260 con 0x7f2394155fd0 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2398df7640 10 monclient(hunting): authenticate will time out at 1338.390283s 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2391d74640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f2394073b90 0x7f239415f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44876/0 (socket says 10.20.193.10:44876) 2026-02-17T12:01:08.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2391d74640 1 -- 10.20.193.10:0/1602838891 learned_addr learned my addr 10.20.193.10:0/1602838891 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2392575640 1 --2- 10.20.193.10:0/1602838891 >> v2:10.20.193.71:3300/0 conn(0x7f2394155fd0 0x7f23940ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2392575640 10 monclient(hunting): get_auth_request con 0x7f2394155fd0 auth_method 0 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2392575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2392575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.668+0000 7f2392575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.669+0000 7f2392575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.669+0000 7f2392575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.669+0000 7f2392575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2391573640 1 -- 10.20.193.10:0/1602838891 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 473621100 0 0) 0x7f23940cd240 con 0x7f2394073b90 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2391573640 10 monclient(hunting): _negotiate 2026-02-17T12:01:08.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2391573640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2391573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2391573640 10 monclient(hunting): my global_id is 5148 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2391573640 1 -- 10.20.193.10:0/1602838891 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2380003620 con 0x7f2394073b90 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2392575640 10 monclient(hunting): handle_auth_done global_id 5191 payload 274 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2392575640 1 -- 10.20.193.10:0/1602838891 >> v1:10.20.193.153:6789/0 conn(0x7f23940cd9c0 legacy=0x7f239415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2392575640 1 -- 10.20.193.10:0/1602838891 >> v1:10.20.193.10:6789/0 conn(0x7f2394073b90 legacy=0x7f239415f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2392575640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2392575640 1 monclient: found mon.noname-b 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2392575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.676 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2392575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.670+0000 7f2392575640 1 -- 10.20.193.10:0/1602838891 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23940ccc80 con 0x7f2394155fd0 2026-02-17T12:01:08.677 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.671+0000 7f2392575640 1 --2- 10.20.193.10:0/1602838891 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394155fd0 0x7f23940ce840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f23880098a0 tx=0x7f238802edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdce1e465715a3c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 1 -- 10.20.193.10:0/1602838891 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238803c070 con 0x7f2394155fd0 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 10 monclient: dump: 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.684 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 1 -- 10.20.193.10:0/1602838891 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238802fae0 con 0x7f2394155fd0 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 1 -- 10.20.193.10:0/1602838891 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388037440 con 0x7f2394155fd0 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:08.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.672+0000 7f2391573640 10 monclient: dump: 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 5 monclient: authenticate success, global_id 5191 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:08.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 4 set_mon_vals no callback set 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 10 monclient: shutdown 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 1 -- 10.20.193.10:0/1602838891 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394155fd0 msgr2=0x7f23940ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 1 --2- 10.20.193.10:0/1602838891 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394155fd0 0x7f23940ce840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f23880098a0 tx=0x7f238802edd0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 1 -- 10.20.193.10:0/1602838891 shutdown_connections 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 1 --2- 10.20.193.10:0/1602838891 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394155fd0 0x7f23940ce840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 1 -- 10.20.193.10:0/1602838891 >> 10.20.193.10:0/1602838891 conn(0x7f2394073070 msgr2=0x7f2394073480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 1 -- 10.20.193.10:0/1602838891 shutdown_connections 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 1 -- 10.20.193.10:0/1602838891 wait complete. 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.673+0000 7f2398df7640 10 monclient: monmap: 2026-02-17T12:01:08.687 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 librados: starting msgr at 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 librados: starting objecter 2026-02-17T12:01:08.688 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 Processor -- start 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 -- start start 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 librados: setting wanted keys 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 librados: calling monclient init 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient: init 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394073b90 0x7f23941e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient(hunting): picked mon.noname-b con 0x7f2394073b90 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23940cd9c0 0x7f23941e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient(hunting): picked mon.noname-a con 0x7f23940cd9c0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2394155fd0 0x7f239415ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.689 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient(hunting): picked mon.noname-c con 0x7f2394155fd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f23940ce320 con 0x7f23940cd9c0 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23940ce040 con 0x7f2394073b90 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23940cd470 con 0x7f2394155fd0 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2398df7640 10 monclient(hunting): authenticate will time out at 1338.396753s 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.674+0000 7f2391d74640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23940cd9c0 0x7f23941e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392575640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394073b90 0x7f23941e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2391d74640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23940cd9c0 0x7f23941e72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44858/0 (socket says 10.20.193.10:44858) 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2391d74640 1 -- 10.20.193.10:0/2420542239 learned_addr learned my addr 10.20.193.10:0/2420542239 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:08.690 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2391d74640 10 monclient(hunting): get_auth_request con 0x7f23940cd9c0 auth_method 0 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2391d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2391d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2391d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392575640 10 monclient(hunting): get_auth_request con 0x7f2394073b90 auth_method 0 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392d76640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2394155fd0 0x7f239415ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392d76640 10 monclient(hunting): get_auth_request con 0x7f2394155fd0 auth_method 0 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.691 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2391d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2391d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2391d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.675+0000 7f2392d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 10 monclient(hunting): handle_auth_done global_id 5194 payload 824 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 1 -- 10.20.193.10:0/2420542239 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2394155fd0 msgr2=0x7f239415ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2394155fd0 0x7f239415ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.692 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 1 -- 10.20.193.10:0/2420542239 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23940cd9c0 msgr2=0x7f23941e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23940cd9c0 0x7f23941e72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 1 monclient: found mon.noname-b 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.676+0000 7f2392575640 1 -- 10.20.193.10:0/2420542239 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23941f85b0 con 0x7f2394073b90 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.677+0000 7f2392575640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394073b90 0x7f23941e9f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2388036000 tx=0x7f23880047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.677+0000 7f237affd640 10 client.?.objecter ms_handle_connect 0x7f2394073b90 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.677+0000 7f237affd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 1 -- 10.20.193.10:0/2420542239 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238803c040 con 0x7f2394073b90 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:08.693 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 10 monclient: dump: 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.694 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 1 -- 10.20.193.10:0/2420542239 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2388042630 con 0x7f2394073b90 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 1 -- 10.20.193.10:0/2420542239 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388042a20 con 0x7f2394073b90 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2390d72640 4 set_mon_vals no callback set 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f237affd640 10 monclient: dump: 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.695 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2398df7640 5 monclient: authenticate success, global_id 5194 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2398df7640 10 monclient: _renew_subs 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2398df7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23941f7750 con 0x7f2394073b90 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2398df7640 10 client.5194.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2398df7640 10 monclient: _renew_subs 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2398df7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23941f7d10 con 0x7f2394073b90 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.679+0000 7f2398df7640 1 librados: init done 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.680+0000 7f2398df7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.696 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.680+0000 7f2398df7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.680+0000 7f2398df7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:08.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.680+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23940736f0 con 0x7f2394073b90 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.691+0000 7f237affd640 1 -- 10.20.193.10:0/2420542239 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f238804b450 con 0x7f2394073b90 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.692+0000 7f237affd640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2360078e00 0x7f236007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.692+0000 7f2391d74640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2360078e00 0x7f236007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.692+0000 7f2391d74640 10 monclient: get_auth_request con 0x7f2360078e00 auth_method 0 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.692+0000 7f237affd640 10 client.5194.objecter ms_handle_connect 0x7f2360078e00 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.692+0000 7f2391d74640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2360078e00 0x7f236007b2c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f237c007fd0 tx=0x7f237c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.693+0000 7f237affd640 1 -- 10.20.193.10:0/2420542239 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f238802fa20 con 0x7f2394073b90 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.693+0000 7f237affd640 10 client.5194.objecter ms_dispatch2 0x7f2394000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.693+0000 7f237affd640 3 client.5194.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:08.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.693+0000 7f237affd640 3 client.5194.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:08.699 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.693+0000 7f237affd640 20 client.5194.objecter dump_active .. 0 homeless 2026-02-17T12:01:08.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.793+0000 7f237affd640 1 -- 10.20.193.10:0/2420542239 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f23940736f0 con 0x7f2394073b90 2026-02-17T12:01:08.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.794+0000 7f237affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.794+0000 7f237affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.876+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f23940ce840 con 0x7f2360078e00 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.876+0000 7f237affd640 1 -- 10.20.193.10:0/2420542239 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23940ce840 con 0x7f2360078e00 2026-02-17T12:01:08.879 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 5 to deep-scrub 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 10 librados: watch_flush enter 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 10 librados: watch_flush exit 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 20 client.5194.objecter shutdown clearing up homeless session... 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 10 client.5194.objecter successfully canceled tick 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2360078e00 msgr2=0x7f236007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2360078e00 0x7f236007b2c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f237c007fd0 tx=0x7f237c009040 comp rx=0 tx=0).stop 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 10 monclient: shutdown 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394073b90 msgr2=0x7f23941e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394073b90 0x7f23941e9f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2388036000 tx=0x7f23880047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 shutdown_connections 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2360078e00 0x7f236007b2c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2394155fd0 0x7f239415ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23940cd9c0 0x7f23941e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 --2- 10.20.193.10:0/2420542239 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2394073b90 0x7f23941e9f40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 >> 10.20.193.10:0/2420542239 conn(0x7f2394073070 msgr2=0x7f239406b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 shutdown_connections 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 -- 10.20.193.10:0/2420542239 wait complete. 2026-02-17T12:01:08.881 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.878+0000 7f2398df7640 1 librados: shutdown 2026-02-17T12:01:08.890 INFO:tasks.ceph:Scrubbing osd.9 2026-02-17T12:01:08.890 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:08.961 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.959+0000 7fb4bd46c640 10 monclient: get_monmap_and_config 2026-02-17T12:01:08.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.959+0000 7fb4bd46c640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.962 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.959+0000 7fb4bd46c640 10 monclient: monmap: 2026-02-17T12:01:08.962 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.962 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.962 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:08.960736+0000 2026-02-17T12:01:08.962 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:08.960736+0000 2026-02-17T12:01:08.962 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.962 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.962 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:08.963 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:08.963 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:08.963 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:08.963 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:08.963 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:08.963 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.959+0000 7fb4bd46c640 1 Processor -- start 2026-02-17T12:01:08.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.959+0000 7fb4bd46c640 1 -- start start 2026-02-17T12:01:08.963 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.959+0000 7fb4bd46c640 10 monclient: init 2026-02-17T12:01:08.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 10 monclient: _add_conns ranks=[1,4,2,0,3,5] 2026-02-17T12:01:08.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb4b8150300 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:08.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fb4b81506e0 0x7fb4b815d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 10 monclient(hunting): picked mon.noname-b con 0x7fb4b81506e0 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:08.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb4b815d5a0 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:08.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4b80c55e0 con 0x7fb4b8150300 2026-02-17T12:01:08.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4b80c5300 con 0x7fb4b815d5a0 2026-02-17T12:01:08.970 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb4b8159c80 con 0x7fb4b81506e0 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4bd46c640 10 monclient(hunting): authenticate will time out at 1338.682514s 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4b6ffd640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fb4b8150300 0x7fb4b806fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37768/0 (socket says 10.20.193.10:37768) 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.960+0000 7fb4b6ffd640 1 -- 10.20.193.10:0/3872029514 learned_addr learned my addr 10.20.193.10:0/3872029514 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4058216757 0 0) 0x7fb4ac002920 con 0x7fb4b8150300 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 10 monclient(hunting): _negotiate 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 10 monclient(hunting): my global_id is 5197 2026-02-17T12:01:08.971 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4a4003620 con 0x7fb4b8150300 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b67fc640 1 --2- 10.20.193.10:0/3872029514 >> v2:10.20.193.71:3300/0 conn(0x7fb4b81506e0 0x7fb4b815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800846932 0 0) 0x7fb4b80c5300 con 0x7fb4b815d5a0 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 10 monclient(hunting): _negotiate 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 10 monclient(hunting): my global_id is 5198 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4ac002920 con 0x7fb4b815d5a0 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b67fc640 10 monclient(hunting): get_auth_request con 0x7fb4b81506e0 auth_method 0 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.972 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.962+0000 7fb4b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 <== mon.2 v1:10.20.193.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 971371661 0 0) 0x7fb4ac002920 con 0x7fb4b815d5a0 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 >> v2:10.20.193.71:3300/0 conn(0x7fb4b81506e0 msgr2=0x7fb4b815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 --2- 10.20.193.10:0/3872029514 >> v2:10.20.193.71:3300/0 conn(0x7fb4b81506e0 0x7fb4b815d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 >> v1:10.20.193.71:6789/0 conn(0x7fb4b8150300 legacy=0x7fb4b806fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.153:6789/0 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 --> v1:10.20.193.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b8159f60 con 0x7fb4b815d5a0 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.973 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 <== mon.2 v1:10.20.193.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fb4a8003260 con 0x7fb4b815d5a0 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient: dump: 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.974 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] but i'm connected to v1:10.20.193.153:6789/0, reconnecting 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 >> v1:10.20.193.153:6789/0 conn(0x7fb4b815d5a0 legacy=0x7fb4b80c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb4a4003dd0 0x7fb4a40041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient(hunting): picked mon.b con 0x7fb4a4003dd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb4a4004900 0x7fb4a4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient(hunting): picked mon.c con 0x7fb4a4004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:08.975 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4a400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient(hunting): picked mon.a con 0x7fb4a4005430 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b8159c80 con 0x7fb4a4005430 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a400c380 con 0x7fb4a4003dd0 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a400c580 con 0x7fb4a4004900 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:01:08.976 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b77fe640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4a400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b77fe640 10 monclient(hunting): get_auth_request con 0x7fb4a4005430 auth_method 0 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.964+0000 7fb4b77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b67fc640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb4a4004900 0x7fb4a4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b67fc640 10 monclient(hunting): get_auth_request con 0x7fb4a4004900 auth_method 0 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b6ffd640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb4a4003dd0 0x7fb4a40041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.977 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b67fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b6ffd640 10 monclient(hunting): get_auth_request con 0x7fb4a4003dd0 auth_method 0 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.965+0000 7fb4b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 10 monclient(hunting): handle_auth_done global_id 5198 payload 293 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 1 -- 10.20.193.10:0/3872029514 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb4a4004900 msgr2=0x7fb4a4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:08.978 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb4a4004900 0x7fb4a4004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 1 -- 10.20.193.10:0/3872029514 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb4a4003dd0 msgr2=0x7fb4a40041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb4a4003dd0 0x7fb4a40041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 1 monclient: found mon.a 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 1 -- 10.20.193.10:0/3872029514 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ac002920 con 0x7fb4a4005430 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4bd46c640 5 monclient: authenticate success, global_id 5198 2026-02-17T12:01:08.979 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4bd46c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:08.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.966+0000 7fb4b77fe640 1 -- 10.20.193.10:0/3872029514 reap_dead start 2026-02-17T12:01:08.980 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.967+0000 7fb4b77fe640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4a400bac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800a730 tx=0x7fb4a802fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98808130d743d323 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8038020 con 0x7fb4a4005430 2026-02-17T12:01:08.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:08.986 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 10 monclient: dump: 2026-02-17T12:01:08.986 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.986 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a8034680 con 0x7fb4a4005430 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.987 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 1 -- 10.20.193.10:0/3872029514 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800a350 con 0x7fb4a4005430 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 4 set_mon_vals no callback set 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4b5ffb640 10 monclient: dump: 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.988 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 10 monclient: shutdown 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 1 -- 10.20.193.10:0/3872029514 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 msgr2=0x7fb4a400bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4a400bac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800a730 tx=0x7fb4a802fb10 comp rx=0 tx=0).stop 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 1 -- 10.20.193.10:0/3872029514 shutdown_connections 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 1 --2- 10.20.193.10:0/3872029514 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4a400bac0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 1 -- 10.20.193.10:0/3872029514 >> 10.20.193.10:0/3872029514 conn(0x7fb4b80cd560 msgr2=0x7fb4b80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 1 -- 10.20.193.10:0/3872029514 shutdown_connections 2026-02-17T12:01:08.989 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.969+0000 7fb4bd46c640 1 -- 10.20.193.10:0/3872029514 wait complete. 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient: build_initial_monmap 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient: monmap: 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:08.990 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 librados: starting msgr at 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 librados: starting objecter 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 Processor -- start 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 -- start start 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 librados: setting wanted keys 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 librados: calling monclient init 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient: init 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4b81f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient(hunting): picked mon.noname-a con 0x7fb4a4005430 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:08.991 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb4b81578e0 0x7fb4b80ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient(hunting): picked mon.noname-c con 0x7fb4b81578e0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb4b80ca5e0 0x7fb4b81f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient(hunting): picked mon.noname-b con 0x7fb4b80ca5e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b815d060 con 0x7fb4a4005430 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b815a520 con 0x7fb4b80ca5e0 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b815d1e0 con 0x7fb4b81578e0 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.970+0000 7fb4bd46c640 10 monclient(hunting): authenticate will time out at 1338.692808s 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4b81f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.992 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4b81f5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44862/0 (socket says 10.20.193.10:44862) 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 1 -- 10.20.193.10:0/874850598 learned_addr learned my addr 10.20.193.10:0/874850598 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 10 monclient(hunting): get_auth_request con 0x7fb4a4005430 auth_method 0 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b67fc640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb4b81578e0 0x7fb4b80ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b77fe640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb4b80ca5e0 0x7fb4b81f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b77fe640 10 monclient(hunting): get_auth_request con 0x7fb4b80ca5e0 auth_method 0 2026-02-17T12:01:08.993 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b67fc640 10 monclient(hunting): get_auth_request con 0x7fb4b81578e0 auth_method 0 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:08.994 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.971+0000 7fb4b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 10 monclient(hunting): handle_auth_done global_id 5154 payload 824 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 1 -- 10.20.193.10:0/874850598 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb4b81578e0 msgr2=0x7fb4b80ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb4b81578e0 0x7fb4b80ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 1 -- 10.20.193.10:0/874850598 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb4b80ca5e0 msgr2=0x7fb4b81f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fb4b80ca5e0 0x7fb4b81f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 1 monclient: found mon.noname-a 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.972+0000 7fb4b6ffd640 1 -- 10.20.193.10:0/874850598 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b8147300 con 0x7fb4a4005430 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.973+0000 7fb4b6ffd640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4b81f5780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac007380 tx=0x7fb4ac007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:08.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.973+0000 7fb4977fe640 10 client.?.objecter ms_handle_connect 0x7fb4a4005430 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.973+0000 7fb4977fe640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4977fe640 1 -- 10.20.193.10:0/874850598 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac00f9c0 con 0x7fb4a4005430 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4977fe640 10 monclient: dump: 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.996 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4977fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4977fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4bd46c640 5 monclient: authenticate success, global_id 5154 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4bd46c640 10 monclient: _renew_subs 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4bd46c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b81f25a0 con 0x7fb4a4005430 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4bd46c640 10 client.5154.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4bd46c640 10 monclient: _renew_subs 2026-02-17T12:01:08.997 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4bd46c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b815bf80 con 0x7fb4a4005430 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.974+0000 7fb4bd46c640 1 librados: init done 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4bd46c640 10 client.5154.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4bd46c640 15 client.5154.objecter _session_command_op_assign -1 1 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4bd46c640 20 client.5154.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4bd46c640 10 client.5154.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4bd46c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4b814e380 con 0x7fb4a4005430 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4977fe640 1 -- 10.20.193.10:0/874850598 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b814e380 con 0x7fb4a4005430 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4977fe640 1 -- 10.20.193.10:0/874850598 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac00fd60 con 0x7fb4a4005430 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:08.998 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4977fe640 10 monclient: dump: 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:08.999 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.975+0000 7fb4b57fa640 4 set_mon_vals no callback set 2026-02-17T12:01:09.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.987+0000 7fb4977fe640 1 -- 10.20.193.10:0/874850598 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fb4ac01d460 con 0x7fb4a4005430 2026-02-17T12:01:09.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.988+0000 7fb4977fe640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb484078e00 0x7fb48407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.988+0000 7fb4b67fc640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb484078e00 0x7fb48407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.988+0000 7fb4b67fc640 10 monclient: get_auth_request con 0x7fb484078e00 auth_method 0 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.988+0000 7fb4977fe640 10 client.5154.objecter ms_handle_connect 0x7fb484078e00 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.988+0000 7fb4b67fc640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb484078e00 0x7fb48407b2c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4b814d4f0 tx=0x7fb4a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 1 -- 10.20.193.10:0/874850598 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb4ac097b70 con 0x7fb4a4005430 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 10 client.5154.objecter ms_dispatch2 0x7fb4b8000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 3 client.5154.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 3 client.5154.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 10 client.5154.objecter checking command 1 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7fb4840812e0 0x7fb484083700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 20 client.5154.objecter _get_session s=0x7fb484080c10 osd=9 3 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 20 client.5154.objecter put_session s=0x7fb484080c10 osd=9 3 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 15 client.5154.objecter _session_command_op_remove -1 1 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 20 client.5154.objecter _get_session s=0x7fb484080c10 osd=9 3 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 20 client.5154.objecter get_session s=0x7fb484080c10 osd=9 3 2026-02-17T12:01:09.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 15 client.5154.objecter _session_command_op_assign 9 1 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 20 client.5154.objecter put_session s=0x7fb484080c10 osd=9 4 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 10 client.5154.objecter _send_command 1 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 1 -- 10.20.193.10:0/874850598 --> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4ac016e50 con 0x7fb4840812e0 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 20 client.5154.objecter dump_active .. 0 homeless 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 1 -- 10.20.193.10:0/874850598 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb4ac05e7a0 con 0x7fb4a4005430 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.989+0000 7fb4977fe640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.990+0000 7fb4b77fe640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7fb4840812e0 0x7fb484083700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.990+0000 7fb4b77fe640 10 monclient: get_auth_request con 0x7fb4840812e0 auth_method 0 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.991+0000 7fb4b77fe640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7fb4840812e0 0x7fb484083700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:08.991+0000 7fb4977fe640 10 client.5154.objecter ms_handle_connect 0x7fb4840812e0 2026-02-17T12:01:09.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.002+0000 7fb4977fe640 1 -- 10.20.193.10:0/874850598 <== osd.9 v2:10.20.193.71:6800/1369683666 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fb4ac016e50 con 0x7fb4840812e0 2026-02-17T12:01:09.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.002+0000 7fb4977fe640 10 client.5154.objecter ms_dispatch2 0x7fb4b8000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:09.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.002+0000 7fb4977fe640 10 client.5154.objecter _finish_command 1 = system:0 2026-02-17T12:01:09.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.002+0000 7fb4977fe640 20 client.5154.objecter put_session s=0x7fb484080c10 osd=9 4 2026-02-17T12:01:09.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.002+0000 7fb4977fe640 15 client.5154.objecter _session_command_op_remove 9 1 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 10 client.5154.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 15 client.5154.objecter _session_command_op_assign -1 2 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 20 client.5154.objecter _get_session s=0x7fb484080c10 osd=9 3 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 20 client.5154.objecter put_session s=0x7fb484080c10 osd=9 3 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 20 client.5154.objecter _get_session s=0x7fb484080c10 osd=9 3 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 15 client.5154.objecter _session_command_op_remove -1 2 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 20 client.5154.objecter get_session s=0x7fb484080c10 osd=9 3 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 15 client.5154.objecter _session_command_op_assign 9 2 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 20 client.5154.objecter put_session s=0x7fb484080c10 osd=9 4 2026-02-17T12:01:09.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 10 client.5154.objecter _send_command 2 2026-02-17T12:01:09.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.008+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 --> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb4b806fe00 con 0x7fb4840812e0 2026-02-17T12:01:09.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4977fe640 1 -- 10.20.193.10:0/874850598 <== osd.9 v2:10.20.193.71:6800/1369683666 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb4b806fe00 con 0x7fb4840812e0 2026-02-17T12:01:09.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4977fe640 10 client.5154.objecter ms_dispatch2 0x7fb4b8000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:09.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4977fe640 10 client.5154.objecter _finish_command 2 = system:0 2026-02-17T12:01:09.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4977fe640 20 client.5154.objecter put_session s=0x7fb484080c10 osd=9 4 2026-02-17T12:01:09.018 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4977fe640 15 client.5154.objecter _session_command_op_remove 9 2 2026-02-17T12:01:09.018 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:09.018 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:09.019 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:09.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 10 librados: watch_flush enter 2026-02-17T12:01:09.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 10 librados: watch_flush exit 2026-02-17T12:01:09.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 10 client.5154.objecter close_session for osd.9 2026-02-17T12:01:09.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7fb4840812e0 msgr2=0x7fb484083700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.71:6800/1369683666,v1:10.20.193.71:6801/1369683666] conn(0x7fb4840812e0 0x7fb484083700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 20 client.5154.objecter put_session s=0x7fb484080c10 osd=9 1 2026-02-17T12:01:09.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 20 client.5154.objecter shutdown clearing up homeless session... 2026-02-17T12:01:09.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 10 client.5154.objecter successfully canceled tick 2026-02-17T12:01:09.020 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb484078e00 msgr2=0x7fb48407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fb484078e00 0x7fb48407b2c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4b814d4f0 tx=0x7fb4a0008040 comp rx=0 tx=0).stop 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 10 monclient: shutdown 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 msgr2=0x7fb4b81f5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 --2- 10.20.193.10:0/874850598 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fb4a4005430 0x7fb4b81f5780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac007380 tx=0x7fb4ac007850 comp rx=0 tx=0).stop 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4b77fe640 1 -- 10.20.193.10:0/874850598 reap_dead start 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 shutdown_connections 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 >> 10.20.193.10:0/874850598 conn(0x7fb4b80cd560 msgr2=0x7fb4b815d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 shutdown_connections 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 -- 10.20.193.10:0/874850598 wait complete. 2026-02-17T12:01:09.021 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.016+0000 7fb4bd46c640 1 librados: shutdown 2026-02-17T12:01:09.026 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-17T12:01:09.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.091+0000 7f775e0fc640 10 monclient: get_monmap_and_config 2026-02-17T12:01:09.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.091+0000 7f775e0fc640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.091+0000 7f775e0fc640 10 monclient: monmap: 2026-02-17T12:01:09.094 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.094 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.094 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:09.092873+0000 2026-02-17T12:01:09.094 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:09.092873+0000 2026-02-17T12:01:09.094 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 1 Processor -- start 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 1 -- start start 2026-02-17T12:01:09.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 10 monclient: init 2026-02-17T12:01:09.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 10 monclient: _add_conns ranks=[1,3,2,0,4,5] 2026-02-17T12:01:09.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f775815d220 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f77580c92f0 0x7f775815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 10 monclient(hunting): picked mon.noname-a con 0x7f77580c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7758074920 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77580c58a0 con 0x7f775815d220 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77580c55c0 con 0x7f7758074920 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f77580c7e20 con 0x7f77580c92f0 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f775e0fc640 10 monclient(hunting): authenticate will time out at 1338.814598s 2026-02-17T12:01:09.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f77577fe640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f775815d220 0x7f77580c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37770/0 (socket says 10.20.193.10:37770) 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.092+0000 7f77577fe640 1 -- 10.20.193.10:0/1445359709 learned_addr learned my addr 10.20.193.10:0/1445359709 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.093+0000 7f7756ffd640 1 --2- 10.20.193.10:0/1445359709 >> v2:10.20.193.10:3300/0 conn(0x7f77580c92f0 0x7f775815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.093+0000 7f7756ffd640 10 monclient(hunting): get_auth_request con 0x7f77580c92f0 auth_method 0 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.093+0000 7f7756ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.093+0000 7f7756ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.093+0000 7f7756ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.093+0000 7f7756ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.093+0000 7f7756ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.093+0000 7f7756ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f77567fc640 1 -- 10.20.193.10:0/1445359709 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336376032 0 0) 0x7f77580c58a0 con 0x7f775815d220 2026-02-17T12:01:09.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f77567fc640 10 monclient(hunting): _negotiate 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f77567fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f77567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f77567fc640 10 monclient(hunting): my global_id is 5206 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f77567fc640 1 -- 10.20.193.10:0/1445359709 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f773c003620 con 0x7f775815d220 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f7756ffd640 10 monclient(hunting): handle_auth_done global_id 5157 payload 274 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f7756ffd640 1 -- 10.20.193.10:0/1445359709 >> v1:10.20.193.153:6789/0 conn(0x7f7758074920 legacy=0x7f7758153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f7756ffd640 1 -- 10.20.193.10:0/1445359709 >> v1:10.20.193.71:6789/0 conn(0x7f775815d220 legacy=0x7f77580c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f7756ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f7756ffd640 1 monclient: found mon.noname-a 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f7756ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f7756ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:09.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.094+0000 7f7756ffd640 1 -- 10.20.193.10:0/1445359709 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77580c8100 con 0x7f77580c92f0 2026-02-17T12:01:09.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.095+0000 7f7756ffd640 1 --2- 10.20.193.10:0/1445359709 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 0x7f775815d600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f77480098d0 tx=0x7f774802eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05041fbe8f976d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 1 -- 10.20.193.10:0/1445359709 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774803c070 con 0x7f77580c92f0 2026-02-17T12:01:09.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:09.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 10 monclient: dump: 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 1 -- 10.20.193.10:0/1445359709 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774802fba0 con 0x7f77580c92f0 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 5 monclient: authenticate success, global_id 5157 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 1 -- 10.20.193.10:0/1445359709 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748037440 con 0x7f77580c92f0 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 4 set_mon_vals no callback set 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f77567fc640 10 monclient: dump: 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.110 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 10 monclient: shutdown 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 1 -- 10.20.193.10:0/1445359709 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 msgr2=0x7f775815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 1 --2- 10.20.193.10:0/1445359709 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 0x7f775815d600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f77480098d0 tx=0x7f774802eed0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 1 -- 10.20.193.10:0/1445359709 shutdown_connections 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 1 --2- 10.20.193.10:0/1445359709 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 0x7f775815d600 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 1 -- 10.20.193.10:0/1445359709 >> 10.20.193.10:0/1445359709 conn(0x7f77580c9d80 msgr2=0x7f77580ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 1 -- 10.20.193.10:0/1445359709 shutdown_connections 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.097+0000 7f775e0fc640 1 -- 10.20.193.10:0/1445359709 wait complete. 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient: monmap: 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:09.112 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 librados: starting msgr at 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 librados: starting objecter 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 Processor -- start 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 -- start start 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 librados: setting wanted keys 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 librados: calling monclient init 2026-02-17T12:01:09.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient: init 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7758074920 0x7f775815c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient(hunting): picked mon.noname-b con 0x7f7758074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 0x7f77580cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient(hunting): picked mon.noname-a con 0x7f77580c92f0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f775815d220 0x7f77580724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient(hunting): picked mon.noname-c con 0x7f775815d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f7758074d70 con 0x7f77580c92f0 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f77580c86c0 con 0x7f7758074920 2026-02-17T12:01:09.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7758153d60 con 0x7f775815d220 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.098+0000 7f775e0fc640 10 monclient(hunting): authenticate will time out at 1338.820855s 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 0x7f77580cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f77577fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7758074920 0x7f775815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 0x7f77580cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44872/0 (socket says 10.20.193.10:44872) 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 1 -- 10.20.193.10:0/2942798224 learned_addr learned my addr 10.20.193.10:0/2942798224 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 10 monclient(hunting): get_auth_request con 0x7f77580c92f0 auth_method 0 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f77577fe640 10 monclient(hunting): get_auth_request con 0x7f7758074920 auth_method 0 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f77577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f77577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f77577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7757fff640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f775815d220 0x7f77580724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7756ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7757fff640 10 monclient(hunting): get_auth_request con 0x7f775815d220 auth_method 0 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7757fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7757fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7757fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f77577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f77577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f77577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7757fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7757fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.099+0000 7f7757fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 10 monclient(hunting): handle_auth_done global_id 5160 payload 824 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 1 -- 10.20.193.10:0/2942798224 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f775815d220 msgr2=0x7f77580724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f775815d220 0x7f77580724d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 1 -- 10.20.193.10:0/2942798224 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7758074920 msgr2=0x7f775815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7758074920 0x7f775815c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 1 monclient: found mon.noname-a 2026-02-17T12:01:09.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.100+0000 7f7756ffd640 1 -- 10.20.193.10:0/2942798224 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77580730e0 con 0x7f77580c92f0 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.101+0000 7f7756ffd640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 0x7f77580cc3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f774803a040 tx=0x7f77480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.101+0000 7f7733fff640 10 client.?.objecter ms_handle_connect 0x7f77580c92f0 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.101+0000 7f7733fff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 1 -- 10.20.193.10:0/2942798224 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774803c040 con 0x7f77580c92f0 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 10 monclient: dump: 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.118 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 1 -- 10.20.193.10:0/2942798224 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7748004230 con 0x7f77580c92f0 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 1 -- 10.20.193.10:0/2942798224 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748004620 con 0x7f77580c92f0 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f775e0fc640 5 monclient: authenticate success, global_id 5160 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f775e0fc640 10 monclient: _renew_subs 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f775e0fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7755ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77580733c0 con 0x7f77580c92f0 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f7733fff640 10 monclient: dump: 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.120 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f775e0fc640 10 client.5160.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f775e0fc640 10 monclient: _renew_subs 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f775e0fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7758073980 con 0x7f77580c92f0 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.103+0000 7f775e0fc640 1 librados: init done 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.104+0000 7f775e0fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.104+0000 7f775e0fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.121 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.104+0000 7f775e0fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:09.122 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.104+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775815d600 con 0x7f77580c92f0 2026-02-17T12:01:09.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.208+0000 7f7733fff640 1 -- 10.20.193.10:0/2942798224 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f7748003710 con 0x7f77580c92f0 2026-02-17T12:01:09.210 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.209+0000 7f7733fff640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7728078e50 0x7f772807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.209+0000 7f77577fe640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7728078e50 0x7f772807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.209+0000 7f77577fe640 10 monclient: get_auth_request con 0x7f7728078e50 auth_method 0 2026-02-17T12:01:09.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.209+0000 7f77577fe640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7728078e50 0x7f772807b310 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7744007b60 tx=0x7f7744007ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.209+0000 7f7733fff640 10 client.5160.objecter ms_handle_connect 0x7f7728078e50 2026-02-17T12:01:09.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.216+0000 7f7733fff640 1 -- 10.20.193.10:0/2942798224 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f774802fa60 con 0x7f77580c92f0 2026-02-17T12:01:09.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.216+0000 7f7733fff640 10 client.5160.objecter ms_dispatch2 0x7f7758000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:09.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.216+0000 7f7733fff640 3 client.5160.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:09.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.216+0000 7f7733fff640 3 client.5160.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:09.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.216+0000 7f7733fff640 20 client.5160.objecter dump_active .. 0 homeless 2026-02-17T12:01:09.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.216+0000 7f7733fff640 1 -- 10.20.193.10:0/2942798224 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7748050070 con 0x7f77580c92f0 2026-02-17T12:01:09.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.216+0000 7f7733fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.216+0000 7f7733fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:09.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.302+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7f77580c6920 con 0x7f7728078e50 2026-02-17T12:01:09.304 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.302+0000 7f7733fff640 1 -- 10.20.193.10:0/2942798224 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77580c6920 con 0x7f7728078e50 2026-02-17T12:01:09.305 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 9 to deep-scrub 2026-02-17T12:01:09.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 10 librados: watch_flush enter 2026-02-17T12:01:09.306 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 10 librados: watch_flush exit 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 20 client.5160.objecter shutdown clearing up homeless session... 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 10 client.5160.objecter successfully canceled tick 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7728078e50 msgr2=0x7f772807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7728078e50 0x7f772807b310 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7744007b60 tx=0x7f7744007ab0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 10 monclient: shutdown 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 msgr2=0x7f77580cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 0x7f77580cc3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f774803a040 tx=0x7f77480047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 shutdown_connections 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7728078e50 0x7f772807b310 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.307 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f775815d220 0x7f77580724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f77580c92f0 0x7f77580cc3a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 --2- 10.20.193.10:0/2942798224 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7758074920 0x7f775815c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 >> 10.20.193.10:0/2942798224 conn(0x7f77580c9d80 msgr2=0x7f7758153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 shutdown_connections 2026-02-17T12:01:09.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 -- 10.20.193.10:0/2942798224 wait complete. 2026-02-17T12:01:09.308 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.303+0000 7f775e0fc640 1 librados: shutdown 2026-02-17T12:01:09.314 INFO:tasks.ceph:Scrubbing osd.13 2026-02-17T12:01:09.314 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:09.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.382+0000 7f5952fc1640 10 monclient: get_monmap_and_config 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.382+0000 7f5952fc1640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.382+0000 7f5952fc1640 10 monclient: monmap: 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:09.383561+0000 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:09.383561+0000 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:09.385 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:09.386 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:09.386 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:09.386 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:09.386 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:09.386 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.382+0000 7f5952fc1640 1 Processor -- start 2026-02-17T12:01:09.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.382+0000 7f5952fc1640 1 -- start start 2026-02-17T12:01:09.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.382+0000 7f5952fc1640 10 monclient: init 2026-02-17T12:01:09.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 10 monclient: _add_conns ranks=[5,4,1,3,0,2] 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f594c150300 0x7f594c06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 10 monclient(hunting): picked mon.noname-c con 0x7f594c150300 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f594c1506e0 0x7f594c15d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 10 monclient(hunting): picked mon.noname-b con 0x7f594c1506e0 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f594c070340 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c0c55e0 con 0x7f594c070340 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f594c0c5300 con 0x7f594c1506e0 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f594c159c80 con 0x7f594c150300 2026-02-17T12:01:09.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5952fc1640 10 monclient(hunting): authenticate will time out at 1339.105374s 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5950d36640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f594c150300 0x7f594c06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.383+0000 7f5943fff640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f594c1506e0 0x7f594c15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5951537640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f594c070340 0x7f594c0c4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37786/0 (socket says 10.20.193.10:37786) 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5951537640 1 -- 10.20.193.10:0/698582011 learned_addr learned my addr 10.20.193.10:0/698582011 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5950d36640 10 monclient(hunting): get_auth_request con 0x7f594c150300 auth_method 0 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5950d36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5950d36640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5950d36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5943fff640 10 monclient(hunting): get_auth_request con 0x7f594c1506e0 auth_method 0 2026-02-17T12:01:09.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5943fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5943fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5943fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5950d36640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5950d36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5950d36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5943fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5943fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.384+0000 7f5943fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.385+0000 7f5950d36640 10 monclient(hunting): handle_auth_done global_id 5210 payload 274 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.385+0000 7f5950d36640 1 -- 10.20.193.10:0/698582011 >> v2:10.20.193.71:3300/0 conn(0x7f594c1506e0 msgr2=0x7f594c15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.385+0000 7f5950d36640 1 --2- 10.20.193.10:0/698582011 >> v2:10.20.193.71:3300/0 conn(0x7f594c1506e0 0x7f594c15d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.385+0000 7f5950d36640 1 -- 10.20.193.10:0/698582011 >> v1:10.20.193.71:6789/0 conn(0x7f594c070340 legacy=0x7f594c0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.385+0000 7f5950d36640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.385+0000 7f5950d36640 1 monclient: found mon.noname-c 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.385+0000 7f5950d36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.385+0000 7f5950d36640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.385+0000 7f5950d36640 1 -- 10.20.193.10:0/698582011 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c159f60 con 0x7f594c150300 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.386+0000 7f5950d36640 1 --2- 10.20.193.10:0/698582011 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c150300 0x7f594c06fe00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f594c074840 tx=0x7f593c02eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126e2a2ab36c4457 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 1 -- 10.20.193.10:0/698582011 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c03c070 con 0x7f594c150300 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 10 monclient: dump: 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.398 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 1 -- 10.20.193.10:0/698582011 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593c02fb80 con 0x7f594c150300 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 1 -- 10.20.193.10:0/698582011 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c037440 con 0x7f594c150300 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f59437fe640 10 monclient: dump: 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.400 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f5952fc1640 5 monclient: authenticate success, global_id 5210 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f5952fc1640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.387+0000 7f5952fc1640 4 set_mon_vals no callback set 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 10 monclient: shutdown 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 1 -- 10.20.193.10:0/698582011 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c150300 msgr2=0x7f594c06fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 1 --2- 10.20.193.10:0/698582011 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c150300 0x7f594c06fe00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f594c074840 tx=0x7f593c02eeb0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 1 -- 10.20.193.10:0/698582011 shutdown_connections 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 1 --2- 10.20.193.10:0/698582011 >> v2:10.20.193.71:3300/0 conn(0x7f594c1506e0 0x7f594c15d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.401 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 1 --2- 10.20.193.10:0/698582011 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c150300 0x7f594c06fe00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 1 -- 10.20.193.10:0/698582011 >> 10.20.193.10:0/698582011 conn(0x7f594c0cd560 msgr2=0x7f594c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 1 -- 10.20.193.10:0/698582011 shutdown_connections 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.388+0000 7f5952fc1640 1 -- 10.20.193.10:0/698582011 wait complete. 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient: monmap: 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:09.402 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 librados: starting msgr at 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 librados: starting objecter 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 Processor -- start 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 -- start start 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 librados: setting wanted keys 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 librados: calling monclient init 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient: init 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c070340 0x7f594c1f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient(hunting): picked mon.noname-c con 0x7f594c070340 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f594c150300 0x7f594c1e6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient(hunting): picked mon.noname-b con 0x7f594c150300 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f594c1506e0 0x7f594c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient(hunting): picked mon.noname-a con 0x7f594c1506e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f594c0c4e90 con 0x7f594c1506e0 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f594c15a520 con 0x7f594c150300 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f594c0c5010 con 0x7f594c070340 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.389+0000 7f5952fc1640 10 monclient(hunting): authenticate will time out at 1339.111721s 2026-02-17T12:01:09.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c070340 0x7f594c1f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5951537640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f594c1506e0 0x7f594c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5943fff640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f594c150300 0x7f594c1e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c070340 0x7f594c1f5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36352/0 (socket says 10.20.193.10:36352) 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 1 -- 10.20.193.10:0/2029921856 learned_addr learned my addr 10.20.193.10:0/2029921856 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 10 monclient(hunting): get_auth_request con 0x7f594c070340 auth_method 0 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5951537640 10 monclient(hunting): get_auth_request con 0x7f594c1506e0 auth_method 0 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5951537640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5951537640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5951537640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5943fff640 10 monclient(hunting): get_auth_request con 0x7f594c150300 auth_method 0 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5943fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5943fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5943fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5950d36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5943fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5943fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5943fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5951537640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5951537640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.390+0000 7f5951537640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 10 monclient(hunting): handle_auth_done global_id 5213 payload 824 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 1 -- 10.20.193.10:0/2029921856 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f594c150300 msgr2=0x7f594c1e6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f594c150300 0x7f594c1e6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 1 -- 10.20.193.10:0/2029921856 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f594c1506e0 msgr2=0x7f594c1545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f594c1506e0 0x7f594c1545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 1 monclient: found mon.noname-c 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.391+0000 7f5950d36640 1 -- 10.20.193.10:0/2029921856 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c1e5260 con 0x7f594c070340 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.392+0000 7f5950d36640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c070340 0x7f594c1f5320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f593c009130 tx=0x7f593c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.392+0000 7f59417fa640 10 client.?.objecter ms_handle_connect 0x7f594c070340 2026-02-17T12:01:09.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.392+0000 7f59417fa640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:09.410 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f59417fa640 1 -- 10.20.193.10:0/2029921856 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c03c040 con 0x7f594c070340 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f59417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f59417fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f59417fa640 10 monclient: dump: 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.411 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f59417fa640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f59417fa640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f59417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f5952fc1640 5 monclient: authenticate success, global_id 5213 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f5952fc1640 10 monclient: _renew_subs 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f5952fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.393+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594c1e5540 con 0x7f594c070340 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 10 client.5213.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 10 monclient: _renew_subs 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594c1e5b00 con 0x7f594c070340 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 1 librados: init done 2026-02-17T12:01:09.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f59417fa640 1 -- 10.20.193.10:0/2029921856 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593c02fb00 con 0x7f594c070340 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f59417fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f59417fa640 1 -- 10.20.193.10:0/2029921856 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c042810 con 0x7f594c070340 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f59417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f59417fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5942ffd640 4 set_mon_vals no callback set 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f59417fa640 10 monclient: dump: 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.413 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 10 client.5213.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 15 client.5213.objecter _session_command_op_assign -1 1 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 20 client.5213.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 10 client.5213.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.394+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f594c1e5010 con 0x7f594c070340 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.405+0000 7f59417fa640 1 -- 10.20.193.10:0/2029921856 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f593c0429b0 con 0x7f594c070340 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.406+0000 7f59417fa640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f591c078e00 0x7f591c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.406+0000 7f5943fff640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f591c078e00 0x7f591c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.406+0000 7f5943fff640 10 monclient: get_auth_request con 0x7f591c078e00 auth_method 0 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.406+0000 7f5943fff640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f591c078e00 0x7f591c07b2c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f594c1e6dd0 tx=0x7f5934009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.406+0000 7f59417fa640 10 client.5213.objecter ms_handle_connect 0x7f591c078e00 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 1 -- 10.20.193.10:0/2029921856 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f593c0bc370 con 0x7f594c070340 2026-02-17T12:01:09.414 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 10 client.5213.objecter ms_dispatch2 0x7f594c000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 3 client.5213.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 3 client.5213.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 10 client.5213.objecter checking command 1 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f591c081340 0x7f591c083760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 20 client.5213.objecter _get_session s=0x7f591c080c70 osd=13 3 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 20 client.5213.objecter put_session s=0x7f591c080c70 osd=13 3 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 15 client.5213.objecter _session_command_op_remove -1 1 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 20 client.5213.objecter _get_session s=0x7f591c080c70 osd=13 3 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 20 client.5213.objecter get_session s=0x7f591c080c70 osd=13 3 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 15 client.5213.objecter _session_command_op_assign 13 1 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 20 client.5213.objecter put_session s=0x7f591c080c70 osd=13 4 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 10 client.5213.objecter _send_command 1 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 1 -- 10.20.193.10:0/2029921856 --> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f593c039e90 con 0x7f591c081340 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 20 client.5213.objecter dump_active .. 0 homeless 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 1 -- 10.20.193.10:0/2029921856 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f593c082fd0 con 0x7f594c070340 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.407+0000 7f59417fa640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:09.415 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.408+0000 7f5951537640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f591c081340 0x7f591c083760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.408+0000 7f5951537640 10 monclient: get_auth_request con 0x7f591c081340 auth_method 0 2026-02-17T12:01:09.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.410+0000 7f5951537640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f591c081340 0x7f591c083760 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.416 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.410+0000 7f59417fa640 10 client.5213.objecter ms_handle_connect 0x7f591c081340 2026-02-17T12:01:09.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.421+0000 7f59417fa640 1 -- 10.20.193.10:0/2029921856 <== osd.13 v2:10.20.193.71:6824/1119039635 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f593c039e90 con 0x7f591c081340 2026-02-17T12:01:09.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.421+0000 7f59417fa640 10 client.5213.objecter ms_dispatch2 0x7f594c000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:09.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.421+0000 7f59417fa640 10 client.5213.objecter _finish_command 1 = system:0 2026-02-17T12:01:09.422 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.421+0000 7f59417fa640 20 client.5213.objecter put_session s=0x7f591c080c70 osd=13 4 2026-02-17T12:01:09.423 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.421+0000 7f59417fa640 15 client.5213.objecter _session_command_op_remove 13 1 2026-02-17T12:01:09.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 10 client.5213.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:09.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 15 client.5213.objecter _session_command_op_assign -1 2 2026-02-17T12:01:09.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 20 client.5213.objecter _get_session s=0x7f591c080c70 osd=13 3 2026-02-17T12:01:09.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 20 client.5213.objecter put_session s=0x7f591c080c70 osd=13 3 2026-02-17T12:01:09.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 20 client.5213.objecter _get_session s=0x7f591c080c70 osd=13 3 2026-02-17T12:01:09.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 15 client.5213.objecter _session_command_op_remove -1 2 2026-02-17T12:01:09.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 20 client.5213.objecter get_session s=0x7f591c080c70 osd=13 3 2026-02-17T12:01:09.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 15 client.5213.objecter _session_command_op_assign 13 2 2026-02-17T12:01:09.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 20 client.5213.objecter put_session s=0x7f591c080c70 osd=13 4 2026-02-17T12:01:09.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 10 client.5213.objecter _send_command 2 2026-02-17T12:01:09.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.427+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 --> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f594c06fe00 con 0x7f591c081340 2026-02-17T12:01:09.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f59417fa640 1 -- 10.20.193.10:0/2029921856 <== osd.13 v2:10.20.193.71:6824/1119039635 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f594c06fe00 con 0x7f591c081340 2026-02-17T12:01:09.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f59417fa640 10 client.5213.objecter ms_dispatch2 0x7f594c000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:09.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f59417fa640 10 client.5213.objecter _finish_command 2 = system:0 2026-02-17T12:01:09.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f59417fa640 20 client.5213.objecter put_session s=0x7f591c080c70 osd=13 4 2026-02-17T12:01:09.437 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f59417fa640 15 client.5213.objecter _session_command_op_remove 13 2 2026-02-17T12:01:09.437 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:09.438 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:09.438 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:09.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 10 librados: watch_flush enter 2026-02-17T12:01:09.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 10 librados: watch_flush exit 2026-02-17T12:01:09.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 10 client.5213.objecter close_session for osd.13 2026-02-17T12:01:09.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f591c081340 msgr2=0x7f591c083760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.71:6824/1119039635,v1:10.20.193.71:6825/1119039635] conn(0x7f591c081340 0x7f591c083760 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.439 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 20 client.5213.objecter put_session s=0x7f591c080c70 osd=13 1 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 20 client.5213.objecter shutdown clearing up homeless session... 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 10 client.5213.objecter successfully canceled tick 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f591c078e00 msgr2=0x7f591c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f591c078e00 0x7f591c07b2c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f594c1e6dd0 tx=0x7f5934009290 comp rx=0 tx=0).stop 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 10 monclient: shutdown 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c070340 msgr2=0x7f594c1f5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 --2- 10.20.193.10:0/2029921856 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f594c070340 0x7f594c1f5320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f593c009130 tx=0x7f593c0047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5951537640 1 -- 10.20.193.10:0/2029921856 reap_dead start 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 shutdown_connections 2026-02-17T12:01:09.440 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 >> 10.20.193.10:0/2029921856 conn(0x7f594c0cd560 msgr2=0x7f594c0c4710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 shutdown_connections 2026-02-17T12:01:09.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 -- 10.20.193.10:0/2029921856 wait complete. 2026-02-17T12:01:09.441 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.435+0000 7f5952fc1640 1 librados: shutdown 2026-02-17T12:01:09.444 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-17T12:01:09.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.510+0000 7f6c0efde640 10 monclient: get_monmap_and_config 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.510+0000 7f6c0efde640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.510+0000 7f6c0efde640 10 monclient: monmap: 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:09.512206+0000 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:09.512206+0000 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:09.525 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 1 Processor -- start 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 1 -- start start 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient: init 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient: _add_conns ranks=[1,3,5,0,4,2] 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6c080c3e80 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f6c0815f920 0x7f6c0806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient(hunting): picked mon.noname-a con 0x7f6c0815f920 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f6c080c92e0 0x7f6c080730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient(hunting): picked mon.noname-c con 0x7f6c080c92e0 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c080c9710 con 0x7f6c080c3e80 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f6c080c8e50 con 0x7f6c0815f920 2026-02-17T12:01:09.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6c080c7c80 con 0x7f6c080c92e0 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.511+0000 7f6c0efde640 10 monclient(hunting): authenticate will time out at 1339.233960s 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0cd53640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f6c080c3e80 0x7f6c0815f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37800/0 (socket says 10.20.193.10:37800) 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0cd53640 1 -- 10.20.193.10:0/2420914727 learned_addr learned my addr 10.20.193.10:0/2420914727 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6bfffff640 1 --2- 10.20.193.10:0/2420914727 >> v2:10.20.193.10:3300/0 conn(0x7f6c0815f920 0x7f6c0806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0d554640 1 --2- 10.20.193.10:0/2420914727 >> v2:10.20.193.153:3300/0 conn(0x7f6c080c92e0 0x7f6c080730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6bfffff640 10 monclient(hunting): get_auth_request con 0x7f6c0815f920 auth_method 0 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6bfffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6bfffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6bfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0d554640 10 monclient(hunting): get_auth_request con 0x7f6c080c92e0 auth_method 0 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0d554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0d554640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0d554640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0d554640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0d554640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6c0d554640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6bfffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.512+0000 7f6bfffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6bfffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6bff7fe640 1 -- 10.20.193.10:0/2420914727 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388512110 0 0) 0x7f6c080c9710 con 0x7f6c080c3e80 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6bff7fe640 10 monclient(hunting): _negotiate 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6bff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6bff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6bff7fe640 10 monclient(hunting): my global_id is 5221 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6bff7fe640 1 -- 10.20.193.10:0/2420914727 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bf4003620 con 0x7f6c080c3e80 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6c0d554640 10 monclient(hunting): handle_auth_done global_id 5216 payload 274 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6c0d554640 1 -- 10.20.193.10:0/2420914727 >> v2:10.20.193.10:3300/0 conn(0x7f6c0815f920 msgr2=0x7f6c0806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6c0d554640 1 --2- 10.20.193.10:0/2420914727 >> v2:10.20.193.10:3300/0 conn(0x7f6c0815f920 0x7f6c0806d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6c0d554640 1 -- 10.20.193.10:0/2420914727 >> v1:10.20.193.71:6789/0 conn(0x7f6c080c3e80 legacy=0x7f6c0815f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6c0d554640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6c0d554640 1 monclient: found mon.noname-c 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6c0d554640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6c0d554640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.513+0000 7f6c0d554640 1 -- 10.20.193.10:0/2420914727 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c080c7f60 con 0x7f6c080c92e0 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.514+0000 7f6c0d554640 1 --2- 10.20.193.10:0/2420914727 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c080c92e0 0x7f6c080730a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6c08159760 tx=0x7f6c0402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7034421cacf16d13 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.515+0000 7f6bff7fe640 1 -- 10.20.193.10:0/2420914727 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0403c070 con 0x7f6c080c92e0 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.515+0000 7f6bff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.515+0000 7f6bff7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.515+0000 7f6bff7fe640 10 monclient: dump: 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.529 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.515+0000 7f6bff7fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.515+0000 7f6bff7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.515+0000 7f6bff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.515+0000 7f6c0efde640 5 monclient: authenticate success, global_id 5216 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.515+0000 7f6c0efde640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6bff7fe640 1 -- 10.20.193.10:0/2420914727 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c04037440 con 0x7f6c080c92e0 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6bff7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6bff7fe640 1 -- 10.20.193.10:0/2420914727 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c040377f0 con 0x7f6c080c92e0 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6bff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6bff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6bff7fe640 10 monclient: dump: 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.530 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 4 set_mon_vals no callback set 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 10 monclient: shutdown 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 1 -- 10.20.193.10:0/2420914727 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c080c92e0 msgr2=0x7f6c080730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 1 --2- 10.20.193.10:0/2420914727 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c080c92e0 0x7f6c080730a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6c08159760 tx=0x7f6c0402f1c0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 1 -- 10.20.193.10:0/2420914727 shutdown_connections 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 1 --2- 10.20.193.10:0/2420914727 >> v2:10.20.193.10:3300/0 conn(0x7f6c0815f920 0x7f6c0806d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 1 --2- 10.20.193.10:0/2420914727 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c080c92e0 0x7f6c080730a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 1 -- 10.20.193.10:0/2420914727 >> 10.20.193.10:0/2420914727 conn(0x7f6c080c9d80 msgr2=0x7f6c080ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 1 -- 10.20.193.10:0/2420914727 shutdown_connections 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 1 -- 10.20.193.10:0/2420914727 wait complete. 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.516+0000 7f6c0efde640 10 monclient: monmap: 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 librados: starting msgr at 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 librados: starting objecter 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 Processor -- start 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 -- start start 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 librados: setting wanted keys 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 librados: calling monclient init 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient: init 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:09.532 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c080c3e80 0x7f6c081f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient(hunting): picked mon.noname-b con 0x7f6c080c3e80 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c080c92e0 0x7f6c08146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient(hunting): picked mon.noname-a con 0x7f6c080c92e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c0815f920 0x7f6c08158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient(hunting): picked mon.noname-c con 0x7f6c0815f920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f6c080c8800 con 0x7f6c080c92e0 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c080c8520 con 0x7f6c080c3e80 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c080c8ae0 con 0x7f6c0815f920 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0efde640 10 monclient(hunting): authenticate will time out at 1339.239662s 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6bfffff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c080c92e0 0x7f6c08146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.517+0000 7f6c0cd53640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c080c3e80 0x7f6c081f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0cd53640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c080c3e80 0x7f6c081f7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59596/0 (socket says 10.20.193.10:59596) 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0cd53640 1 -- 10.20.193.10:0/1689110710 learned_addr learned my addr 10.20.193.10:0/1689110710 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0cd53640 10 monclient(hunting): get_auth_request con 0x7f6c080c3e80 auth_method 0 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0d554640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c0815f920 0x7f6c08158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0cd53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0cd53640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0cd53640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6bfffff640 10 monclient(hunting): get_auth_request con 0x7f6c080c92e0 auth_method 0 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6bfffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6bfffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6bfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0d554640 10 monclient(hunting): get_auth_request con 0x7f6c0815f920 auth_method 0 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0d554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0d554640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0d554640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0cd53640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0cd53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0cd53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6bfffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6bfffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6bfffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0d554640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0d554640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.518+0000 7f6c0d554640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 10 monclient(hunting): handle_auth_done global_id 5224 payload 824 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 1 -- 10.20.193.10:0/1689110710 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c0815f920 msgr2=0x7f6c08158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c0815f920 0x7f6c08158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 1 -- 10.20.193.10:0/1689110710 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c080c92e0 msgr2=0x7f6c08146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c080c92e0 0x7f6c08146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 1 monclient: found mon.noname-b 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.519+0000 7f6c0cd53640 1 -- 10.20.193.10:0/1689110710 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c081f7860 con 0x7f6c080c3e80 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.520+0000 7f6c0cd53640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c080c3e80 0x7f6c081f7200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c520 tx=0x7f6bf800c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.520+0000 7f6bfd7fa640 10 client.?.objecter ms_handle_connect 0x7f6c080c3e80 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.520+0000 7f6bfd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 1 -- 10.20.193.10:0/1689110710 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8017070 con 0x7f6c080c3e80 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 10 monclient: dump: 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.535 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 5 monclient: authenticate success, global_id 5224 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 10 monclient: _renew_subs 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c081f7b40 con 0x7f6c080c3e80 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 10 client.5224.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 10 monclient: _renew_subs 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c081584b0 con 0x7f6c080c3e80 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 1 librados: init done 2026-02-17T12:01:09.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 1 -- 10.20.193.10:0/1689110710 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf8002a20 con 0x7f6c080c3e80 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 1 -- 10.20.193.10:0/1689110710 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8021060 con 0x7f6c080c3e80 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfd7fa640 10 monclient: dump: 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6bfeffd640 4 set_mon_vals no callback set 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:09.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.522+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c08070d90 con 0x7f6c080c3e80 2026-02-17T12:01:09.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.534+0000 7f6bfd7fa640 1 -- 10.20.193.10:0/1689110710 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f6bf8024080 con 0x7f6c080c3e80 2026-02-17T12:01:09.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.534+0000 7f6bfd7fa640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6bd8078e00 0x7f6bd807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.534+0000 7f6bfffff640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6bd8078e00 0x7f6bd807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.534+0000 7f6bfffff640 10 monclient: get_auth_request con 0x7f6bd8078e00 auth_method 0 2026-02-17T12:01:09.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.535+0000 7f6bfd7fa640 10 client.5224.objecter ms_handle_connect 0x7f6bd8078e00 2026-02-17T12:01:09.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.535+0000 7f6bfffff640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6bd8078e00 0x7f6bd807b2c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c08070d60 tx=0x7f6bf0009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.536+0000 7f6bfd7fa640 1 -- 10.20.193.10:0/1689110710 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f6bf805d480 con 0x7f6c080c3e80 2026-02-17T12:01:09.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.536+0000 7f6bfd7fa640 10 client.5224.objecter ms_dispatch2 0x7f6c08000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:09.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.536+0000 7f6bfd7fa640 3 client.5224.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:09.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.536+0000 7f6bfd7fa640 3 client.5224.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:09.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.536+0000 7f6bfd7fa640 20 client.5224.objecter dump_active .. 0 homeless 2026-02-17T12:01:09.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.636+0000 7f6bfd7fa640 1 -- 10.20.193.10:0/1689110710 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6bf8061440 con 0x7f6c080c3e80 2026-02-17T12:01:09.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.636+0000 7f6bfd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.636+0000 7f6bfd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:09.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.717+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7f6c0814f3a0 con 0x7f6bd8078e00 2026-02-17T12:01:09.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.718+0000 7f6bfd7fa640 1 -- 10.20.193.10:0/1689110710 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f6c0814f3a0 con 0x7f6bd8078e00 2026-02-17T12:01:09.719 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 13 to deep-scrub 2026-02-17T12:01:09.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.718+0000 7f6c0efde640 10 librados: watch_flush enter 2026-02-17T12:01:09.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.718+0000 7f6c0efde640 10 librados: watch_flush exit 2026-02-17T12:01:09.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.718+0000 7f6c0efde640 20 client.5224.objecter shutdown clearing up homeless session... 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.718+0000 7f6c0efde640 10 client.5224.objecter successfully canceled tick 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6bd8078e00 msgr2=0x7f6bd807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6bd8078e00 0x7f6bd807b2c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c08070d60 tx=0x7f6bf0009290 comp rx=0 tx=0).stop 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 10 monclient: shutdown 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c080c3e80 msgr2=0x7f6c081f7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c080c3e80 0x7f6c081f7200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c520 tx=0x7f6bf800c9f0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 shutdown_connections 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f6bd8078e00 0x7f6bd807b2c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6c0815f920 0x7f6c08158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f6c080c92e0 0x7f6c08146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 --2- 10.20.193.10:0/1689110710 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f6c080c3e80 0x7f6c081f7200 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 >> 10.20.193.10:0/1689110710 conn(0x7f6c080c9d80 msgr2=0x7f6c080cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 shutdown_connections 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 -- 10.20.193.10:0/1689110710 wait complete. 2026-02-17T12:01:09.721 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.719+0000 7f6c0efde640 1 librados: shutdown 2026-02-17T12:01:09.728 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T12:01:09.728 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:09.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.794+0000 7f530a643640 10 monclient: get_monmap_and_config 2026-02-17T12:01:09.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.794+0000 7f530a643640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.794+0000 7f530a643640 10 monclient: monmap: 2026-02-17T12:01:09.797 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.797 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.797 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:09.795827+0000 2026-02-17T12:01:09.797 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:09.795827+0000 2026-02-17T12:01:09.797 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.797 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.797 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:09.798 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:09.798 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:09.798 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:09.798 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:09.798 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:09.798 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 1 Processor -- start 2026-02-17T12:01:09.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 1 -- start start 2026-02-17T12:01:09.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 10 monclient: init 2026-02-17T12:01:09.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 10 monclient: _add_conns ranks=[0,5,2,1,3,4] 2026-02-17T12:01:09.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f530414f1b0 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:09.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f530414f590 0x7f530406da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 10 monclient(hunting): picked mon.noname-c con 0x7f530414f590 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:09.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f53040c61f0 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:09.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530406e190 con 0x7f530414f1b0 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530406e470 con 0x7f53040c61f0 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f530406e750 con 0x7f530414f590 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.795+0000 7f530a643640 10 monclient(hunting): authenticate will time out at 1339.517629s 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f5303fff640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f530414f1b0 0x7f53040c5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44882/0 (socket says 10.20.193.10:44882) 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f5303fff640 1 -- 10.20.193.10:0/419016975 learned_addr learned my addr 10.20.193.10:0/419016975 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f53037fe640 1 --2- 10.20.193.10:0/419016975 >> v2:10.20.193.153:3300/0 conn(0x7f530414f590 0x7f530406da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f53037fe640 10 monclient(hunting): get_auth_request con 0x7f530414f590 auth_method 0 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f53037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f53037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f53037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f53037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f53037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.796+0000 7f53037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.797+0000 7f5302ffd640 1 -- 10.20.193.10:0/419016975 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452777303 0 0) 0x7f530406e190 con 0x7f530414f1b0 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.797+0000 7f5302ffd640 10 monclient(hunting): _negotiate 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.797+0000 7f5302ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.797+0000 7f5302ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.797+0000 7f5302ffd640 10 monclient(hunting): my global_id is 5172 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.797+0000 7f5302ffd640 1 -- 10.20.193.10:0/419016975 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e80058b0 con 0x7f530414f1b0 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.798+0000 7f53037fe640 10 monclient(hunting): handle_auth_done global_id 5222 payload 274 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.798+0000 7f53037fe640 1 -- 10.20.193.10:0/419016975 >> v1:10.20.193.153:6789/0 conn(0x7f53040c61f0 legacy=0x7f53040c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.798+0000 7f53037fe640 1 -- 10.20.193.10:0/419016975 >> v1:10.20.193.10:6789/0 conn(0x7f530414f1b0 legacy=0x7f53040c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.798+0000 7f53037fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.798+0000 7f53037fe640 1 monclient: found mon.noname-c 2026-02-17T12:01:09.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.798+0000 7f53037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.798+0000 7f53037fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.798+0000 7f53037fe640 1 -- 10.20.193.10:0/419016975 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530406ea30 con 0x7f530414f590 2026-02-17T12:01:09.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.800+0000 7f53037fe640 1 --2- 10.20.193.10:0/419016975 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f530414f590 0x7f530406da70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f52f40098a0 tx=0x7f52f402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7085d213015d91f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 1 -- 10.20.193.10:0/419016975 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f403c070 con 0x7f530414f590 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 10 monclient: dump: 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.809 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 1 -- 10.20.193.10:0/419016975 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f402fb70 con 0x7f530414f590 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 1 -- 10.20.193.10:0/419016975 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4037440 con 0x7f530414f590 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f5302ffd640 10 monclient: dump: 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 5 monclient: authenticate success, global_id 5222 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:09.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 4 set_mon_vals no callback set 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 10 monclient: shutdown 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 1 -- 10.20.193.10:0/419016975 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f530414f590 msgr2=0x7f530406da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 1 --2- 10.20.193.10:0/419016975 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f530414f590 0x7f530406da70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f52f40098a0 tx=0x7f52f402ee60 comp rx=0 tx=0).stop 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 1 -- 10.20.193.10:0/419016975 shutdown_connections 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 1 --2- 10.20.193.10:0/419016975 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f530414f590 0x7f530406da70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 1 -- 10.20.193.10:0/419016975 >> 10.20.193.10:0/419016975 conn(0x7f53040cd560 msgr2=0x7f53040cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 1 -- 10.20.193.10:0/419016975 shutdown_connections 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.802+0000 7f530a643640 1 -- 10.20.193.10:0/419016975 wait complete. 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient: monmap: 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:09.812 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 librados: starting msgr at 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 librados: starting objecter 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 Processor -- start 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 -- start start 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 librados: setting wanted keys 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 librados: calling monclient init 2026-02-17T12:01:09.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient: init 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53040c61f0 0x7f53040bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient(hunting): picked mon.noname-c con 0x7f53040c61f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530414f1b0 0x7f530414a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient(hunting): picked mon.noname-a con 0x7f530414f1b0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f530414f590 0x7f530414a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient(hunting): picked mon.noname-b con 0x7f530414f590 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f53040c9560 con 0x7f530414f1b0 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f530406eff0 con 0x7f530414f590 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f53040c96e0 con 0x7f53040c61f0 2026-02-17T12:01:09.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.803+0000 7f530a643640 10 monclient(hunting): authenticate will time out at 1339.525917s 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f53037fe640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530414f1b0 0x7f530414a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53040c61f0 0x7f53040bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5308bb9640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f530414f590 0x7f530414a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53040c61f0 0x7f53040bf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36398/0 (socket says 10.20.193.10:36398) 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 1 -- 10.20.193.10:0/3483297016 learned_addr learned my addr 10.20.193.10:0/3483297016 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 10 monclient(hunting): get_auth_request con 0x7f53040c61f0 auth_method 0 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f53037fe640 10 monclient(hunting): get_auth_request con 0x7f530414f1b0 auth_method 0 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f53037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f53037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f53037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5308bb9640 10 monclient(hunting): get_auth_request con 0x7f530414f590 auth_method 0 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5308bb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5308bb9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5308bb9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5303fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f53037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f53037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f53037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5308bb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5308bb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.804+0000 7f5308bb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 10 monclient(hunting): handle_auth_done global_id 5228 payload 824 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 1 -- 10.20.193.10:0/3483297016 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f530414f590 msgr2=0x7f530414a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f530414f590 0x7f530414a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 1 -- 10.20.193.10:0/3483297016 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530414f1b0 msgr2=0x7f530414a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f530414f1b0 0x7f530414a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 1 monclient: found mon.noname-c 2026-02-17T12:01:09.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.805+0000 7f5303fff640 1 -- 10.20.193.10:0/3483297016 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53040cd090 con 0x7f53040c61f0 2026-02-17T12:01:09.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.806+0000 7f5303fff640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53040c61f0 0x7f53040bf510 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c730 tx=0x7f52f000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.806+0000 7f5300ff9640 10 client.?.objecter ms_handle_connect 0x7f53040c61f0 2026-02-17T12:01:09.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.806+0000 7f5300ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:09.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 1 -- 10.20.193.10:0/3483297016 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0017070 con 0x7f53040c61f0 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 10 monclient: dump: 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 5 monclient: authenticate success, global_id 5228 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 10 monclient: _renew_subs 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53040bfea0 con 0x7f53040c61f0 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 10 client.5228.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 10 monclient: _renew_subs 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5304149860 con 0x7f53040c61f0 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 1 librados: init done 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 1 -- 10.20.193.10:0/3483297016 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f0005bd0 con 0x7f53040c61f0 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 1 -- 10.20.193.10:0/3483297016 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0021060 con 0x7f53040c61f0 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f5300ff9640 10 monclient: dump: 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.820 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f53027fc640 4 set_mon_vals no callback set 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 10 client.5228.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 15 client.5228.objecter _session_command_op_assign -1 1 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 20 client.5228.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 10 client.5228.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:09.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.808+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f530414e040 con 0x7f53040c61f0 2026-02-17T12:01:09.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.819+0000 7f5300ff9640 1 -- 10.20.193.10:0/3483297016 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f52f0007070 con 0x7f53040c61f0 2026-02-17T12:01:09.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.820+0000 7f5300ff9640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52d4078e00 0x7f52d407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.820+0000 7f53037fe640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52d4078e00 0x7f52d407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.820+0000 7f53037fe640 10 monclient: get_auth_request con 0x7f52d4078e00 auth_method 0 2026-02-17T12:01:09.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.820+0000 7f5300ff9640 10 client.5228.objecter ms_handle_connect 0x7f52d4078e00 2026-02-17T12:01:09.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.820+0000 7f53037fe640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52d4078e00 0x7f52d407b2c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f52f4039000 tx=0x7f52f4033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 1 -- 10.20.193.10:0/3483297016 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f52f00972f0 con 0x7f53040c61f0 2026-02-17T12:01:09.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 10 client.5228.objecter ms_dispatch2 0x7f5304000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:09.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 3 client.5228.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:09.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 3 client.5228.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 10 client.5228.objecter checking command 1 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f52d40812e0 0x7f52d4083700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 20 client.5228.objecter _get_session s=0x7f52d4080c10 osd=2 3 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 20 client.5228.objecter put_session s=0x7f52d4080c10 osd=2 3 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 15 client.5228.objecter _session_command_op_remove -1 1 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 20 client.5228.objecter _get_session s=0x7f52d4080c10 osd=2 3 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 20 client.5228.objecter get_session s=0x7f52d4080c10 osd=2 3 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 15 client.5228.objecter _session_command_op_assign 2 1 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 20 client.5228.objecter put_session s=0x7f52d4080c10 osd=2 4 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 10 client.5228.objecter _send_command 1 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 1 -- 10.20.193.10:0/3483297016 --> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52f0010e50 con 0x7f52d40812e0 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 20 client.5228.objecter dump_active .. 0 homeless 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 1 -- 10.20.193.10:0/3483297016 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f52f005dec0 con 0x7f53040c61f0 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5300ff9640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.821+0000 7f5308bb9640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f52d40812e0 0x7f52d4083700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.824 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.822+0000 7f5308bb9640 10 monclient: get_auth_request con 0x7f52d40812e0 auth_method 0 2026-02-17T12:01:09.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.823+0000 7f5308bb9640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f52d40812e0 0x7f52d4083700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.825 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.823+0000 7f5300ff9640 10 client.5228.objecter ms_handle_connect 0x7f52d40812e0 2026-02-17T12:01:09.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.835+0000 7f5300ff9640 1 -- 10.20.193.10:0/3483297016 <== osd.2 v2:10.20.193.153:6816/4180566480 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f52f0010e50 con 0x7f52d40812e0 2026-02-17T12:01:09.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.835+0000 7f5300ff9640 10 client.5228.objecter ms_dispatch2 0x7f5304000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:09.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.835+0000 7f5300ff9640 10 client.5228.objecter _finish_command 1 = system:0 2026-02-17T12:01:09.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.835+0000 7f5300ff9640 20 client.5228.objecter put_session s=0x7f52d4080c10 osd=2 4 2026-02-17T12:01:09.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.835+0000 7f5300ff9640 15 client.5228.objecter _session_command_op_remove 2 1 2026-02-17T12:01:09.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 10 client.5228.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 15 client.5228.objecter _session_command_op_assign -1 2 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 20 client.5228.objecter _get_session s=0x7f52d4080c10 osd=2 3 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 20 client.5228.objecter put_session s=0x7f52d4080c10 osd=2 3 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 20 client.5228.objecter _get_session s=0x7f52d4080c10 osd=2 3 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 15 client.5228.objecter _session_command_op_remove -1 2 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 20 client.5228.objecter get_session s=0x7f52d4080c10 osd=2 3 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 15 client.5228.objecter _session_command_op_assign 2 2 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 20 client.5228.objecter put_session s=0x7f52d4080c10 osd=2 4 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 10 client.5228.objecter _send_command 2 2026-02-17T12:01:09.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.842+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 --> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f530406da70 con 0x7f52d40812e0 2026-02-17T12:01:09.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f5300ff9640 1 -- 10.20.193.10:0/3483297016 <== osd.2 v2:10.20.193.153:6816/4180566480 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f530406da70 con 0x7f52d40812e0 2026-02-17T12:01:09.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f5300ff9640 10 client.5228.objecter ms_dispatch2 0x7f5304000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:09.850 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f5300ff9640 10 client.5228.objecter _finish_command 2 = system:0 2026-02-17T12:01:09.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f5300ff9640 20 client.5228.objecter put_session s=0x7f52d4080c10 osd=2 4 2026-02-17T12:01:09.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f5300ff9640 15 client.5228.objecter _session_command_op_remove 2 2 2026-02-17T12:01:09.851 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:09.851 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:09.851 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 10 librados: watch_flush enter 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 10 librados: watch_flush exit 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 10 client.5228.objecter close_session for osd.2 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f52d40812e0 msgr2=0x7f52d4083700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.153:6816/4180566480,v1:10.20.193.153:6817/4180566480] conn(0x7f52d40812e0 0x7f52d4083700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 20 client.5228.objecter put_session s=0x7f52d4080c10 osd=2 1 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 20 client.5228.objecter shutdown clearing up homeless session... 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 10 client.5228.objecter successfully canceled tick 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52d4078e00 msgr2=0x7f52d407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f52d4078e00 0x7f52d407b2c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f52f4039000 tx=0x7f52f4033000 comp rx=0 tx=0).stop 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 10 monclient: shutdown 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53040c61f0 msgr2=0x7f53040bf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 --2- 10.20.193.10:0/3483297016 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f53040c61f0 0x7f53040bf510 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c730 tx=0x7f52f000cc00 comp rx=0 tx=0).stop 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f5308bb9640 1 -- 10.20.193.10:0/3483297016 reap_dead start 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 shutdown_connections 2026-02-17T12:01:09.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 >> 10.20.193.10:0/3483297016 conn(0x7f53040cd560 msgr2=0x7f530414c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 shutdown_connections 2026-02-17T12:01:09.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 -- 10.20.193.10:0/3483297016 wait complete. 2026-02-17T12:01:09.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.849+0000 7f530a643640 1 librados: shutdown 2026-02-17T12:01:09.859 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.925+0000 7fdcd4ce1640 10 monclient: get_monmap_and_config 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.925+0000 7fdcd4ce1640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.925+0000 7fdcd4ce1640 10 monclient: monmap: 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:09.926615+0000 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:09.926615+0000 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:09.927 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.925+0000 7fdcd4ce1640 1 Processor -- start 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.925+0000 7fdcd4ce1640 1 -- start start 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.925+0000 7fdcd4ce1640 10 monclient: init 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 10 monclient: _add_conns ranks=[2,5,4,0,3,1] 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdcd0152660 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fdcd015b030 0x7fdcd00c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 10 monclient(hunting): picked mon.noname-c con 0x7fdcd015b030 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fdcd0152a40 0x7fdcd00c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 10 monclient(hunting): picked mon.noname-b con 0x7fdcd0152a40 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd00c71e0 con 0x7fdcd0152660 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd00c77a0 con 0x7fdcd0152a40 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd00c74c0 con 0x7fdcd015b030 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.926+0000 7fdcd4ce1640 10 monclient(hunting): authenticate will time out at 1339.648493s 2026-02-17T12:01:09.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.938+0000 7fdcced76640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fdcd0152a40 0x7fdcd00c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.938+0000 7fdcced76640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fdcd0152a40 0x7fdcd00c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59616/0 (socket says 10.20.193.10:59616) 2026-02-17T12:01:09.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.938+0000 7fdcced76640 1 -- 10.20.193.10:0/1829904586 learned_addr learned my addr 10.20.193.10:0/1829904586 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:09.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.938+0000 7fdcced76640 10 monclient(hunting): get_auth_request con 0x7fdcd0152a40 auth_method 0 2026-02-17T12:01:09.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.938+0000 7fdcced76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.938+0000 7fdcced76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.938+0000 7fdcced76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.938+0000 7fdcced76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.938+0000 7fdcced76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdccdd74640 1 --2- 10.20.193.10:0/1829904586 >> v2:10.20.193.153:3300/0 conn(0x7fdcd015b030 0x7fdcd00c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 10 monclient(hunting): handle_auth_done global_id 5230 payload 274 2026-02-17T12:01:09.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 1 -- 10.20.193.10:0/1829904586 >> v2:10.20.193.153:3300/0 conn(0x7fdcd015b030 msgr2=0x7fdcd00c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:09.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 1 --2- 10.20.193.10:0/1829904586 >> v2:10.20.193.153:3300/0 conn(0x7fdcd015b030 0x7fdcd00c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 1 -- 10.20.193.10:0/1829904586 >> v1:10.20.193.153:6789/0 conn(0x7fdcd0152660 legacy=0x7fdcd015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:09.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 1 monclient: found mon.noname-b 2026-02-17T12:01:09.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:09.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.939+0000 7fdcced76640 1 -- 10.20.193.10:0/1829904586 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd0159e40 con 0x7fdcd0152a40 2026-02-17T12:01:09.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.941+0000 7fdcced76640 1 --2- 10.20.193.10:0/1829904586 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 0x7fdcd00c9310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0072150 tx=0x7fdcc002f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14f2eb18dc86175e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 1 -- 10.20.193.10:0/1829904586 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc002fcd0 con 0x7fdcd0152a40 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 10 monclient: dump: 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdcd4ce1640 5 monclient: authenticate success, global_id 5230 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 1 -- 10.20.193.10:0/1829904586 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc00373f0 con 0x7fdcd0152a40 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 1 -- 10.20.193.10:0/1829904586 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00377c0 con 0x7fdcd0152a40 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdcd4ce1640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdcd4ce1640 4 set_mon_vals no callback set 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.943+0000 7fdccd573640 10 monclient: dump: 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.947 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 10 monclient: shutdown 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/1829904586 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 msgr2=0x7fdcd00c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 --2- 10.20.193.10:0/1829904586 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 0x7fdcd00c9310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0072150 tx=0x7fdcc002f270 comp rx=0 tx=0).stop 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/1829904586 shutdown_connections 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 --2- 10.20.193.10:0/1829904586 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 0x7fdcd00c9310 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 --2- 10.20.193.10:0/1829904586 >> v2:10.20.193.153:3300/0 conn(0x7fdcd015b030 0x7fdcd00c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/1829904586 >> 10.20.193.10:0/1829904586 conn(0x7fdcd00c9d80 msgr2=0x7fdcd00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/1829904586 shutdown_connections 2026-02-17T12:01:09.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/1829904586 wait complete. 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 10 monclient: build_initial_monmap 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 10 monclient: monmap: 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 librados: starting msgr at 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.944+0000 7fdcd4ce1640 1 librados: starting objecter 2026-02-17T12:01:09.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 Processor -- start 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 -- start start 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 librados: setting wanted keys 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 librados: calling monclient init 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient: init 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdcd0152660 0x7fdcd01f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient(hunting): picked mon.noname-a con 0x7fdcd0152660 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 0x7fdcd01516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient(hunting): picked mon.noname-b con 0x7fdcd0152a40 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdcd015b030 0x7fdcd014b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient(hunting): picked mon.noname-c con 0x7fdcd015b030 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd00c5cd0 con 0x7fdcd0152660 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd015a400 con 0x7fdcd0152a40 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd00c5e50 con 0x7fdcd015b030 2026-02-17T12:01:09.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcd4ce1640 10 monclient(hunting): authenticate will time out at 1339.667449s 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdccdd74640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 0x7fdcd01516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcced76640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdcd015b030 0x7fdcd014b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdcce575640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdcd0152660 0x7fdcd01f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdccdd74640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 0x7fdcd01516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59624/0 (socket says 10.20.193.10:59624) 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdccdd74640 1 -- 10.20.193.10:0/2054323790 learned_addr learned my addr 10.20.193.10:0/2054323790 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdccdd74640 10 monclient(hunting): get_auth_request con 0x7fdcd0152a40 auth_method 0 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdccdd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdccdd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.945+0000 7fdccdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcced76640 10 monclient(hunting): get_auth_request con 0x7fdcd015b030 auth_method 0 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcced76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcced76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcced76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcce575640 10 monclient(hunting): get_auth_request con 0x7fdcd0152660 auth_method 0 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcce575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcce575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcce575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdccdd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdccdd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdccdd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcce575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcce575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcce575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcced76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcced76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.946+0000 7fdcced76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 10 monclient(hunting): handle_auth_done global_id 5233 payload 824 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 1 -- 10.20.193.10:0/2054323790 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdcd015b030 msgr2=0x7fdcd014b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdcd015b030 0x7fdcd014b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 1 -- 10.20.193.10:0/2054323790 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdcd0152660 msgr2=0x7fdcd01f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdcd0152660 0x7fdcd01f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 10 monclient: _finish_hunting 0 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 1 monclient: found mon.noname-b 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.947+0000 7fdccdd74640 1 -- 10.20.193.10:0/2054323790 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd01f58d0 con 0x7fdcd0152a40 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.948+0000 7fdccdd74640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 0x7fdcd01516e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c7f0 tx=0x7fdcb800ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.948+0000 7fdcb6ffd640 10 client.?.objecter ms_handle_connect 0x7fdcd0152a40 2026-02-17T12:01:09.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.948+0000 7fdcb6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcb6ffd640 1 -- 10.20.193.10:0/2054323790 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8015070 con 0x7fdcd0152a40 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcb6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcb6ffd640 10 monclient: dump: 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcb6ffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcb6ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcb6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcd4ce1640 5 monclient: authenticate success, global_id 5233 2026-02-17T12:01:09.956 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcd4ce1640 10 monclient: _renew_subs 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcd4ce1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd0150020 con 0x7fdcd0152a40 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcd4ce1640 10 client.5233.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcd4ce1640 10 monclient: _renew_subs 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcd4ce1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd01505e0 con 0x7fdcd0152a40 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.949+0000 7fdcd4ce1640 1 librados: init done 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcd4ce1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcd4ce1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcd4ce1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd015a920 con 0x7fdcd0152a40 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcb6ffd640 1 -- 10.20.193.10:0/2054323790 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb8004220 con 0x7fdcd0152a40 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcb6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcb6ffd640 1 -- 10.20.193.10:0/2054323790 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb801e060 con 0x7fdcd0152a40 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcb6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcb6ffd640 10 monclient: dump: 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:09.957 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:09.958 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:09.958 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:09.958 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:09.958 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:09.958 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:09.950+0000 7fdcccd72640 4 set_mon_vals no callback set 2026-02-17T12:01:10.056 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.054+0000 7fdcb6ffd640 1 -- 10.20.193.10:0/2054323790 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fdcb8007830 con 0x7fdcd0152a40 2026-02-17T12:01:10.057 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.055+0000 7fdcb6ffd640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc9c078e00 0x7fdc9c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.055+0000 7fdcce575640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc9c078e00 0x7fdc9c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.055+0000 7fdcce575640 10 monclient: get_auth_request con 0x7fdc9c078e00 auth_method 0 2026-02-17T12:01:10.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.055+0000 7fdcb6ffd640 10 client.5233.objecter ms_handle_connect 0x7fdc9c078e00 2026-02-17T12:01:10.058 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.055+0000 7fdcce575640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc9c078e00 0x7fdc9c07b2c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40046e0 tx=0x7fdcc40091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.056+0000 7fdcb6ffd640 1 -- 10.20.193.10:0/2054323790 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fdcb805dcd0 con 0x7fdcd0152a40 2026-02-17T12:01:10.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.056+0000 7fdcb6ffd640 10 client.5233.objecter ms_dispatch2 0x7fdcd0000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:10.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.056+0000 7fdcb6ffd640 3 client.5233.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:10.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.056+0000 7fdcb6ffd640 3 client.5233.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:10.059 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.056+0000 7fdcb6ffd640 20 client.5233.objecter dump_active .. 0 homeless 2026-02-17T12:01:10.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.066+0000 7fdcb6ffd640 1 -- 10.20.193.10:0/2054323790 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdcd01f58d0 con 0x7fdcd0152a40 2026-02-17T12:01:10.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.066+0000 7fdcb6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:10.067 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.066+0000 7fdcb6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:10.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.148+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fdcd015ce20 con 0x7fdc9c078e00 2026-02-17T12:01:10.150 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.148+0000 7fdcb6ffd640 1 -- 10.20.193.10:0/2054323790 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdcd015ce20 con 0x7fdc9c078e00 2026-02-17T12:01:10.150 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T12:01:10.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 10 librados: watch_flush enter 2026-02-17T12:01:10.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 10 librados: watch_flush exit 2026-02-17T12:01:10.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 20 client.5233.objecter shutdown clearing up homeless session... 2026-02-17T12:01:10.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 10 client.5233.objecter successfully canceled tick 2026-02-17T12:01:10.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc9c078e00 msgr2=0x7fdc9c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.151 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc9c078e00 0x7fdc9c07b2c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40046e0 tx=0x7fdcc40091c0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 10 monclient: shutdown 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 msgr2=0x7fdcd01516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 0x7fdcd01516e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c7f0 tx=0x7fdcb800ccc0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 shutdown_connections 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fdc9c078e00 0x7fdc9c07b2c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdcd015b030 0x7fdcd014b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fdcd0152a40 0x7fdcd01516e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 --2- 10.20.193.10:0/2054323790 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fdcd0152660 0x7fdcd01f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 >> 10.20.193.10:0/2054323790 conn(0x7fdcd00c9d80 msgr2=0x7fdcd00ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 shutdown_connections 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 -- 10.20.193.10:0/2054323790 wait complete. 2026-02-17T12:01:10.152 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.149+0000 7fdcd4ce1640 1 librados: shutdown 2026-02-17T12:01:10.160 INFO:tasks.ceph:Scrubbing osd.6 2026-02-17T12:01:10.160 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:10.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.228+0000 7fabff1f7640 10 monclient: get_monmap_and_config 2026-02-17T12:01:10.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.228+0000 7fabff1f7640 10 monclient: build_initial_monmap 2026-02-17T12:01:10.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.228+0000 7fabff1f7640 10 monclient: monmap: 2026-02-17T12:01:10.230 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:10.230 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.230 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:10.230174+0000 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:10.230174+0000 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 1 Processor -- start 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 1 -- start start 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 10 monclient: init 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:10.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 10 monclient: _add_conns ranks=[1,2,4,0,5,3] 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fabf8150300 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fabf81506e0 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fabf80c4780 0x7fabf80c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 10 monclient(hunting): picked mon.noname-b con 0x7fabf80c4780 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf80c55e0 con 0x7fabf8150300 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf80c5300 con 0x7fabf81506e0 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fabf8159c80 con 0x7fabf80c4780 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.229+0000 7fabff1f7640 10 monclient(hunting): authenticate will time out at 1339.951959s 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.230+0000 7fabfcf6c640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fabf8150300 0x7fabf806fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37812/0 (socket says 10.20.193.10:37812) 2026-02-17T12:01:10.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.230+0000 7fabfcf6c640 1 -- 10.20.193.10:0/1397045044 learned_addr learned my addr 10.20.193.10:0/1397045044 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.231+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038636121 0 0) 0x7fabf80c5300 con 0x7fabf81506e0 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.231+0000 7fabef7fe640 10 monclient(hunting): _negotiate 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.231+0000 7fabef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.231+0000 7fabef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.231+0000 7fabef7fe640 10 monclient(hunting): my global_id is 5234 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.231+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabe4003620 con 0x7fabf81506e0 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabfd76d640 1 --2- 10.20.193.10:0/1397045044 >> v2:10.20.193.71:3300/0 conn(0x7fabf80c4780 0x7fabf80c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147308199 0 0) 0x7fabe8002920 con 0x7fabf8150300 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabef7fe640 10 monclient(hunting): _negotiate 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabef7fe640 10 monclient(hunting): my global_id is 5236 2026-02-17T12:01:10.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabf80c5300 con 0x7fabf8150300 2026-02-17T12:01:10.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabfd76d640 10 monclient(hunting): get_auth_request con 0x7fabf80c4780 auth_method 0 2026-02-17T12:01:10.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabfd76d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabfd76d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabfd76d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabfd76d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabfd76d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.234 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.232+0000 7fabfd76d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 <== mon.2 v1:10.20.193.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3616524311 0 0) 0x7fabe4003620 con 0x7fabf81506e0 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 >> v2:10.20.193.71:3300/0 conn(0x7fabf80c4780 msgr2=0x7fabf80c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 --2- 10.20.193.10:0/1397045044 >> v2:10.20.193.71:3300/0 conn(0x7fabf80c4780 0x7fabf80c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 >> v1:10.20.193.71:6789/0 conn(0x7fabf8150300 legacy=0x7fabf806fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 monclient: found mon.noname-c-legacy 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.153:6789/0 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 --> v1:10.20.193.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf8159f60 con 0x7fabf81506e0 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:10.235 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 <== mon.2 v1:10.20.193.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fabe0002f00 con 0x7fabf81506e0 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient: dump: 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] but i'm connected to v1:10.20.193.153:6789/0, reconnecting 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 >> v1:10.20.193.153:6789/0 conn(0x7fabf81506e0 legacy=0x7fabf815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabe4003dd0 0x7fabe40041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient(hunting): picked mon.a con 0x7fabe4003dd0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabe4004900 0x7fabe4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient(hunting): picked mon.c con 0x7fabe4004900 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabe4005380 0x7fabe400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient(hunting): picked mon.b con 0x7fabe4005380 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fabf8159c80 con 0x7fabe4003dd0 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fabe400c2c0 con 0x7fabe4005380 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fabe400c4c0 con 0x7fabe4004900 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabef7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.233+0000 7fabfcf6c640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabe4003dd0 0x7fabe40041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.234+0000 7fabfcf6c640 10 monclient(hunting): get_auth_request con 0x7fabe4003dd0 auth_method 0 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.234+0000 7fabfcf6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.234+0000 7fabfcf6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.234+0000 7fabfcf6c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.234+0000 7fabfcf6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.234+0000 7fabfcf6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.234+0000 7fabfcf6c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.234+0000 7fabeffff640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabe4004900 0x7fabe4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabeffff640 10 monclient(hunting): get_auth_request con 0x7fabe4004900 auth_method 0 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabeffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabeffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabeffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 10 monclient(hunting): handle_auth_done global_id 5234 payload 293 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 1 -- 10.20.193.10:0/1397045044 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabe4004900 msgr2=0x7fabe4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:10.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabe4004900 0x7fabe4004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 1 -- 10.20.193.10:0/1397045044 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabe4005380 msgr2=0x7fabe400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabe4005380 0x7fabe400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 10 monclient: _finish_hunting 0 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 1 monclient: found mon.a 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfd76d640 1 -- 10.20.193.10:0/1397045044 reap_dead start 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 1 -- 10.20.193.10:0/1397045044 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe4003620 con 0x7fabe4003dd0 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 10 monclient: _finish_auth 0 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 10 monclient: _check_auth_tickets 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabfcf6c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabff1f7640 5 monclient: authenticate success, global_id 5234 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.235+0000 7fabff1f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:10.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.236+0000 7fabfcf6c640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabe4003dd0 0x7fabe40041d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fabe80034c0 tx=0x7fabe802f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20abe80d699860c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80030e0 con 0x7fabe4003dd0 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 10 monclient: dump: 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe8033070 con 0x7fabe4003dd0 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 1 -- 10.20.193.10:0/1397045044 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80049a0 con 0x7fabe4003dd0 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabef7fe640 10 monclient: dump: 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 4 set_mon_vals no callback set 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 10 monclient: shutdown 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 1 -- 10.20.193.10:0/1397045044 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabe4003dd0 msgr2=0x7fabe40041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabe4003dd0 0x7fabe40041d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fabe80034c0 tx=0x7fabe802f220 comp rx=0 tx=0).stop 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 1 -- 10.20.193.10:0/1397045044 shutdown_connections 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 1 --2- 10.20.193.10:0/1397045044 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabe4003dd0 0x7fabe40041d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 1 -- 10.20.193.10:0/1397045044 >> 10.20.193.10:0/1397045044 conn(0x7fabf80cd560 msgr2=0x7fabf80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 1 -- 10.20.193.10:0/1397045044 shutdown_connections 2026-02-17T12:01:10.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 1 -- 10.20.193.10:0/1397045044 wait complete. 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 10 monclient: build_initial_monmap 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.238+0000 7fabff1f7640 10 monclient: monmap: 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 librados: starting msgr at 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 librados: starting objecter 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 Processor -- start 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 -- start start 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 librados: setting wanted keys 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 librados: calling monclient init 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient: init 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabe4003dd0 0x7fabf81f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient(hunting): picked mon.noname-b con 0x7fabe4003dd0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabf81f2110 0x7fabf8147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient(hunting): picked mon.noname-c con 0x7fabf81f2110 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabf80c79d0 0x7fabf80c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient(hunting): picked mon.noname-a con 0x7fabf80c79d0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fabf80c4bf0 con 0x7fabf80c79d0 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fabf815a520 con 0x7fabe4003dd0 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fabf80c4d70 con 0x7fabf81f2110 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabff1f7640 10 monclient(hunting): authenticate will time out at 1339.961583s 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabfd76d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabf80c79d0 0x7fabf80c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabeffff640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabf81f2110 0x7fabf8147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabfd76d640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabf80c79d0 0x7fabf80c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44934/0 (socket says 10.20.193.10:44934) 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabfd76d640 1 -- 10.20.193.10:0/2702639393 learned_addr learned my addr 10.20.193.10:0/2702639393 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabfd76d640 10 monclient(hunting): get_auth_request con 0x7fabf80c79d0 auth_method 0 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabfd76d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabfd76d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.239+0000 7fabfd76d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfcf6c640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabe4003dd0 0x7fabf81f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabeffff640 10 monclient(hunting): get_auth_request con 0x7fabf81f2110 auth_method 0 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabeffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfd76d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfd76d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfd76d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfcf6c640 10 monclient(hunting): get_auth_request con 0x7fabe4003dd0 auth_method 0 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfcf6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfcf6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfcf6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfcf6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfcf6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.240+0000 7fabfcf6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 10 monclient(hunting): handle_auth_done global_id 5181 payload 824 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 1 -- 10.20.193.10:0/2702639393 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabf81f2110 msgr2=0x7fabf8147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabf81f2110 0x7fabf8147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 1 -- 10.20.193.10:0/2702639393 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabe4003dd0 msgr2=0x7fabf81f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fabe4003dd0 0x7fabf81f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 10 monclient: _finish_hunting 0 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 1 monclient: found mon.noname-a 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.241+0000 7fabfd76d640 1 -- 10.20.193.10:0/2702639393 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf81f5c20 con 0x7fabf80c79d0 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.242+0000 7fabfd76d640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabf80c79d0 0x7fabf80c7e50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fabf807cf10 tx=0x7fabf400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.242+0000 7fabed7fa640 10 client.?.objecter ms_handle_connect 0x7fabf80c79d0 2026-02-17T12:01:10.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.242+0000 7fabed7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 1 -- 10.20.193.10:0/2702639393 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf400bb20 con 0x7fabf80c79d0 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 10 monclient: dump: 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 10 monclient: _finish_auth 0 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 1 -- 10.20.193.10:0/2702639393 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf401a070 con 0x7fabf80c79d0 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 1 -- 10.20.193.10:0/2702639393 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf4014400 con 0x7fabf80c79d0 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabed7fa640 10 monclient: dump: 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.246 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabeeffd640 4 set_mon_vals no callback set 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 5 monclient: authenticate success, global_id 5181 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 10 monclient: _renew_subs 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf80c8390 con 0x7fabf80c79d0 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 10 client.5181.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 10 monclient: _renew_subs 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf81f5380 con 0x7fabf80c79d0 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 1 librados: init done 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 10 client.5181.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 15 client.5181.objecter _session_command_op_assign -1 1 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 20 client.5181.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 10 client.5181.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.247 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.244+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fabf806fe00 con 0x7fabf80c79d0 2026-02-17T12:01:10.258 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.257+0000 7fabed7fa640 1 -- 10.20.193.10:0/2702639393 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fabf40145a0 con 0x7fabf80c79d0 2026-02-17T12:01:10.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.257+0000 7fabed7fa640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabc8078e50 0x7fabc807b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.257+0000 7fabfcf6c640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabc8078e50 0x7fabc807b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.257+0000 7fabfcf6c640 10 monclient: get_auth_request con 0x7fabc8078e50 auth_method 0 2026-02-17T12:01:10.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.257+0000 7fabed7fa640 10 client.5181.objecter ms_handle_connect 0x7fabc8078e50 2026-02-17T12:01:10.259 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.257+0000 7fabfcf6c640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabc8078e50 0x7fabc807b310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabe8036000 tx=0x7fabe8007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 1 -- 10.20.193.10:0/2702639393 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fabf405eb70 con 0x7fabf80c79d0 2026-02-17T12:01:10.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 10 client.5181.objecter ms_dispatch2 0x7fabf8000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:10.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 3 client.5181.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:10.260 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 3 client.5181.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 10 client.5181.objecter checking command 1 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7fabc8081390 0x7fabc80837b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 20 client.5181.objecter _get_session s=0x7fabc8080cc0 osd=6 3 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 20 client.5181.objecter put_session s=0x7fabc8080cc0 osd=6 3 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 15 client.5181.objecter _session_command_op_remove -1 1 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 20 client.5181.objecter _get_session s=0x7fabc8080cc0 osd=6 3 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 20 client.5181.objecter get_session s=0x7fabc8080cc0 osd=6 3 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 15 client.5181.objecter _session_command_op_assign 6 1 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 20 client.5181.objecter put_session s=0x7fabc8080cc0 osd=6 4 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 10 client.5181.objecter _send_command 1 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 1 -- 10.20.193.10:0/2702639393 --> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabc8083e80 con 0x7fabc8081390 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 20 client.5181.objecter dump_active .. 0 homeless 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 1 -- 10.20.193.10:0/2702639393 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fabf405ef30 con 0x7fabf80c79d0 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.258+0000 7fabed7fa640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.259+0000 7fabeffff640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7fabc8081390 0x7fabc80837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.261 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.259+0000 7fabeffff640 10 monclient: get_auth_request con 0x7fabc8081390 auth_method 0 2026-02-17T12:01:10.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.261+0000 7fabeffff640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7fabc8081390 0x7fabc80837b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.262 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.261+0000 7fabed7fa640 10 client.5181.objecter ms_handle_connect 0x7fabc8081390 2026-02-17T12:01:10.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.271+0000 7fabed7fa640 1 -- 10.20.193.10:0/2702639393 <== osd.6 v2:10.20.193.153:6824/3203696878 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fabc8083e80 con 0x7fabc8081390 2026-02-17T12:01:10.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.271+0000 7fabed7fa640 10 client.5181.objecter ms_dispatch2 0x7fabf8000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:10.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.271+0000 7fabed7fa640 10 client.5181.objecter _finish_command 1 = system:0 2026-02-17T12:01:10.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.271+0000 7fabed7fa640 20 client.5181.objecter put_session s=0x7fabc8080cc0 osd=6 4 2026-02-17T12:01:10.273 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.271+0000 7fabed7fa640 15 client.5181.objecter _session_command_op_remove 6 1 2026-02-17T12:01:10.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 10 client.5181.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:10.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 15 client.5181.objecter _session_command_op_assign -1 2 2026-02-17T12:01:10.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 20 client.5181.objecter _get_session s=0x7fabc8080cc0 osd=6 3 2026-02-17T12:01:10.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 20 client.5181.objecter put_session s=0x7fabc8080cc0 osd=6 3 2026-02-17T12:01:10.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 20 client.5181.objecter _get_session s=0x7fabc8080cc0 osd=6 3 2026-02-17T12:01:10.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 15 client.5181.objecter _session_command_op_remove -1 2 2026-02-17T12:01:10.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 20 client.5181.objecter get_session s=0x7fabc8080cc0 osd=6 3 2026-02-17T12:01:10.279 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 15 client.5181.objecter _session_command_op_assign 6 2 2026-02-17T12:01:10.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 20 client.5181.objecter put_session s=0x7fabc8080cc0 osd=6 4 2026-02-17T12:01:10.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 10 client.5181.objecter _send_command 2 2026-02-17T12:01:10.280 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.277+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 --> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fabf8149b80 con 0x7fabc8081390 2026-02-17T12:01:10.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabed7fa640 1 -- 10.20.193.10:0/2702639393 <== osd.6 v2:10.20.193.153:6824/3203696878 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fabf8149b80 con 0x7fabc8081390 2026-02-17T12:01:10.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabed7fa640 10 client.5181.objecter ms_dispatch2 0x7fabf8000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:10.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabed7fa640 10 client.5181.objecter _finish_command 2 = system:0 2026-02-17T12:01:10.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabed7fa640 20 client.5181.objecter put_session s=0x7fabc8080cc0 osd=6 4 2026-02-17T12:01:10.287 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabed7fa640 15 client.5181.objecter _session_command_op_remove 6 2 2026-02-17T12:01:10.288 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:10.288 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:10.288 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 10 librados: watch_flush enter 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 10 librados: watch_flush exit 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 10 client.5181.objecter close_session for osd.6 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7fabc8081390 msgr2=0x7fabc80837b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.153:6824/3203696878,v1:10.20.193.153:6825/3203696878] conn(0x7fabc8081390 0x7fabc80837b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 20 client.5181.objecter put_session s=0x7fabc8080cc0 osd=6 1 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 20 client.5181.objecter shutdown clearing up homeless session... 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 10 client.5181.objecter successfully canceled tick 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabc8078e50 msgr2=0x7fabc807b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fabc8078e50 0x7fabc807b310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabe8036000 tx=0x7fabe8007000 comp rx=0 tx=0).stop 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 10 monclient: shutdown 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:10.289 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabf80c79d0 msgr2=0x7fabf80c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 --2- 10.20.193.10:0/2702639393 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fabf80c79d0 0x7fabf80c7e50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fabf807cf10 tx=0x7fabf400ef60 comp rx=0 tx=0).stop 2026-02-17T12:01:10.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabfd76d640 1 -- 10.20.193.10:0/2702639393 reap_dead start 2026-02-17T12:01:10.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 shutdown_connections 2026-02-17T12:01:10.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 >> 10.20.193.10:0/2702639393 conn(0x7fabf80cd560 msgr2=0x7fabf806ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:10.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 shutdown_connections 2026-02-17T12:01:10.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 -- 10.20.193.10:0/2702639393 wait complete. 2026-02-17T12:01:10.290 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.285+0000 7fabff1f7640 1 librados: shutdown 2026-02-17T12:01:10.295 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-17T12:01:10.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.361+0000 7faea83cc640 10 monclient: get_monmap_and_config 2026-02-17T12:01:10.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.361+0000 7faea83cc640 10 monclient: build_initial_monmap 2026-02-17T12:01:10.364 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.361+0000 7faea83cc640 10 monclient: monmap: 2026-02-17T12:01:10.364 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:10.364 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.364 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:10.363072+0000 2026-02-17T12:01:10.364 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:10.363072+0000 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 1 Processor -- start 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 1 -- start start 2026-02-17T12:01:10.365 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient: init 2026-02-17T12:01:10.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:10.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient: _add_conns ranks=[5,1,3,2,4,0] 2026-02-17T12:01:10.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7faea015d220 0x7faea015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.368 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient(hunting): picked mon.noname-c con 0x7faea015d220 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7faea0074920 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7faea00c92f0 0x7faea0153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient(hunting): picked mon.noname-a con 0x7faea00c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea00c58a0 con 0x7faea0074920 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7faea00c55c0 con 0x7faea00c92f0 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7faea00c7e20 con 0x7faea015d220 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.362+0000 7faea83cc640 10 monclient(hunting): authenticate will time out at 1340.084905s 2026-02-17T12:01:10.369 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea5940640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7faea0074920 0x7faea00c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37818/0 (socket says 10.20.193.10:37818) 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea5940640 1 -- 10.20.193.10:0/2755728983 learned_addr learned my addr 10.20.193.10:0/2755728983 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6942640 1 --2- 10.20.193.10:0/2755728983 >> v2:10.20.193.10:3300/0 conn(0x7faea00c92f0 0x7faea0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6141640 1 --2- 10.20.193.10:0/2755728983 >> v2:10.20.193.153:3300/0 conn(0x7faea015d220 0x7faea015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6141640 10 monclient(hunting): get_auth_request con 0x7faea015d220 auth_method 0 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6141640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6141640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6141640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6942640 10 monclient(hunting): get_auth_request con 0x7faea00c92f0 auth_method 0 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6942640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6942640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6942640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6942640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.370 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6942640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6942640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6141640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6141640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.363+0000 7faea6141640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.364+0000 7faea6141640 10 monclient(hunting): handle_auth_done global_id 5240 payload 274 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.364+0000 7faea6141640 1 -- 10.20.193.10:0/2755728983 >> v2:10.20.193.10:3300/0 conn(0x7faea00c92f0 msgr2=0x7faea0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.364+0000 7faea6141640 1 --2- 10.20.193.10:0/2755728983 >> v2:10.20.193.10:3300/0 conn(0x7faea00c92f0 0x7faea0153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.364+0000 7faea6141640 1 -- 10.20.193.10:0/2755728983 >> v1:10.20.193.71:6789/0 conn(0x7faea0074920 legacy=0x7faea00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.364+0000 7faea6141640 10 monclient: _finish_hunting 0 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.364+0000 7faea6141640 1 monclient: found mon.noname-c 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.364+0000 7faea6141640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.364+0000 7faea6141640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:10.371 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.364+0000 7faea6141640 1 -- 10.20.193.10:0/2755728983 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea00c8100 con 0x7faea015d220 2026-02-17T12:01:10.372 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.365+0000 7faea6141640 1 --2- 10.20.193.10:0/2755728983 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea015d220 0x7faea015d600 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae900098a0 tx=0x7fae9002ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=915189d93b1e85fa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 1 -- 10.20.193.10:0/2755728983 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9003c070 con 0x7faea015d220 2026-02-17T12:01:10.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:10.378 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 10 monclient: dump: 2026-02-17T12:01:10.378 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 10 monclient: _finish_auth 0 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 10 monclient: _check_auth_tickets 2026-02-17T12:01:10.379 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 1 -- 10.20.193.10:0/2755728983 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae9002fae0 con 0x7faea015d220 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 5 monclient: authenticate success, global_id 5240 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 1 -- 10.20.193.10:0/2755728983 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90037440 con 0x7faea015d220 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 4 set_mon_vals no callback set 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea513f640 10 monclient: dump: 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.380 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 10 monclient: shutdown 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 1 -- 10.20.193.10:0/2755728983 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea015d220 msgr2=0x7faea015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.381 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 1 --2- 10.20.193.10:0/2755728983 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea015d220 0x7faea015d600 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae900098a0 tx=0x7fae9002ee10 comp rx=0 tx=0).stop 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 1 -- 10.20.193.10:0/2755728983 shutdown_connections 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 1 --2- 10.20.193.10:0/2755728983 >> v2:10.20.193.10:3300/0 conn(0x7faea00c92f0 0x7faea0153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 1 --2- 10.20.193.10:0/2755728983 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea015d220 0x7faea015d600 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 1 -- 10.20.193.10:0/2755728983 >> 10.20.193.10:0/2755728983 conn(0x7faea00c9d80 msgr2=0x7faea00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 1 -- 10.20.193.10:0/2755728983 shutdown_connections 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.367+0000 7faea83cc640 1 -- 10.20.193.10:0/2755728983 wait complete. 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.368+0000 7faea83cc640 10 monclient: build_initial_monmap 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.368+0000 7faea83cc640 10 monclient: monmap: 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:10.382 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.368+0000 7faea83cc640 1 librados: starting msgr at 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.368+0000 7faea83cc640 1 librados: starting objecter 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.368+0000 7faea83cc640 1 Processor -- start 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.368+0000 7faea83cc640 1 -- start start 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.368+0000 7faea83cc640 1 librados: setting wanted keys 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.368+0000 7faea83cc640 1 librados: calling monclient init 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.368+0000 7faea83cc640 10 monclient: init 2026-02-17T12:01:10.383 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faea0074920 0x7faea00cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient(hunting): picked mon.noname-b con 0x7faea0074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea00c92f0 0x7faea01f7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient(hunting): picked mon.noname-c con 0x7faea00c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faea015d220 0x7faea006d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient(hunting): picked mon.noname-a con 0x7faea015d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7faea0074d70 con 0x7faea015d220 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7faea00c86c0 con 0x7faea0074920 2026-02-17T12:01:10.384 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7faea0153b90 con 0x7faea00c92f0 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea83cc640 10 monclient(hunting): authenticate will time out at 1340.091302s 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea5940640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea00c92f0 0x7faea01f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6942640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faea015d220 0x7faea006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6141640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faea0074920 0x7faea00cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea5940640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea00c92f0 0x7faea01f7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36436/0 (socket says 10.20.193.10:36436) 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea5940640 1 -- 10.20.193.10:0/3753428636 learned_addr learned my addr 10.20.193.10:0/3753428636 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea5940640 10 monclient(hunting): get_auth_request con 0x7faea00c92f0 auth_method 0 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea5940640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea5940640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea5940640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6942640 10 monclient(hunting): get_auth_request con 0x7faea015d220 auth_method 0 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6942640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6942640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6942640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6141640 10 monclient(hunting): get_auth_request con 0x7faea0074920 auth_method 0 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6141640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6141640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea6141640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea5940640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.369+0000 7faea5940640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.370+0000 7faea5940640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.370+0000 7faea6942640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.370+0000 7faea6942640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.370+0000 7faea6942640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.370+0000 7faea6141640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.370+0000 7faea6141640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.370+0000 7faea6141640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 10 monclient(hunting): handle_auth_done global_id 5187 payload 824 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 1 -- 10.20.193.10:0/3753428636 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea00c92f0 msgr2=0x7faea01f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea00c92f0 0x7faea01f7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 1 -- 10.20.193.10:0/3753428636 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faea0074920 msgr2=0x7faea00cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faea0074920 0x7faea00cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 10 monclient: _finish_hunting 0 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 1 monclient: found mon.noname-a 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:10.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.371+0000 7faea6942640 1 -- 10.20.193.10:0/3753428636 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea00cb740 con 0x7faea015d220 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.372+0000 7faea6942640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faea015d220 0x7faea006d750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009d90 tx=0x7fae9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.372+0000 7fae86ffd640 10 client.?.objecter ms_handle_connect 0x7faea015d220 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.372+0000 7fae86ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 1 -- 10.20.193.10:0/3753428636 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c018020 con 0x7faea015d220 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 10 monclient: dump: 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.388 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 1 -- 10.20.193.10:0/3753428636 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae9c014480 con 0x7faea015d220 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 1 -- 10.20.193.10:0/3753428636 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c014870 con 0x7faea015d220 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7fae86ffd640 10 monclient: dump: 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea493e640 4 set_mon_vals no callback set 2026-02-17T12:01:10.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 5 monclient: authenticate success, global_id 5187 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 10 monclient: _renew_subs 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea00cba20 con 0x7faea015d220 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 10 client.5187.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 10 monclient: _renew_subs 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea00cbfe0 con 0x7faea015d220 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 1 librados: init done 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.374+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea0069900 con 0x7faea015d220 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.386+0000 7fae86ffd640 1 -- 10.20.193.10:0/3753428636 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fae9c014a10 con 0x7faea015d220 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.386+0000 7fae86ffd640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae70078e30 0x7fae7007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.386+0000 7faea6141640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae70078e30 0x7fae7007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.386+0000 7faea6141640 10 monclient: get_auth_request con 0x7fae70078e30 auth_method 0 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.386+0000 7fae86ffd640 10 client.5187.objecter ms_handle_connect 0x7fae70078e30 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.386+0000 7faea6141640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae70078e30 0x7fae7007b2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae90039000 tx=0x7fae90033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.387+0000 7fae86ffd640 1 -- 10.20.193.10:0/3753428636 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fae9c05eee0 con 0x7faea015d220 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.387+0000 7fae86ffd640 10 client.5187.objecter ms_dispatch2 0x7faea0000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.387+0000 7fae86ffd640 3 client.5187.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.387+0000 7fae86ffd640 3 client.5187.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:10.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.387+0000 7fae86ffd640 20 client.5187.objecter dump_active .. 0 homeless 2026-02-17T12:01:10.495 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.494+0000 7fae86ffd640 1 -- 10.20.193.10:0/3753428636 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faea0069900 con 0x7faea015d220 2026-02-17T12:01:10.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.494+0000 7fae86ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:10.496 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.494+0000 7fae86ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:10.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.577+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7faea0153f70 con 0x7fae70078e30 2026-02-17T12:01:10.579 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.577+0000 7fae86ffd640 1 -- 10.20.193.10:0/3753428636 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faea0153f70 con 0x7fae70078e30 2026-02-17T12:01:10.579 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 6 to deep-scrub 2026-02-17T12:01:10.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 10 librados: watch_flush enter 2026-02-17T12:01:10.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 10 librados: watch_flush exit 2026-02-17T12:01:10.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 20 client.5187.objecter shutdown clearing up homeless session... 2026-02-17T12:01:10.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 10 client.5187.objecter successfully canceled tick 2026-02-17T12:01:10.581 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae70078e30 msgr2=0x7fae7007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae70078e30 0x7fae7007b2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae90039000 tx=0x7fae90033000 comp rx=0 tx=0).stop 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 10 monclient: shutdown 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faea015d220 msgr2=0x7faea006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faea015d220 0x7faea006d750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009d90 tx=0x7fae9c00c490 comp rx=0 tx=0).stop 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 shutdown_connections 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fae70078e30 0x7fae7007b2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7faea015d220 0x7faea006d750 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faea00c92f0 0x7faea01f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 --2- 10.20.193.10:0/3753428636 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7faea0074920 0x7faea00cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 >> 10.20.193.10:0/3753428636 conn(0x7faea00c9d80 msgr2=0x7faea006fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:10.582 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 shutdown_connections 2026-02-17T12:01:10.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 -- 10.20.193.10:0/3753428636 wait complete. 2026-02-17T12:01:10.583 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.578+0000 7faea83cc640 1 librados: shutdown 2026-02-17T12:01:10.588 INFO:tasks.ceph:Scrubbing osd.10 2026-02-17T12:01:10.589 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:10.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.656+0000 7fae307f5640 10 monclient: get_monmap_and_config 2026-02-17T12:01:10.658 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.656+0000 7fae307f5640 10 monclient: build_initial_monmap 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.656+0000 7fae307f5640 10 monclient: monmap: 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:10.658184+0000 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:10.658184+0000 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:10.659 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.657+0000 7fae307f5640 1 Processor -- start 2026-02-17T12:01:10.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.657+0000 7fae307f5640 1 -- start start 2026-02-17T12:01:10.660 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.657+0000 7fae307f5640 10 monclient: init 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.657+0000 7fae307f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.657+0000 7fae307f5640 10 monclient: _add_conns ranks=[1,0,5,4,2,3] 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.657+0000 7fae307f5640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fae2814f1b0 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.657+0000 7fae307f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fae2814f590 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.657+0000 7fae307f5640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fae280c61f0 0x7fae2806da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.657+0000 7fae307f5640 10 monclient(hunting): picked mon.noname-c con 0x7fae280c61f0 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae307f5640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2806e190 con 0x7fae2814f590 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae307f5640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2806e470 con 0x7fae2814f1b0 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae307f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae307f5640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fae2806e750 con 0x7fae280c61f0 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae307f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae307f5640 10 monclient(hunting): authenticate will time out at 1340.380020s 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae2e56a640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fae2814f1b0 0x7fae280c5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37822/0 (socket says 10.20.193.10:37822) 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae2e56a640 1 -- 10.20.193.10:0/4154795000 learned_addr learned my addr 10.20.193.10:0/4154795000 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae2ed6b640 1 --2- 10.20.193.10:0/4154795000 >> v2:10.20.193.153:3300/0 conn(0x7fae280c61f0 0x7fae2806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae2ed6b640 10 monclient(hunting): get_auth_request con 0x7fae280c61f0 auth_method 0 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae2ed6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae2ed6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.658+0000 7fae2ed6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.661 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.662 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 1 -- 10.20.193.10:0/4154795000 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542331941 0 0) 0x7fae2806e470 con 0x7fae2814f1b0 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 10 monclient(hunting): _negotiate 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 10 monclient(hunting): my global_id is 5251 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 1 -- 10.20.193.10:0/4154795000 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae10003620 con 0x7fae2814f1b0 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 1 -- 10.20.193.10:0/4154795000 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243044354 0 0) 0x7fae2806e190 con 0x7fae2814f590 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 10 monclient(hunting): _negotiate 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 10 monclient(hunting): my global_id is 5190 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2d568640 1 -- 10.20.193.10:0/4154795000 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae2806e470 con 0x7fae2814f590 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 10 monclient(hunting): handle_auth_done global_id 5246 payload 274 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 1 -- 10.20.193.10:0/4154795000 >> v1:10.20.193.71:6789/0 conn(0x7fae2814f1b0 legacy=0x7fae280c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 1 -- 10.20.193.10:0/4154795000 >> v1:10.20.193.10:6789/0 conn(0x7fae2814f590 legacy=0x7fae280c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 10 monclient: _finish_hunting 0 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 1 monclient: found mon.noname-c 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.659+0000 7fae2ed6b640 1 -- 10.20.193.10:0/4154795000 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2806ea30 con 0x7fae280c61f0 2026-02-17T12:01:10.663 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.661+0000 7fae2ed6b640 1 --2- 10.20.193.10:0/4154795000 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae280c61f0 0x7fae2806da70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae24009d90 tx=0x7fae2402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd143b4aa260031 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 1 -- 10.20.193.10:0/4154795000 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2403c070 con 0x7fae280c61f0 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 10 monclient: dump: 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.665 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 10 monclient: _finish_auth 0 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 10 monclient: _check_auth_tickets 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 1 -- 10.20.193.10:0/4154795000 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae24037440 con 0x7fae280c61f0 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae307f5640 5 monclient: authenticate success, global_id 5246 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae307f5640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 1 -- 10.20.193.10:0/4154795000 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae24037810 con 0x7fae280c61f0 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae307f5640 4 set_mon_vals no callback set 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.662+0000 7fae2d568640 10 monclient: dump: 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.666 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 10 monclient: shutdown 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 -- 10.20.193.10:0/4154795000 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae280c61f0 msgr2=0x7fae2806da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 --2- 10.20.193.10:0/4154795000 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae280c61f0 0x7fae2806da70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae24009d90 tx=0x7fae2402f230 comp rx=0 tx=0).stop 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 -- 10.20.193.10:0/4154795000 shutdown_connections 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 --2- 10.20.193.10:0/4154795000 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae280c61f0 0x7fae2806da70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 -- 10.20.193.10:0/4154795000 >> 10.20.193.10:0/4154795000 conn(0x7fae280cd560 msgr2=0x7fae280cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 -- 10.20.193.10:0/4154795000 shutdown_connections 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 -- 10.20.193.10:0/4154795000 wait complete. 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 10 monclient: build_initial_monmap 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 10 monclient: monmap: 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:10.667 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.668 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:10.668 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:10.668 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:10.668 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 librados: starting msgr at 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 librados: starting objecter 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.663+0000 7fae307f5640 1 Processor -- start 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 1 -- start start 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 1 librados: setting wanted keys 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 1 librados: calling monclient init 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient: init 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae280c61f0 0x7fae280c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient(hunting): picked mon.noname-c con 0x7fae280c61f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2814f1b0 0x7fae281f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient(hunting): picked mon.noname-a con 0x7fae2814f1b0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2814f590 0x7fae28073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient(hunting): picked mon.noname-b con 0x7fae2814f590 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.671 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fae280c9560 con 0x7fae2814f1b0 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae2806eff0 con 0x7fae2814f590 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae280c96e0 con 0x7fae280c61f0 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae307f5640 10 monclient(hunting): authenticate will time out at 1340.386458s 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae2e56a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae280c61f0 0x7fae280c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae2ed6b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2814f590 0x7fae28073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae2dd69640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2814f1b0 0x7fae281f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae2e56a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae280c61f0 0x7fae280c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36452/0 (socket says 10.20.193.10:36452) 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae2e56a640 1 -- 10.20.193.10:0/1923186658 learned_addr learned my addr 10.20.193.10:0/1923186658 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae2e56a640 10 monclient(hunting): get_auth_request con 0x7fae280c61f0 auth_method 0 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae2e56a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae2e56a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.664+0000 7fae2e56a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2ed6b640 10 monclient(hunting): get_auth_request con 0x7fae2814f590 auth_method 0 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2ed6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2ed6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2ed6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2dd69640 10 monclient(hunting): get_auth_request con 0x7fae2814f1b0 auth_method 0 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2dd69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2dd69640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.672 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2dd69640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2e56a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2e56a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2e56a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2ed6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2ed6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2ed6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2dd69640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2dd69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.665+0000 7fae2dd69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 10 monclient(hunting): handle_auth_done global_id 5254 payload 824 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 1 -- 10.20.193.10:0/1923186658 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae280c61f0 msgr2=0x7fae280c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fae280c61f0 0x7fae280c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 1 -- 10.20.193.10:0/1923186658 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2814f1b0 msgr2=0x7fae281f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fae2814f1b0 0x7fae281f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 10 monclient: _finish_hunting 0 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 1 monclient: found mon.noname-b 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.666+0000 7fae2ed6b640 1 -- 10.20.193.10:0/1923186658 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae281f4860 con 0x7fae2814f590 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.667+0000 7fae2ed6b640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2814f590 0x7fae28073f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fae24036000 tx=0x7fae24004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.667+0000 7fae0effd640 10 client.?.objecter ms_handle_connect 0x7fae2814f590 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.667+0000 7fae0effd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae0effd640 1 -- 10.20.193.10:0/1923186658 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2403c050 con 0x7fae2814f590 2026-02-17T12:01:10.673 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae0effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae0effd640 10 monclient: dump: 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae0effd640 10 monclient: _finish_auth 0 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae0effd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 5 monclient: authenticate success, global_id 5254 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 10 monclient: _renew_subs 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae280c1130 con 0x7fae2814f590 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 10 client.5254.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 10 monclient: _renew_subs 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae280c13d0 con 0x7fae2814f590 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 1 librados: init done 2026-02-17T12:01:10.674 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 10 client.5254.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 15 client.5254.objecter _session_command_op_assign -1 1 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 20 client.5254.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 10 client.5254.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.668+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae2806da70 con 0x7fae2814f590 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.669+0000 7fae0effd640 1 -- 10.20.193.10:0/1923186658 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae2806da70 con 0x7fae2814f590 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.669+0000 7fae0effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.669+0000 7fae0effd640 1 -- 10.20.193.10:0/1923186658 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae24041810 con 0x7fae2814f590 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.669+0000 7fae0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.669+0000 7fae0effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.669+0000 7fae2cd67640 4 set_mon_vals no callback set 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.669+0000 7fae0effd640 10 monclient: dump: 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.675 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.681+0000 7fae0effd640 1 -- 10.20.193.10:0/1923186658 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fae240419b0 con 0x7fae2814f590 2026-02-17T12:01:10.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.682+0000 7fae0effd640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadf8078e30 0x7fadf807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.683 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.682+0000 7fae2e56a640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadf8078e30 0x7fadf807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.682+0000 7fae2e56a640 10 monclient: get_auth_request con 0x7fadf8078e30 auth_method 0 2026-02-17T12:01:10.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.682+0000 7fae0effd640 10 client.5254.objecter ms_handle_connect 0x7fadf8078e30 2026-02-17T12:01:10.684 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.682+0000 7fae2e56a640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadf8078e30 0x7fadf807b2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fae18005980 tx=0x7fae18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 1 -- 10.20.193.10:0/1923186658 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fae240bd5a0 con 0x7fae2814f590 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 10 client.5254.objecter ms_dispatch2 0x7fae28000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 3 client.5254.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 3 client.5254.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 10 client.5254.objecter checking command 1 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7fadf8081310 0x7fadf8083730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 20 client.5254.objecter _get_session s=0x7fadf8080c40 osd=10 3 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 20 client.5254.objecter put_session s=0x7fadf8080c40 osd=10 3 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 15 client.5254.objecter _session_command_op_remove -1 1 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 20 client.5254.objecter _get_session s=0x7fadf8080c40 osd=10 3 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 20 client.5254.objecter get_session s=0x7fadf8080c40 osd=10 3 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 15 client.5254.objecter _session_command_op_assign 10 1 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 20 client.5254.objecter put_session s=0x7fadf8080c40 osd=10 4 2026-02-17T12:01:10.685 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 10 client.5254.objecter _send_command 1 2026-02-17T12:01:10.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 1 -- 10.20.193.10:0/1923186658 --> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae240038c0 con 0x7fadf8081310 2026-02-17T12:01:10.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 20 client.5254.objecter dump_active .. 0 homeless 2026-02-17T12:01:10.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 1 -- 10.20.193.10:0/1923186658 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fae24083fe0 con 0x7fae2814f590 2026-02-17T12:01:10.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae0effd640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:10.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae2dd69640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7fadf8081310 0x7fadf8083730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.686 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.683+0000 7fae2dd69640 10 monclient: get_auth_request con 0x7fadf8081310 auth_method 0 2026-02-17T12:01:10.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.685+0000 7fae0effd640 10 client.5254.objecter ms_handle_connect 0x7fadf8081310 2026-02-17T12:01:10.687 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.685+0000 7fae2dd69640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7fadf8081310 0x7fadf8083730 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.697 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.696+0000 7fae0effd640 1 -- 10.20.193.10:0/1923186658 <== osd.10 v2:10.20.193.153:6800/22479275 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fae240038c0 con 0x7fadf8081310 2026-02-17T12:01:10.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.696+0000 7fae0effd640 10 client.5254.objecter ms_dispatch2 0x7fae28000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:10.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.696+0000 7fae0effd640 10 client.5254.objecter _finish_command 1 = system:0 2026-02-17T12:01:10.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.696+0000 7fae0effd640 20 client.5254.objecter put_session s=0x7fadf8080c40 osd=10 4 2026-02-17T12:01:10.698 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.696+0000 7fae0effd640 15 client.5254.objecter _session_command_op_remove 10 1 2026-02-17T12:01:10.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 10 client.5254.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:10.703 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 15 client.5254.objecter _session_command_op_assign -1 2 2026-02-17T12:01:10.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 20 client.5254.objecter _get_session s=0x7fadf8080c40 osd=10 3 2026-02-17T12:01:10.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 20 client.5254.objecter put_session s=0x7fadf8080c40 osd=10 3 2026-02-17T12:01:10.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 20 client.5254.objecter _get_session s=0x7fadf8080c40 osd=10 3 2026-02-17T12:01:10.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 15 client.5254.objecter _session_command_op_remove -1 2 2026-02-17T12:01:10.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 20 client.5254.objecter get_session s=0x7fadf8080c40 osd=10 3 2026-02-17T12:01:10.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 15 client.5254.objecter _session_command_op_assign 10 2 2026-02-17T12:01:10.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 20 client.5254.objecter put_session s=0x7fadf8080c40 osd=10 4 2026-02-17T12:01:10.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 10 client.5254.objecter _send_command 2 2026-02-17T12:01:10.704 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.701+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 --> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae2814d1c0 con 0x7fadf8081310 2026-02-17T12:01:10.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae0effd640 1 -- 10.20.193.10:0/1923186658 <== osd.10 v2:10.20.193.153:6800/22479275 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae2814d1c0 con 0x7fadf8081310 2026-02-17T12:01:10.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae0effd640 10 client.5254.objecter ms_dispatch2 0x7fae28000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:10.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae0effd640 10 client.5254.objecter _finish_command 2 = system:0 2026-02-17T12:01:10.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae0effd640 20 client.5254.objecter put_session s=0x7fadf8080c40 osd=10 4 2026-02-17T12:01:10.711 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae0effd640 15 client.5254.objecter _session_command_op_remove 10 2 2026-02-17T12:01:10.712 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:10.712 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:10.712 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 10 librados: watch_flush enter 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 10 librados: watch_flush exit 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 10 client.5254.objecter close_session for osd.10 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7fadf8081310 msgr2=0x7fadf8083730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.153:6800/22479275,v1:10.20.193.153:6801/22479275] conn(0x7fadf8081310 0x7fadf8083730 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 20 client.5254.objecter put_session s=0x7fadf8080c40 osd=10 1 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 20 client.5254.objecter shutdown clearing up homeless session... 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 10 client.5254.objecter successfully canceled tick 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadf8078e30 msgr2=0x7fadf807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.714 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadf8078e30 0x7fadf807b2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fae18005980 tx=0x7fae18009040 comp rx=0 tx=0).stop 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 10 monclient: shutdown 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2814f590 msgr2=0x7fae28073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 --2- 10.20.193.10:0/1923186658 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fae2814f590 0x7fae28073f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fae24036000 tx=0x7fae24004b40 comp rx=0 tx=0).stop 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae2ed6b640 1 -- 10.20.193.10:0/1923186658 reap_dead start 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 shutdown_connections 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 >> 10.20.193.10:0/1923186658 conn(0x7fae280cd560 msgr2=0x7fae2814c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 shutdown_connections 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 -- 10.20.193.10:0/1923186658 wait complete. 2026-02-17T12:01:10.715 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.710+0000 7fae307f5640 1 librados: shutdown 2026-02-17T12:01:10.719 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-17T12:01:10.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.784+0000 7fc3bd1de640 10 monclient: get_monmap_and_config 2026-02-17T12:01:10.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.784+0000 7fc3bd1de640 10 monclient: build_initial_monmap 2026-02-17T12:01:10.790 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.784+0000 7fc3bd1de640 10 monclient: monmap: 2026-02-17T12:01:10.791 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:10.791 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.791 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:10.785731+0000 2026-02-17T12:01:10.791 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:10.785731+0000 2026-02-17T12:01:10.791 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:10.791 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.791 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:10.792 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:10.792 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:10.792 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:10.792 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:10.792 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:10.792 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.784+0000 7fc3bd1de640 1 Processor -- start 2026-02-17T12:01:10.792 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 1 -- start start 2026-02-17T12:01:10.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient: init 2026-02-17T12:01:10.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:10.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient: _add_conns ranks=[5,2,3,4,1,0] 2026-02-17T12:01:10.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc3b815d220 0x7fc3b815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient(hunting): picked mon.noname-c con 0x7fc3b815d220 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:10.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc3b8074920 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:10.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc3b80c92f0 0x7fc3b8153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.793 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient(hunting): picked mon.noname-a con 0x7fc3b80c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:10.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b80c58a0 con 0x7fc3b8074920 2026-02-17T12:01:10.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b80c55c0 con 0x7fc3b80c92f0 2026-02-17T12:01:10.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b80c7e20 con 0x7fc3b815d220 2026-02-17T12:01:10.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:10.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.785+0000 7fc3bd1de640 10 monclient(hunting): authenticate will time out at 1340.507558s 2026-02-17T12:01:10.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc3b80c92f0 0x7fc3b8153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.794 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b6d76640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc3b815d220 0x7fc3b815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc3b80c92f0 0x7fc3b8153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44966/0 (socket says 10.20.193.10:44966) 2026-02-17T12:01:10.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 1 -- 10.20.193.10:0/3934151935 learned_addr learned my addr 10.20.193.10:0/3934151935 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:10.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 10 monclient(hunting): get_auth_request con 0x7fc3b80c92f0 auth_method 0 2026-02-17T12:01:10.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b6d76640 10 monclient(hunting): get_auth_request con 0x7fc3b815d220 auth_method 0 2026-02-17T12:01:10.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b7577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.786+0000 7fc3b6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.787+0000 7fc3b7577640 10 monclient(hunting): handle_auth_done global_id 5196 payload 274 2026-02-17T12:01:10.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.787+0000 7fc3b7577640 1 -- 10.20.193.10:0/3934151935 >> v2:10.20.193.153:3300/0 conn(0x7fc3b815d220 msgr2=0x7fc3b815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:10.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.787+0000 7fc3b7577640 1 --2- 10.20.193.10:0/3934151935 >> v2:10.20.193.153:3300/0 conn(0x7fc3b815d220 0x7fc3b815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.787+0000 7fc3b7577640 1 -- 10.20.193.10:0/3934151935 >> v1:10.20.193.153:6789/0 conn(0x7fc3b8074920 legacy=0x7fc3b80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.787+0000 7fc3b7577640 10 monclient: _finish_hunting 0 2026-02-17T12:01:10.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.787+0000 7fc3b7577640 1 monclient: found mon.noname-a 2026-02-17T12:01:10.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.787+0000 7fc3b7577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:10.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.787+0000 7fc3b7577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.787+0000 7fc3b7577640 1 -- 10.20.193.10:0/3934151935 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b80c8100 con 0x7fc3b80c92f0 2026-02-17T12:01:10.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.788+0000 7fc3b7577640 1 --2- 10.20.193.10:0/3934151935 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b80c92f0 0x7fc3b8153650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009e50 tx=0x7fc3a802f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffbbf2df19d3320 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 1 -- 10.20.193.10:0/3934151935 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a802fd60 con 0x7fc3b80c92f0 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 10 monclient: dump: 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.809 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 10 monclient: _finish_auth 0 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 10 monclient: _check_auth_tickets 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 1 -- 10.20.193.10:0/3934151935 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a80373f0 con 0x7fc3b80c92f0 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 5 monclient: authenticate success, global_id 5196 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 1 -- 10.20.193.10:0/3934151935 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a80377c0 con 0x7fc3b80c92f0 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3b5d74640 10 monclient: dump: 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.810 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 4 set_mon_vals no callback set 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 10 monclient: shutdown 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 1 -- 10.20.193.10:0/3934151935 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b80c92f0 msgr2=0x7fc3b8153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 1 --2- 10.20.193.10:0/3934151935 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b80c92f0 0x7fc3b8153650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009e50 tx=0x7fc3a802f2a0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 1 -- 10.20.193.10:0/3934151935 shutdown_connections 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 1 --2- 10.20.193.10:0/3934151935 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b80c92f0 0x7fc3b8153650 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 1 --2- 10.20.193.10:0/3934151935 >> v2:10.20.193.153:3300/0 conn(0x7fc3b815d220 0x7fc3b815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 1 -- 10.20.193.10:0/3934151935 >> 10.20.193.10:0/3934151935 conn(0x7fc3b80c9d80 msgr2=0x7fc3b80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 1 -- 10.20.193.10:0/3934151935 shutdown_connections 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.790+0000 7fc3bd1de640 1 -- 10.20.193.10:0/3934151935 wait complete. 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.791+0000 7fc3bd1de640 10 monclient: build_initial_monmap 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.791+0000 7fc3bd1de640 10 monclient: monmap: 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:10.811 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.791+0000 7fc3bd1de640 1 librados: starting msgr at 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.791+0000 7fc3bd1de640 1 librados: starting objecter 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.791+0000 7fc3bd1de640 1 Processor -- start 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.791+0000 7fc3bd1de640 1 -- start start 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.791+0000 7fc3bd1de640 1 librados: setting wanted keys 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.791+0000 7fc3bd1de640 1 librados: calling monclient init 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.791+0000 7fc3bd1de640 10 monclient: init 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc3b8074920 0x7fc3b814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient(hunting): picked mon.noname-b con 0x7fc3b8074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc3b80c92f0 0x7fc3b8072d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient(hunting): picked mon.noname-c con 0x7fc3b80c92f0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:10.812 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b815d220 0x7fc3b80732b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient(hunting): picked mon.noname-a con 0x7fc3b815d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8074d70 con 0x7fc3b815d220 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b80c86c0 con 0x7fc3b8074920 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8153b90 con 0x7fc3b80c92f0 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3bd1de640 10 monclient(hunting): authenticate will time out at 1340.514199s 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b815d220 0x7fc3b80732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b815d220 0x7fc3b80732b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44980/0 (socket says 10.20.193.10:44980) 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 1 -- 10.20.193.10:0/2406580060 learned_addr learned my addr 10.20.193.10:0/2406580060 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 10 monclient(hunting): get_auth_request con 0x7fc3b815d220 auth_method 0 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6d76640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc3b8074920 0x7fc3b814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6575640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc3b80c92f0 0x7fc3b8072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6d76640 10 monclient(hunting): get_auth_request con 0x7fc3b8074920 auth_method 0 2026-02-17T12:01:10.813 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6575640 10 monclient(hunting): get_auth_request con 0x7fc3b80c92f0 auth_method 0 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.792+0000 7fc3b7577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.793+0000 7fc3b6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.793+0000 7fc3b6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.793+0000 7fc3b6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.793+0000 7fc3b6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.793+0000 7fc3b6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.793+0000 7fc3b6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 10 monclient(hunting): handle_auth_done global_id 5199 payload 824 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 1 -- 10.20.193.10:0/2406580060 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc3b80c92f0 msgr2=0x7fc3b8072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc3b80c92f0 0x7fc3b8072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 1 -- 10.20.193.10:0/2406580060 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc3b8074920 msgr2=0x7fc3b814d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc3b8074920 0x7fc3b814d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 10 monclient: _finish_hunting 0 2026-02-17T12:01:10.814 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 1 monclient: found mon.noname-a 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b7577640 1 -- 10.20.193.10:0/2406580060 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b81571b0 con 0x7fc3b815d220 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.794+0000 7fc3b6575640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc3b80c92f0 0x7fc3b8072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.795+0000 7fc3b7577640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b815d220 0x7fc3b80732b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc3a802f7d0 tx=0x7fc3a8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.795+0000 7fc3977fe640 10 client.?.objecter ms_handle_connect 0x7fc3b815d220 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.795+0000 7fc3977fe640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 1 -- 10.20.193.10:0/2406580060 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8046020 con 0x7fc3b815d220 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 10 monclient: dump: 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 1 -- 10.20.193.10:0/2406580060 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a8041450 con 0x7fc3b815d220 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 5 monclient: authenticate success, global_id 5199 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 10 monclient: _renew_subs 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b814b2d0 con 0x7fc3b815d220 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 1 -- 10.20.193.10:0/2406580060 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8009510 con 0x7fc3b815d220 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3977fe640 10 monclient: dump: 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:10.816 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3b5573640 4 set_mon_vals no callback set 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 10 client.5199.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 10 monclient: _renew_subs 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b814b890 con 0x7fc3b815d220 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 1 librados: init done 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:10.817 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.797+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b8153f20 con 0x7fc3b815d220 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.809+0000 7fc3977fe640 1 -- 10.20.193.10:0/2406580060 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc3a8041820 con 0x7fc3b815d220 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.809+0000 7fc3977fe640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc384078e80 0x7fc38407b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.810+0000 7fc3b6d76640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc384078e80 0x7fc38407b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.810+0000 7fc3b6d76640 10 monclient: get_auth_request con 0x7fc384078e80 auth_method 0 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.810+0000 7fc3b6d76640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc384078e80 0x7fc38407b340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009ba0 tx=0x7fc3ac009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.810+0000 7fc3977fe640 10 client.5199.objecter ms_handle_connect 0x7fc384078e80 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.811+0000 7fc3977fe640 1 -- 10.20.193.10:0/2406580060 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc3a8083890 con 0x7fc3b815d220 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.811+0000 7fc3977fe640 10 client.5199.objecter ms_dispatch2 0x7fc3b8000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.811+0000 7fc3977fe640 3 client.5199.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.811+0000 7fc3977fe640 3 client.5199.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:10.818 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.811+0000 7fc3977fe640 20 client.5199.objecter dump_active .. 0 homeless 2026-02-17T12:01:10.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.913+0000 7fc3977fe640 1 -- 10.20.193.10:0/2406580060 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc3a8050030 con 0x7fc3b815d220 2026-02-17T12:01:10.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.913+0000 7fc3977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:10.914 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.913+0000 7fc3977fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:11.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.998+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7fc3b80c9b60 con 0x7fc384078e80 2026-02-17T12:01:11.000 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.998+0000 7fc3977fe640 1 -- 10.20.193.10:0/2406580060 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7fc3b80c9b60 con 0x7fc384078e80 2026-02-17T12:01:11.001 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 10 to deep-scrub 2026-02-17T12:01:11.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 10 librados: watch_flush enter 2026-02-17T12:01:11.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 10 librados: watch_flush exit 2026-02-17T12:01:11.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 20 client.5199.objecter shutdown clearing up homeless session... 2026-02-17T12:01:11.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 10 client.5199.objecter successfully canceled tick 2026-02-17T12:01:11.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc384078e80 msgr2=0x7fc38407b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc384078e80 0x7fc38407b340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009ba0 tx=0x7fc3ac009290 comp rx=0 tx=0).stop 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 10 monclient: shutdown 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b815d220 msgr2=0x7fc3b80732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b815d220 0x7fc3b80732b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc3a802f7d0 tx=0x7fc3a8004b40 comp rx=0 tx=0).stop 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 shutdown_connections 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc384078e80 0x7fc38407b340 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc3b815d220 0x7fc3b80732b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc3b80c92f0 0x7fc3b8072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 --2- 10.20.193.10:0/2406580060 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc3b8074920 0x7fc3b814d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.003 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 >> 10.20.193.10:0/2406580060 conn(0x7fc3b80c9d80 msgr2=0x7fc3b814df70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 shutdown_connections 2026-02-17T12:01:11.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 -- 10.20.193.10:0/2406580060 wait complete. 2026-02-17T12:01:11.004 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:10.999+0000 7fc3bd1de640 1 librados: shutdown 2026-02-17T12:01:11.010 INFO:tasks.ceph:Scrubbing osd.14 2026-02-17T12:01:11.010 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:11.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.078+0000 7f01b37d3640 10 monclient: get_monmap_and_config 2026-02-17T12:01:11.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.078+0000 7f01b37d3640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.080 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.078+0000 7f01b37d3640 10 monclient: monmap: 2026-02-17T12:01:11.080 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.080 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.080 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:11.079518+0000 2026-02-17T12:01:11.080 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:11.079518+0000 2026-02-17T12:01:11.081 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.081 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.081 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:11.081 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:11.081 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:11.081 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:11.081 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:11.081 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:11.081 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.078+0000 7f01b37d3640 1 Processor -- start 2026-02-17T12:01:11.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.078+0000 7f01b37d3640 1 -- start start 2026-02-17T12:01:11.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.078+0000 7f01b37d3640 10 monclient: init 2026-02-17T12:01:11.084 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 10 monclient: _add_conns ranks=[3,1,2,0,4,5] 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f01ac156070 0x7f01ac15c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 10 monclient(hunting): picked mon.noname-a con 0x7f01ac156070 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f01ac0708b0 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f01ac15c890 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01ac15cd00 con 0x7f01ac0708b0 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01ac0cbd20 con 0x7f01ac15c890 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f01ac15bec0 con 0x7f01ac156070 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.085 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.079+0000 7f01b37d3640 10 monclient(hunting): authenticate will time out at 1340.801581s 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b0d47640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f01ac0708b0 0x7f01ac0caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37824/0 (socket says 10.20.193.10:37824) 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b0d47640 1 -- 10.20.193.10:0/1791974206 learned_addr learned my addr 10.20.193.10:0/1791974206 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b1548640 1 --2- 10.20.193.10:0/1791974206 >> v2:10.20.193.10:3300/0 conn(0x7f01ac156070 0x7f01ac15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b1548640 10 monclient(hunting): get_auth_request con 0x7f01ac156070 auth_method 0 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b1548640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b1548640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b1548640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b1548640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b1548640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.080+0000 7f01b1548640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 1 -- 10.20.193.10:0/1791974206 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388397796 0 0) 0x7f01a0002920 con 0x7f01ac0708b0 2026-02-17T12:01:11.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 10 monclient(hunting): _negotiate 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 10 monclient(hunting): my global_id is 5260 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 1 -- 10.20.193.10:0/1791974206 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0194003620 con 0x7f01ac0708b0 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 1 -- 10.20.193.10:0/1791974206 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 932648314 0 0) 0x7f01ac0cbd20 con 0x7f01ac15c890 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 10 monclient(hunting): _negotiate 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 10 monclient(hunting): my global_id is 5261 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f019bfff640 1 -- 10.20.193.10:0/1791974206 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01a0002920 con 0x7f01ac15c890 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f01b1548640 10 monclient(hunting): handle_auth_done global_id 5202 payload 274 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f01b1548640 1 -- 10.20.193.10:0/1791974206 >> v1:10.20.193.153:6789/0 conn(0x7f01ac15c890 legacy=0x7f01ac0cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.087 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f01b1548640 1 -- 10.20.193.10:0/1791974206 >> v1:10.20.193.71:6789/0 conn(0x7f01ac0708b0 legacy=0x7f01ac0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f01b1548640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f01b1548640 1 monclient: found mon.noname-a 2026-02-17T12:01:11.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f01b1548640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f01b1548640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:11.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.081+0000 7f01b1548640 1 -- 10.20.193.10:0/1791974206 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ac15f650 con 0x7f01ac156070 2026-02-17T12:01:11.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.082+0000 7f01b1548640 1 --2- 10.20.193.10:0/1791974206 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac156070 0x7f01ac15c350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f019c0098a0 tx=0x7f019c02ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66145b8fecfa156 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 1 -- 10.20.193.10:0/1791974206 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c03c070 con 0x7f01ac156070 2026-02-17T12:01:11.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:11.095 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 10 monclient: dump: 2026-02-17T12:01:11.095 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.096 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f01b37d3640 5 monclient: authenticate success, global_id 5202 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 1 -- 10.20.193.10:0/1791974206 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c02fca0 con 0x7f01ac156070 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f01b37d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 1 -- 10.20.193.10:0/1791974206 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c037660 con 0x7f01ac156070 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f01b37d3640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f01b37d3640 4 set_mon_vals no callback set 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.084+0000 7f019bfff640 10 monclient: dump: 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.097 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 10 monclient: shutdown 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 -- 10.20.193.10:0/1791974206 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac156070 msgr2=0x7f01ac15c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.098 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 --2- 10.20.193.10:0/1791974206 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac156070 0x7f01ac15c350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f019c0098a0 tx=0x7f019c02ef90 comp rx=0 tx=0).stop 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 -- 10.20.193.10:0/1791974206 shutdown_connections 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 --2- 10.20.193.10:0/1791974206 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac156070 0x7f01ac15c350 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 -- 10.20.193.10:0/1791974206 >> 10.20.193.10:0/1791974206 conn(0x7f01ac0cbff0 msgr2=0x7f01ac0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 -- 10.20.193.10:0/1791974206 shutdown_connections 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 -- 10.20.193.10:0/1791974206 wait complete. 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 10 monclient: monmap: 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:11.099 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 librados: starting msgr at 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 librados: starting objecter 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 Processor -- start 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 -- start start 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 librados: setting wanted keys 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 1 librados: calling monclient init 2026-02-17T12:01:11.100 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.085+0000 7f01b37d3640 10 monclient: init 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac0708b0 0x7f01ac158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient(hunting): picked mon.noname-a con 0x7f01ac0708b0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f01ac156070 0x7f01ac1f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient(hunting): picked mon.noname-c con 0x7f01ac156070 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f01ac15c890 0x7f01ac1f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient(hunting): picked mon.noname-b con 0x7f01ac15c890 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac15fc10 con 0x7f01ac0708b0 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac156450 con 0x7f01ac15c890 2026-02-17T12:01:11.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac15fef0 con 0x7f01ac156070 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b37d3640 10 monclient(hunting): authenticate will time out at 1340.808176s 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac0708b0 0x7f01ac158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1d49640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f01ac15c890 0x7f01ac1f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac0708b0 0x7f01ac158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:44994/0 (socket says 10.20.193.10:44994) 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 1 -- 10.20.193.10:0/1002766761 learned_addr learned my addr 10.20.193.10:0/1002766761 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 10 monclient(hunting): get_auth_request con 0x7f01ac0708b0 auth_method 0 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b0d47640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f01ac156070 0x7f01ac1f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1d49640 10 monclient(hunting): get_auth_request con 0x7f01ac15c890 auth_method 0 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1d49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1d49640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1d49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b1548640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b0d47640 10 monclient(hunting): get_auth_request con 0x7f01ac156070 auth_method 0 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b0d47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b0d47640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.086+0000 7f01b0d47640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.087+0000 7f01b1d49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.087+0000 7f01b1d49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.087+0000 7f01b1d49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.087+0000 7f01b0d47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.087+0000 7f01b0d47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.087+0000 7f01b0d47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 10 monclient(hunting): handle_auth_done global_id 5205 payload 824 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 1 -- 10.20.193.10:0/1002766761 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f01ac156070 msgr2=0x7f01ac1f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f01ac156070 0x7f01ac1f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 1 -- 10.20.193.10:0/1002766761 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f01ac15c890 msgr2=0x7f01ac1f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f01ac15c890 0x7f01ac1f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 1 monclient: found mon.noname-a 2026-02-17T12:01:11.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.088+0000 7f01b1548640 1 -- 10.20.193.10:0/1002766761 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ac1f4ed0 con 0x7f01ac0708b0 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.089+0000 7f01b1548640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac0708b0 0x7f01ac158b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f019c016f60 tx=0x7f019c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.089+0000 7f0199ffb640 10 client.?.objecter ms_handle_connect 0x7f01ac0708b0 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.089+0000 7f0199ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 1 -- 10.20.193.10:0/1002766761 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c03c040 con 0x7f01ac0708b0 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 10 monclient: dump: 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.105 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 1 -- 10.20.193.10:0/1002766761 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c02fe50 con 0x7f01ac0708b0 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 5 monclient: authenticate success, global_id 5205 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 1 -- 10.20.193.10:0/1002766761 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c042450 con 0x7f01ac0708b0 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f019b7fe640 4 set_mon_vals no callback set 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f0199ffb640 10 monclient: dump: 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.107 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 10 monclient: _renew_subs 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ac1f4000 con 0x7f01ac0708b0 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 10 client.5205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 10 monclient: _renew_subs 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ac1f45c0 con 0x7f01ac0708b0 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 1 librados: init done 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 10 client.5205.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 15 client.5205.objecter _session_command_op_assign -1 1 2026-02-17T12:01:11.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 20 client.5205.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:11.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 10 client.5205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:11.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:11.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.091+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01ac1601d0 con 0x7f01ac0708b0 2026-02-17T12:01:11.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.103+0000 7f0199ffb640 1 -- 10.20.193.10:0/1002766761 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f019c0425f0 con 0x7f01ac0708b0 2026-02-17T12:01:11.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.103+0000 7f0199ffb640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f017c078e50 0x7f017c07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.103+0000 7f01b0d47640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f017c078e50 0x7f017c07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.103+0000 7f01b0d47640 10 monclient: get_auth_request con 0x7f017c078e50 auth_method 0 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.103+0000 7f0199ffb640 10 client.5205.objecter ms_handle_connect 0x7f017c078e50 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.103+0000 7f01b0d47640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f017c078e50 0x7f017c07b310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f01ac15f580 tx=0x7f01a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 1 -- 10.20.193.10:0/1002766761 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f019c083200 con 0x7f01ac0708b0 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 10 client.5205.objecter ms_dispatch2 0x7f01ac000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 3 client.5205.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 3 client.5205.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 10 client.5205.objecter checking command 1 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f017c081330 0x7f017c083750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 20 client.5205.objecter _get_session s=0x7f017c080c60 osd=14 3 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 20 client.5205.objecter put_session s=0x7f017c080c60 osd=14 3 2026-02-17T12:01:11.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 15 client.5205.objecter _session_command_op_remove -1 1 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 20 client.5205.objecter _get_session s=0x7f017c080c60 osd=14 3 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 20 client.5205.objecter get_session s=0x7f017c080c60 osd=14 3 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 15 client.5205.objecter _session_command_op_assign 14 1 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 20 client.5205.objecter put_session s=0x7f017c080c60 osd=14 4 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 10 client.5205.objecter _send_command 1 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 1 -- 10.20.193.10:0/1002766761 --> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f019c04ee80 con 0x7f017c081330 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.105+0000 7f0199ffb640 20 client.5205.objecter dump_active .. 0 homeless 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.106+0000 7f01b1d49640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f017c081330 0x7f017c083750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.106+0000 7f0199ffb640 1 -- 10.20.193.10:0/1002766761 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f019c0835c0 con 0x7f01ac0708b0 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.106+0000 7f0199ffb640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.106+0000 7f01b1d49640 10 monclient: get_auth_request con 0x7f017c081330 auth_method 0 2026-02-17T12:01:11.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.107+0000 7f01b1d49640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f017c081330 0x7f017c083750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.107+0000 7f0199ffb640 10 client.5205.objecter ms_handle_connect 0x7f017c081330 2026-02-17T12:01:11.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.118+0000 7f0199ffb640 1 -- 10.20.193.10:0/1002766761 <== osd.14 v2:10.20.193.153:6808/3794015163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f019c04ee80 con 0x7f017c081330 2026-02-17T12:01:11.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.118+0000 7f0199ffb640 10 client.5205.objecter ms_dispatch2 0x7f01ac000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:11.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.118+0000 7f0199ffb640 10 client.5205.objecter _finish_command 1 = system:0 2026-02-17T12:01:11.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.118+0000 7f0199ffb640 20 client.5205.objecter put_session s=0x7f017c080c60 osd=14 4 2026-02-17T12:01:11.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.118+0000 7f0199ffb640 15 client.5205.objecter _session_command_op_remove 14 1 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 10 client.5205.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 15 client.5205.objecter _session_command_op_assign -1 2 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 20 client.5205.objecter _get_session s=0x7f017c080c60 osd=14 3 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 20 client.5205.objecter put_session s=0x7f017c080c60 osd=14 3 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 20 client.5205.objecter _get_session s=0x7f017c080c60 osd=14 3 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 15 client.5205.objecter _session_command_op_remove -1 2 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 20 client.5205.objecter get_session s=0x7f017c080c60 osd=14 3 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 15 client.5205.objecter _session_command_op_assign 14 2 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 20 client.5205.objecter put_session s=0x7f017c080c60 osd=14 4 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 10 client.5205.objecter _send_command 2 2026-02-17T12:01:11.125 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.123+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 --> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f01ac159740 con 0x7f017c081330 2026-02-17T12:01:11.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.131+0000 7f0199ffb640 1 -- 10.20.193.10:0/1002766761 <== osd.14 v2:10.20.193.153:6808/3794015163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f01ac159740 con 0x7f017c081330 2026-02-17T12:01:11.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.131+0000 7f0199ffb640 10 client.5205.objecter ms_dispatch2 0x7f01ac000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:11.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f0199ffb640 10 client.5205.objecter _finish_command 2 = system:0 2026-02-17T12:01:11.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f0199ffb640 20 client.5205.objecter put_session s=0x7f017c080c60 osd=14 4 2026-02-17T12:01:11.133 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f0199ffb640 15 client.5205.objecter _session_command_op_remove 14 2 2026-02-17T12:01:11.133 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:11.133 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:11.133 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 10 librados: watch_flush enter 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 10 librados: watch_flush exit 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 10 client.5205.objecter close_session for osd.14 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f017c081330 msgr2=0x7f017c083750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.153:6808/3794015163,v1:10.20.193.153:6809/3794015163] conn(0x7f017c081330 0x7f017c083750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 20 client.5205.objecter put_session s=0x7f017c080c60 osd=14 1 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 20 client.5205.objecter shutdown clearing up homeless session... 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 10 client.5205.objecter successfully canceled tick 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f017c078e50 msgr2=0x7f017c07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f017c078e50 0x7f017c07b310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f01ac15f580 tx=0x7f01a0009040 comp rx=0 tx=0).stop 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 10 monclient: shutdown 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac0708b0 msgr2=0x7f01ac158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 --2- 10.20.193.10:0/1002766761 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f01ac0708b0 0x7f01ac158b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f019c016f60 tx=0x7f019c0047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b1d49640 1 -- 10.20.193.10:0/1002766761 reap_dead start 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 shutdown_connections 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 >> 10.20.193.10:0/1002766761 conn(0x7f01ac0cbff0 msgr2=0x7f01ac06b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 shutdown_connections 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 -- 10.20.193.10:0/1002766761 wait complete. 2026-02-17T12:01:11.134 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.132+0000 7f01b37d3640 1 librados: shutdown 2026-02-17T12:01:11.141 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-17T12:01:11.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.207+0000 7f56014f5640 10 monclient: get_monmap_and_config 2026-02-17T12:01:11.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.207+0000 7f56014f5640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.209 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.207+0000 7f56014f5640 10 monclient: monmap: 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:11.208391+0000 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:11.208391+0000 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:11.210 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:11.211 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.207+0000 7f56014f5640 1 Processor -- start 2026-02-17T12:01:11.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.207+0000 7f56014f5640 1 -- start start 2026-02-17T12:01:11.211 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.207+0000 7f56014f5640 10 monclient: init 2026-02-17T12:01:11.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.218 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient: _add_conns ranks=[3,4,5,0,1,2] 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f55fc153600 0x7f55fc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient(hunting): picked mon.noname-a con 0x7f55fc153600 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f55fc0ca760 0x7f55fc0c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient(hunting): picked mon.noname-b con 0x7f55fc0ca760 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f55fc1539e0 0x7f55fc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient(hunting): picked mon.noname-c con 0x7f55fc1539e0 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f55fc15a6a0 con 0x7f55fc153600 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f55fc0c7ad0 con 0x7f55fc0ca760 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f55fc0c7db0 con 0x7f55fc1539e0 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f56014f5640 10 monclient(hunting): authenticate will time out at 1340.930170s 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fb7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f55fc0ca760 0x7f55fc0c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fbfff640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f55fc153600 0x7f55fc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f5600cf4640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f55fc1539e0 0x7f55fc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fb7fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f55fc0ca760 0x7f55fc0c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59712/0 (socket says 10.20.193.10:59712) 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fb7fe640 1 -- 10.20.193.10:0/3449194148 learned_addr learned my addr 10.20.193.10:0/3449194148 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fb7fe640 10 monclient(hunting): get_auth_request con 0x7f55fc0ca760 auth_method 0 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fbfff640 10 monclient(hunting): get_auth_request con 0x7f55fc153600 auth_method 0 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f55fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f5600cf4640 10 monclient(hunting): get_auth_request con 0x7f55fc1539e0 auth_method 0 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f5600cf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f5600cf4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.208+0000 7f5600cf4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f5600cf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f5600cf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f5600cf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 10 monclient(hunting): handle_auth_done global_id 5266 payload 274 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 1 -- 10.20.193.10:0/3449194148 >> v2:10.20.193.153:3300/0 conn(0x7f55fc1539e0 msgr2=0x7f55fc0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 1 --2- 10.20.193.10:0/3449194148 >> v2:10.20.193.153:3300/0 conn(0x7f55fc1539e0 0x7f55fc0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 1 -- 10.20.193.10:0/3449194148 >> v2:10.20.193.10:3300/0 conn(0x7f55fc153600 msgr2=0x7f55fc0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 1 --2- 10.20.193.10:0/3449194148 >> v2:10.20.193.10:3300/0 conn(0x7f55fc153600 0x7f55fc0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 1 monclient: found mon.noname-b 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.209+0000 7f55fb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.210+0000 7f55fb7fe640 1 -- 10.20.193.10:0/3449194148 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc0c8090 con 0x7f55fc0ca760 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.210+0000 7f55fb7fe640 1 --2- 10.20.193.10:0/3449194148 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc0ca760 0x7f55fc0c4550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f55fc06cc10 tx=0x7f55ec02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27baa59ffeb56c4d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 1 -- 10.20.193.10:0/3449194148 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec03c070 con 0x7f55fc0ca760 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 10 monclient: dump: 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.223 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 1 -- 10.20.193.10:0/3449194148 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ec02fb50 con 0x7f55fc0ca760 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 1 -- 10.20.193.10:0/3449194148 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec037440 con 0x7f55fc0ca760 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:11.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f55faffd640 10 monclient: dump: 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f56014f5640 5 monclient: authenticate success, global_id 5266 2026-02-17T12:01:11.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f56014f5640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.212+0000 7f56014f5640 4 set_mon_vals no callback set 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 10 monclient: shutdown 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 -- 10.20.193.10:0/3449194148 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc0ca760 msgr2=0x7f55fc0c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 --2- 10.20.193.10:0/3449194148 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc0ca760 0x7f55fc0c4550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f55fc06cc10 tx=0x7f55ec02ee90 comp rx=0 tx=0).stop 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 -- 10.20.193.10:0/3449194148 shutdown_connections 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 --2- 10.20.193.10:0/3449194148 >> v2:10.20.193.153:3300/0 conn(0x7f55fc1539e0 0x7f55fc0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 --2- 10.20.193.10:0/3449194148 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc0ca760 0x7f55fc0c4550 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 --2- 10.20.193.10:0/3449194148 >> v2:10.20.193.10:3300/0 conn(0x7f55fc153600 0x7f55fc0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 -- 10.20.193.10:0/3449194148 >> 10.20.193.10:0/3449194148 conn(0x7f55fc0c9bd0 msgr2=0x7f55fc0c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 -- 10.20.193.10:0/3449194148 shutdown_connections 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 -- 10.20.193.10:0/3449194148 wait complete. 2026-02-17T12:01:11.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 10 monclient: monmap: 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 librados: starting msgr at 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 librados: starting objecter 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 Processor -- start 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 -- start start 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 librados: setting wanted keys 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 1 librados: calling monclient init 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.213+0000 7f56014f5640 10 monclient: init 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f55fc0ca760 0x7f55fc158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient(hunting): picked mon.noname-a con 0x7f55fc0ca760 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55fc153600 0x7f55fc0bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient(hunting): picked mon.noname-c con 0x7f55fc153600 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc1539e0 0x7f55fc14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient(hunting): picked mon.noname-b con 0x7f55fc1539e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc0c8930 con 0x7f55fc0ca760 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc0c8650 con 0x7f55fc1539e0 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc15ad00 con 0x7f55fc153600 2026-02-17T12:01:11.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f56014f5640 10 monclient(hunting): authenticate will time out at 1340.936468s 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f55fbfff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f55fc0ca760 0x7f55fc158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f5600cf4640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc1539e0 0x7f55fc14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f55fb7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55fc153600 0x7f55fc0bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f5600cf4640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc1539e0 0x7f55fc14ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59722/0 (socket says 10.20.193.10:59722) 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f5600cf4640 1 -- 10.20.193.10:0/1152494733 learned_addr learned my addr 10.20.193.10:0/1152494733 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f55fbfff640 10 monclient(hunting): get_auth_request con 0x7f55fc0ca760 auth_method 0 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f55fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f55fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f55fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f5600cf4640 10 monclient(hunting): get_auth_request con 0x7f55fc1539e0 auth_method 0 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f5600cf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f5600cf4640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f5600cf4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.214+0000 7f55fb7fe640 10 monclient(hunting): get_auth_request con 0x7f55fc153600 auth_method 0 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f55fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f55fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f55fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f5600cf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f5600cf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f5600cf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f55fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f55fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.231 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f55fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f55fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f55fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.215+0000 7f55fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 10 monclient(hunting): handle_auth_done global_id 5269 payload 824 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 1 -- 10.20.193.10:0/1152494733 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55fc153600 msgr2=0x7f55fc0bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55fc153600 0x7f55fc0bfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 1 -- 10.20.193.10:0/1152494733 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f55fc0ca760 msgr2=0x7f55fc158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f55fc0ca760 0x7f55fc158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 1 monclient: found mon.noname-b 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.216+0000 7f5600cf4640 1 -- 10.20.193.10:0/1152494733 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc158910 con 0x7f55fc1539e0 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.217+0000 7f5600cf4640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc1539e0 0x7f55fc14ad10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55f000efc0 tx=0x7f55f000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.217+0000 7f55f8ff9640 10 client.?.objecter ms_handle_connect 0x7f55fc1539e0 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.217+0000 7f55f8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 1 -- 10.20.193.10:0/1152494733 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0018020 con 0x7f55fc1539e0 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 10 monclient: dump: 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.236 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.237 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 1 -- 10.20.193.10:0/1152494733 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f0014480 con 0x7f55fc1539e0 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 5 monclient: authenticate success, global_id 5269 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 10 monclient: _renew_subs 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc0726b0 con 0x7f55fc1539e0 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 1 -- 10.20.193.10:0/1152494733 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0014870 con 0x7f55fc1539e0 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55fa7fc640 4 set_mon_vals no callback set 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f55f8ff9640 10 monclient: dump: 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.238 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 10 client.5269.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 10 monclient: _renew_subs 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc072c70 con 0x7f55fc1539e0 2026-02-17T12:01:11.239 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 1 librados: init done 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.219+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55fc0c8e50 con 0x7f55fc1539e0 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.231+0000 7f55f8ff9640 1 -- 10.20.193.10:0/1152494733 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f55f0014a10 con 0x7f55fc1539e0 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.231+0000 7f55f8ff9640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f55cc078e50 0x7f55cc07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.231+0000 7f55fbfff640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f55cc078e50 0x7f55cc07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.231+0000 7f55fbfff640 10 monclient: get_auth_request con 0x7f55cc078e50 auth_method 0 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.231+0000 7f55fbfff640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f55cc078e50 0x7f55cc07b310 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009ba0 tx=0x7f55e8009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.231+0000 7f55f8ff9640 10 client.5269.objecter ms_handle_connect 0x7f55cc078e50 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.233+0000 7f55f8ff9640 1 -- 10.20.193.10:0/1152494733 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f55f005ed10 con 0x7f55fc1539e0 2026-02-17T12:01:11.240 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.233+0000 7f55f8ff9640 10 client.5269.objecter ms_dispatch2 0x7f55fc000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:11.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.233+0000 7f55f8ff9640 3 client.5269.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:11.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.233+0000 7f55f8ff9640 3 client.5269.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:11.241 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.233+0000 7f55f8ff9640 20 client.5269.objecter dump_active .. 0 homeless 2026-02-17T12:01:11.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.335+0000 7f55f8ff9640 1 -- 10.20.193.10:0/1152494733 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f55f0022070 con 0x7f55fc1539e0 2026-02-17T12:01:11.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.335+0000 7f55f8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:11.337 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.335+0000 7f55f8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:11.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.416+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7f55fc15ba40 con 0x7f55cc078e50 2026-02-17T12:01:11.418 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f55f8ff9640 1 -- 10.20.193.10:0/1152494733 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f55fc15ba40 con 0x7f55cc078e50 2026-02-17T12:01:11.418 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 14 to deep-scrub 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 10 librados: watch_flush enter 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 10 librados: watch_flush exit 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 20 client.5269.objecter shutdown clearing up homeless session... 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 10 client.5269.objecter successfully canceled tick 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f55cc078e50 msgr2=0x7f55cc07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f55cc078e50 0x7f55cc07b310 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009ba0 tx=0x7f55e8009290 comp rx=0 tx=0).stop 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 10 monclient: shutdown 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc1539e0 msgr2=0x7f55fc14ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.417+0000 7f56014f5640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc1539e0 0x7f55fc14ad10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55f000efc0 tx=0x7f55f000c490 comp rx=0 tx=0).stop 2026-02-17T12:01:11.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.418+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 shutdown_connections 2026-02-17T12:01:11.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.418+0000 7f56014f5640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f55cc078e50 0x7f55cc07b310 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.418+0000 7f56014f5640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f55fc1539e0 0x7f55fc14ad10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.418+0000 7f56014f5640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55fc153600 0x7f55fc0bfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.418+0000 7f56014f5640 1 --2- 10.20.193.10:0/1152494733 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f55fc0ca760 0x7f55fc158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.418+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 >> 10.20.193.10:0/1152494733 conn(0x7f55fc0c9bd0 msgr2=0x7f55fc151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.418+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 shutdown_connections 2026-02-17T12:01:11.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.418+0000 7f56014f5640 1 -- 10.20.193.10:0/1152494733 wait complete. 2026-02-17T12:01:11.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.418+0000 7f56014f5640 1 librados: shutdown 2026-02-17T12:01:11.427 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T12:01:11.427 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:11.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.494+0000 7f233a161640 10 monclient: get_monmap_and_config 2026-02-17T12:01:11.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.494+0000 7f233a161640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.497 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.494+0000 7f233a161640 10 monclient: monmap: 2026-02-17T12:01:11.497 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.497 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:11.496112+0000 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:11.496112+0000 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.498 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 1 Processor -- start 2026-02-17T12:01:11.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 1 -- start start 2026-02-17T12:01:11.499 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 10 monclient: init 2026-02-17T12:01:11.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 10 monclient: _add_conns ranks=[4,2,1,3,0,5] 2026-02-17T12:01:11.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f2334150300 0x7f233406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 10 monclient(hunting): picked mon.noname-b con 0x7f2334150300 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:11.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f23341506e0 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:11.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2334070340 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:11.501 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23340c55e0 con 0x7f2334070340 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23340c5300 con 0x7f23341506e0 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2334159c80 con 0x7f2334150300 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.495+0000 7f233a161640 10 monclient(hunting): authenticate will time out at 1341.217840s 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.496+0000 7f23337fe640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f2334150300 0x7f233406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.496+0000 7f2332ffd640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7f23341506e0 0x7f233415d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:57538/0 (socket says 10.20.193.10:57538) 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.496+0000 7f2332ffd640 1 -- 10.20.193.10:0/3831073794 learned_addr learned my addr 10.20.193.10:0/3831073794 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.496+0000 7f23337fe640 10 monclient(hunting): get_auth_request con 0x7f2334150300 auth_method 0 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.496+0000 7f23337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.496+0000 7f23337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.502 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.496+0000 7f23337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.497+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.497+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.497+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.497+0000 7f23327fc640 1 -- 10.20.193.10:0/3831073794 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154981090 0 0) 0x7f23340c5300 con 0x7f23341506e0 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.497+0000 7f23327fc640 10 monclient(hunting): _negotiate 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.497+0000 7f23327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.497+0000 7f23327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.497+0000 7f23327fc640 10 monclient(hunting): my global_id is 5273 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.497+0000 7f23327fc640 1 -- 10.20.193.10:0/3831073794 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2318003620 con 0x7f23341506e0 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.498+0000 7f23337fe640 10 monclient(hunting): handle_auth_done global_id 5272 payload 274 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.498+0000 7f23337fe640 1 -- 10.20.193.10:0/3831073794 >> v1:10.20.193.153:6789/0 conn(0x7f23341506e0 legacy=0x7f233415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.498+0000 7f23337fe640 1 -- 10.20.193.10:0/3831073794 >> v1:10.20.193.71:6789/0 conn(0x7f2334070340 legacy=0x7f23340c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.498+0000 7f23337fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.498+0000 7f23337fe640 1 monclient: found mon.noname-b 2026-02-17T12:01:11.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.498+0000 7f23337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.498+0000 7f23337fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.498+0000 7f23337fe640 1 -- 10.20.193.10:0/3831073794 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2334159f60 con 0x7f2334150300 2026-02-17T12:01:11.504 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.501+0000 7f23337fe640 1 --2- 10.20.193.10:0/3831073794 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334150300 0x7f233406fe00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f23200098a0 tx=0x7f232002ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6f4ee62f8ccfe99 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 1 -- 10.20.193.10:0/3831073794 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232003c070 con 0x7f2334150300 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 10 monclient: dump: 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.510 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 1 -- 10.20.193.10:0/3831073794 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232002fc10 con 0x7f2334150300 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 1 -- 10.20.193.10:0/3831073794 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320037440 con 0x7f2334150300 2026-02-17T12:01:11.511 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 5 monclient: authenticate success, global_id 5272 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 4 set_mon_vals no callback set 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f23327fc640 10 monclient: dump: 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.512 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 10 monclient: shutdown 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 1 -- 10.20.193.10:0/3831073794 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334150300 msgr2=0x7f233406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 1 --2- 10.20.193.10:0/3831073794 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334150300 0x7f233406fe00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f23200098a0 tx=0x7f232002ef00 comp rx=0 tx=0).stop 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 1 -- 10.20.193.10:0/3831073794 shutdown_connections 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 1 --2- 10.20.193.10:0/3831073794 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334150300 0x7f233406fe00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 1 -- 10.20.193.10:0/3831073794 >> 10.20.193.10:0/3831073794 conn(0x7f23340cd560 msgr2=0x7f23340cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 1 -- 10.20.193.10:0/3831073794 shutdown_connections 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.503+0000 7f233a161640 1 -- 10.20.193.10:0/3831073794 wait complete. 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 10 monclient: monmap: 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:11.514 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 1 librados: starting msgr at 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 1 librados: starting objecter 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 1 Processor -- start 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 1 -- start start 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 1 librados: setting wanted keys 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 1 librados: calling monclient init 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 10 monclient: init 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334070340 0x7f23341f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 10 monclient(hunting): picked mon.noname-b con 0x7f2334070340 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.504+0000 7f233a161640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2334150300 0x7f2334158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 10 monclient(hunting): picked mon.noname-c con 0x7f2334150300 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23341506e0 0x7f233415c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 10 monclient(hunting): picked mon.noname-a con 0x7f23341506e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f233415d770 con 0x7f23341506e0 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f233415a520 con 0x7f2334070340 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f233415d8f0 con 0x7f2334150300 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f233a161640 10 monclient(hunting): authenticate will time out at 1341.227022s 2026-02-17T12:01:11.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2333fff640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23341506e0 0x7f233415c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334070340 0x7f23341f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2332ffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2334150300 0x7f2334158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334070340 0x7f23341f7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59732/0 (socket says 10.20.193.10:59732) 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 1 -- 10.20.193.10:0/300490561 learned_addr learned my addr 10.20.193.10:0/300490561 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 10 monclient(hunting): get_auth_request con 0x7f2334070340 auth_method 0 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2333fff640 10 monclient(hunting): get_auth_request con 0x7f23341506e0 auth_method 0 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2333fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2333fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f23337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2332ffd640 10 monclient(hunting): get_auth_request con 0x7f2334150300 auth_method 0 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2332ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2332ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2332ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2333fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2333fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.505+0000 7f2333fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.506+0000 7f2332ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.506+0000 7f2332ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.506+0000 7f2332ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 10 monclient(hunting): handle_auth_done global_id 5278 payload 824 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 1 -- 10.20.193.10:0/300490561 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2334150300 msgr2=0x7f2334158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2334150300 0x7f2334158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 1 -- 10.20.193.10:0/300490561 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23341506e0 msgr2=0x7f233415c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f23341506e0 0x7f233415c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 1 monclient: found mon.noname-b 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.507+0000 7f23337fe640 1 -- 10.20.193.10:0/300490561 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23340726b0 con 0x7f2334070340 2026-02-17T12:01:11.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.508+0000 7f23337fe640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334070340 0x7f23341f7930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2320009130 tx=0x7f23200047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.508+0000 7f230ffff640 10 client.?.objecter ms_handle_connect 0x7f2334070340 2026-02-17T12:01:11.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.508+0000 7f230ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 1 -- 10.20.193.10:0/300490561 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232003c040 con 0x7f2334070340 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 10 monclient: dump: 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.522 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 5 monclient: authenticate success, global_id 5278 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 10 monclient: _renew_subs 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2334072990 con 0x7f2334070340 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 10 client.5278.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 10 monclient: _renew_subs 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2334072f50 con 0x7f2334070340 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 1 librados: init done 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 10 client.5278.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 15 client.5278.objecter _session_command_op_assign -1 1 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 20 client.5278.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 10 client.5278.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2334072460 con 0x7f2334070340 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 1 -- 10.20.193.10:0/300490561 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2334072460 con 0x7f2334070340 2026-02-17T12:01:11.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 1 -- 10.20.193.10:0/300490561 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320042610 con 0x7f2334070340 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f230ffff640 10 monclient: dump: 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.525 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.526 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.526 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.509+0000 7f2331ffb640 4 set_mon_vals no callback set 2026-02-17T12:01:11.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.522+0000 7f230ffff640 1 -- 10.20.193.10:0/300490561 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f23200427b0 con 0x7f2334070340 2026-02-17T12:01:11.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.523+0000 7f230ffff640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2304078e30 0x7f230407b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.523+0000 7f2332ffd640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2304078e30 0x7f230407b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.523+0000 7f2332ffd640 10 monclient: get_auth_request con 0x7f2304078e30 auth_method 0 2026-02-17T12:01:11.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.523+0000 7f230ffff640 10 client.5278.objecter ms_handle_connect 0x7f2304078e30 2026-02-17T12:01:11.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.523+0000 7f2332ffd640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2304078e30 0x7f230407b2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f233406f3c0 tx=0x7f2324007dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 1 -- 10.20.193.10:0/300490561 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f23200bc030 con 0x7f2334070340 2026-02-17T12:01:11.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 10 client.5278.objecter ms_dispatch2 0x7f2334000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 3 client.5278.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 3 client.5278.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 10 client.5278.objecter checking command 1 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f2304081310 0x7f2304083730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 20 client.5278.objecter _get_session s=0x7f2304080c40 osd=3 3 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 20 client.5278.objecter put_session s=0x7f2304080c40 osd=3 3 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 15 client.5278.objecter _session_command_op_remove -1 1 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 20 client.5278.objecter _get_session s=0x7f2304080c40 osd=3 3 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 20 client.5278.objecter get_session s=0x7f2304080c40 osd=3 3 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 15 client.5278.objecter _session_command_op_assign 3 1 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 20 client.5278.objecter put_session s=0x7f2304080c40 osd=3 4 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 10 client.5278.objecter _send_command 1 2026-02-17T12:01:11.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 1 -- 10.20.193.10:0/300490561 --> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2320043e50 con 0x7f2304081310 2026-02-17T12:01:11.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 20 client.5278.objecter dump_active .. 0 homeless 2026-02-17T12:01:11.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 1 -- 10.20.193.10:0/300490561 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2320082c90 con 0x7f2334070340 2026-02-17T12:01:11.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.524+0000 7f230ffff640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:11.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.525+0000 7f2333fff640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f2304081310 0x7f2304083730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.525+0000 7f2333fff640 10 monclient: get_auth_request con 0x7f2304081310 auth_method 0 2026-02-17T12:01:11.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.527+0000 7f2333fff640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f2304081310 0x7f2304083730 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.527+0000 7f230ffff640 10 client.5278.objecter ms_handle_connect 0x7f2304081310 2026-02-17T12:01:11.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.538+0000 7f230ffff640 1 -- 10.20.193.10:0/300490561 <== osd.3 v2:10.20.193.174:6816/2117394394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f2320043e50 con 0x7f2304081310 2026-02-17T12:01:11.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.538+0000 7f230ffff640 10 client.5278.objecter ms_dispatch2 0x7f2334000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:11.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.538+0000 7f230ffff640 10 client.5278.objecter _finish_command 1 = system:0 2026-02-17T12:01:11.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.538+0000 7f230ffff640 20 client.5278.objecter put_session s=0x7f2304080c40 osd=3 4 2026-02-17T12:01:11.539 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.538+0000 7f230ffff640 15 client.5278.objecter _session_command_op_remove 3 1 2026-02-17T12:01:11.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 10 client.5278.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:11.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 15 client.5278.objecter _session_command_op_assign -1 2 2026-02-17T12:01:11.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 20 client.5278.objecter _get_session s=0x7f2304080c40 osd=3 3 2026-02-17T12:01:11.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 20 client.5278.objecter put_session s=0x7f2304080c40 osd=3 3 2026-02-17T12:01:11.545 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 20 client.5278.objecter _get_session s=0x7f2304080c40 osd=3 3 2026-02-17T12:01:11.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 15 client.5278.objecter _session_command_op_remove -1 2 2026-02-17T12:01:11.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 20 client.5278.objecter get_session s=0x7f2304080c40 osd=3 3 2026-02-17T12:01:11.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 15 client.5278.objecter _session_command_op_assign 3 2 2026-02-17T12:01:11.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 20 client.5278.objecter put_session s=0x7f2304080c40 osd=3 4 2026-02-17T12:01:11.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 10 client.5278.objecter _send_command 2 2026-02-17T12:01:11.546 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.543+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 --> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f233406fe00 con 0x7f2304081310 2026-02-17T12:01:11.552 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f230ffff640 1 -- 10.20.193.10:0/300490561 <== osd.3 v2:10.20.193.174:6816/2117394394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f233406fe00 con 0x7f2304081310 2026-02-17T12:01:11.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f230ffff640 10 client.5278.objecter ms_dispatch2 0x7f2334000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:11.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f230ffff640 10 client.5278.objecter _finish_command 2 = system:0 2026-02-17T12:01:11.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f230ffff640 20 client.5278.objecter put_session s=0x7f2304080c40 osd=3 4 2026-02-17T12:01:11.553 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f230ffff640 15 client.5278.objecter _session_command_op_remove 3 2 2026-02-17T12:01:11.553 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:11.553 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:11.553 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:11.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 10 librados: watch_flush enter 2026-02-17T12:01:11.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 10 librados: watch_flush exit 2026-02-17T12:01:11.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 10 client.5278.objecter close_session for osd.3 2026-02-17T12:01:11.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f2304081310 msgr2=0x7f2304083730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.174:6816/2117394394,v1:10.20.193.174:6817/2117394394] conn(0x7f2304081310 0x7f2304083730 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 20 client.5278.objecter put_session s=0x7f2304080c40 osd=3 1 2026-02-17T12:01:11.555 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 20 client.5278.objecter shutdown clearing up homeless session... 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 10 client.5278.objecter successfully canceled tick 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2304078e30 msgr2=0x7f230407b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f2304078e30 0x7f230407b2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f233406f3c0 tx=0x7f2324007dd0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 10 monclient: shutdown 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334070340 msgr2=0x7f23341f7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 --2- 10.20.193.10:0/300490561 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f2334070340 0x7f23341f7930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2320009130 tx=0x7f23200047c0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f2333fff640 1 -- 10.20.193.10:0/300490561 reap_dead start 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 shutdown_connections 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 >> 10.20.193.10:0/300490561 conn(0x7f23340cd560 msgr2=0x7f233406d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 shutdown_connections 2026-02-17T12:01:11.556 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 -- 10.20.193.10:0/300490561 wait complete. 2026-02-17T12:01:11.557 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.551+0000 7f233a161640 1 librados: shutdown 2026-02-17T12:01:11.561 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T12:01:11.628 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 10 monclient: get_monmap_and_config 2026-02-17T12:01:11.628 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.628 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 10 monclient: monmap: 2026-02-17T12:01:11.628 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.628 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.628 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:11.628269+0000 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:11.628269+0000 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:11.629 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 1 Processor -- start 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 1 -- start start 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 10 monclient: init 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 10 monclient: _add_conns ranks=[5,4,0,1,3,2] 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f759815d220 0x7f759815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 10 monclient(hunting): picked mon.noname-c con 0x7f759815d220 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f7598074920 0x7f75980c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.627+0000 7f759f9f7640 10 monclient(hunting): picked mon.noname-b con 0x7f7598074920 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759f9f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f75980c9120 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759f9f7640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75980c95b0 con 0x7f75980c9120 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759f9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759f9f7640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f75980c58a0 con 0x7f7598074920 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759f9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759f9f7640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f75980c55c0 con 0x7f759815d220 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759f9f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759f9f7640 10 monclient(hunting): authenticate will time out at 1341.350018s 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759cf6b640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f7598074920 0x7f75980c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759d76c640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f759815d220 0x7f759815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.630 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759df6d640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f75980c9120 0x7f7598153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44902/0 (socket says 10.20.193.10:44902) 2026-02-17T12:01:11.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759df6d640 1 -- 10.20.193.10:0/2205659223 learned_addr learned my addr 10.20.193.10:0/2205659223 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:11.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759cf6b640 10 monclient(hunting): get_auth_request con 0x7f7598074920 auth_method 0 2026-02-17T12:01:11.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759cf6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759cf6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759cf6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.631 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759d76c640 10 monclient(hunting): get_auth_request con 0x7f759815d220 auth_method 0 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759d76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759d76c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759d76c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759d76c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759d76c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759d76c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759cf6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.628+0000 7f759cf6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759cf6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759d76c640 10 monclient(hunting): handle_auth_done global_id 5279 payload 274 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759d76c640 1 -- 10.20.193.10:0/2205659223 >> v2:10.20.193.71:3300/0 conn(0x7f7598074920 msgr2=0x7f75980c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759d76c640 1 --2- 10.20.193.10:0/2205659223 >> v2:10.20.193.71:3300/0 conn(0x7f7598074920 0x7f75980c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759d76c640 1 -- 10.20.193.10:0/2205659223 >> v1:10.20.193.10:6789/0 conn(0x7f75980c9120 legacy=0x7f7598153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759d76c640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759d76c640 1 monclient: found mon.noname-c 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759d76c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759d76c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.629+0000 7f759d76c640 1 -- 10.20.193.10:0/2205659223 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75980c7e20 con 0x7f759815d220 2026-02-17T12:01:11.632 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.630+0000 7f759d76c640 1 --2- 10.20.193.10:0/2205659223 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 0x7f759815d600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f75880098a0 tx=0x7f758802ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eebc0a423b9e8418 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 1 -- 10.20.193.10:0/2205659223 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758803c070 con 0x7f759815d220 2026-02-17T12:01:11.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.634 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 10 monclient: dump: 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 5 monclient: authenticate success, global_id 5279 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 1 -- 10.20.193.10:0/2205659223 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758802fae0 con 0x7f759815d220 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 1 -- 10.20.193.10:0/2205659223 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588037440 con 0x7f759815d220 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 4 set_mon_vals no callback set 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f7587fff640 10 monclient: dump: 2026-02-17T12:01:11.635 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 10 monclient: shutdown 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 1 -- 10.20.193.10:0/2205659223 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 msgr2=0x7f759815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 1 --2- 10.20.193.10:0/2205659223 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 0x7f759815d600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f75880098a0 tx=0x7f758802ee10 comp rx=0 tx=0).stop 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 1 -- 10.20.193.10:0/2205659223 shutdown_connections 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 1 --2- 10.20.193.10:0/2205659223 >> v2:10.20.193.71:3300/0 conn(0x7f7598074920 0x7f75980c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 1 --2- 10.20.193.10:0/2205659223 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 0x7f759815d600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 1 -- 10.20.193.10:0/2205659223 >> 10.20.193.10:0/2205659223 conn(0x7f75980c9d80 msgr2=0x7f75980ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 1 -- 10.20.193.10:0/2205659223 shutdown_connections 2026-02-17T12:01:11.636 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.632+0000 7f759f9f7640 1 -- 10.20.193.10:0/2205659223 wait complete. 2026-02-17T12:01:11.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.633+0000 7f759f9f7640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.638 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.633+0000 7f759f9f7640 10 monclient: monmap: 2026-02-17T12:01:11.638 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.638 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:11.638 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:11.638 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:11.638 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.638 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.638 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.633+0000 7f759f9f7640 1 librados: starting msgr at 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.633+0000 7f759f9f7640 1 librados: starting objecter 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.633+0000 7f759f9f7640 1 Processor -- start 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 1 -- start start 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 1 librados: setting wanted keys 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 1 librados: calling monclient init 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient: init 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7598074920 0x7f75981524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient(hunting): picked mon.noname-b con 0x7f7598074920 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f75980c9120 0x7f7598142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient(hunting): picked mon.noname-a con 0x7f75980c9120 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 0x7f7598143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient(hunting): picked mon.noname-c con 0x7f759815d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f75980c86c0 con 0x7f75980c9120 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f75980c83e0 con 0x7f7598074920 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7598074d70 con 0x7f759815d220 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759f9f7640 10 monclient(hunting): authenticate will time out at 1341.356515s 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759cf6b640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f75980c9120 0x7f7598142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.639 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759d76c640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7598074920 0x7f75981524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759cf6b640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f75980c9120 0x7f7598142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:45034/0 (socket says 10.20.193.10:45034) 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759cf6b640 1 -- 10.20.193.10:0/3297897305 learned_addr learned my addr 10.20.193.10:0/3297897305 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759cf6b640 10 monclient(hunting): get_auth_request con 0x7f75980c9120 auth_method 0 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759cf6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759df6d640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 0x7f7598143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759cf6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.634+0000 7f759cf6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759d76c640 10 monclient(hunting): get_auth_request con 0x7f7598074920 auth_method 0 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759d76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759d76c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759d76c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759cf6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759cf6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759cf6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759df6d640 10 monclient(hunting): get_auth_request con 0x7f759815d220 auth_method 0 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759df6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759df6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759df6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759d76c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759d76c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759d76c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759df6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759df6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.635+0000 7f759df6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 10 monclient(hunting): handle_auth_done global_id 5282 payload 824 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 1 -- 10.20.193.10:0/3297897305 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7598074920 msgr2=0x7f75981524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7598074920 0x7f75981524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 1 -- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f75980c9120 msgr2=0x7f7598142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f75980c9120 0x7f7598142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.640 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 1 monclient: found mon.noname-c 2026-02-17T12:01:11.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759df6d640 1 -- 10.20.193.10:0/3297897305 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75981f1120 con 0x7f759815d220 2026-02-17T12:01:11.641 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.636+0000 7f759cf6b640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f75980c9120 0x7f7598142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.638+0000 7f759df6d640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 0x7f7598143280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f759400cae0 tx=0x7f759400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.638+0000 7f7585ffb640 10 client.?.objecter ms_handle_connect 0x7f759815d220 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.638+0000 7f7585ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 1 -- 10.20.193.10:0/3297897305 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594017070 con 0x7f759815d220 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 10 monclient: dump: 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 5 monclient: authenticate success, global_id 5282 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 10 monclient: _renew_subs 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75981f1400 con 0x7f759815d220 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 10 client.5282.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 10 monclient: _renew_subs 2026-02-17T12:01:11.642 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75981f19c0 con 0x7f759815d220 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 1 librados: init done 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 1 -- 10.20.193.10:0/3297897305 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759400acb0 con 0x7f759815d220 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 1 -- 10.20.193.10:0/3297897305 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594021060 con 0x7f759815d220 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f75877fe640 4 set_mon_vals no callback set 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f7585ffb640 10 monclient: dump: 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.639+0000 7f759f9f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.640+0000 7f759f9f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.643 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.640+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75981f1c00 con 0x7f759815d220 2026-02-17T12:01:11.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.749+0000 7f7585ffb640 1 -- 10.20.193.10:0/3297897305 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f7594024080 con 0x7f759815d220 2026-02-17T12:01:11.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.749+0000 7f7585ffb640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7568078e30 0x7f756807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.749+0000 7f759d76c640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7568078e30 0x7f756807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.749+0000 7f759d76c640 10 monclient: get_auth_request con 0x7f7568078e30 auth_method 0 2026-02-17T12:01:11.752 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.749+0000 7f7585ffb640 10 client.5282.objecter ms_handle_connect 0x7f7568078e30 2026-02-17T12:01:11.753 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.749+0000 7f759d76c640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7568078e30 0x7f756807b2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7588039000 tx=0x7f7588033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.751+0000 7f7585ffb640 1 -- 10.20.193.10:0/3297897305 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f759405dd80 con 0x7f759815d220 2026-02-17T12:01:11.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.751+0000 7f7585ffb640 10 client.5282.objecter ms_dispatch2 0x7f7598000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:11.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.751+0000 7f7585ffb640 3 client.5282.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:11.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.751+0000 7f7585ffb640 3 client.5282.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:11.754 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.751+0000 7f7585ffb640 20 client.5282.objecter dump_active .. 0 homeless 2026-02-17T12:01:11.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.757+0000 7f7585ffb640 1 -- 10.20.193.10:0/3297897305 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7594061d40 con 0x7f759815d220 2026-02-17T12:01:11.759 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.757+0000 7f7585ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:11.760 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.757+0000 7f7585ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:11.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.840+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f75980c8be0 con 0x7f7568078e30 2026-02-17T12:01:11.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.840+0000 7f7585ffb640 1 -- 10.20.193.10:0/3297897305 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f75980c8be0 con 0x7f7568078e30 2026-02-17T12:01:11.842 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 10 librados: watch_flush enter 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 10 librados: watch_flush exit 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 20 client.5282.objecter shutdown clearing up homeless session... 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 10 client.5282.objecter successfully canceled tick 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7568078e30 msgr2=0x7f756807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7568078e30 0x7f756807b2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7588039000 tx=0x7f7588033000 comp rx=0 tx=0).stop 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 10 monclient: shutdown 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 msgr2=0x7f7598143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 0x7f7598143280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f759400cae0 tx=0x7f759400a060 comp rx=0 tx=0).stop 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 shutdown_connections 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f7568078e30 0x7f756807b2f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f759815d220 0x7f7598143280 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f75980c9120 0x7f7598142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 --2- 10.20.193.10:0/3297897305 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f7598074920 0x7f75981524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 >> 10.20.193.10:0/3297897305 conn(0x7f75980c9d80 msgr2=0x7f759814e000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 shutdown_connections 2026-02-17T12:01:11.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 -- 10.20.193.10:0/3297897305 wait complete. 2026-02-17T12:01:11.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.841+0000 7f759f9f7640 1 librados: shutdown 2026-02-17T12:01:11.851 INFO:tasks.ceph:Scrubbing osd.7 2026-02-17T12:01:11.851 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:11.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.919+0000 7f14154fa640 10 monclient: get_monmap_and_config 2026-02-17T12:01:11.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.919+0000 7f14154fa640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.922 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.919+0000 7f14154fa640 10 monclient: monmap: 2026-02-17T12:01:11.922 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.922 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.922 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:11.920827+0000 2026-02-17T12:01:11.922 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:11.920827+0000 2026-02-17T12:01:11.922 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.922 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 1 Processor -- start 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 1 -- start start 2026-02-17T12:01:11.923 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 10 monclient: init 2026-02-17T12:01:11.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 10 monclient: _add_conns ranks=[0,2,5,1,4,3] 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1410150300 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f14101506e0 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f14100c4780 0x7f14100c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 10 monclient(hunting): picked mon.noname-c con 0x7f14100c4780 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14100c55e0 con 0x7f1410150300 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14100c5300 con 0x7f14101506e0 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1410159c80 con 0x7f14100c4780 2026-02-17T12:01:11.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.920+0000 7f14154fa640 10 monclient(hunting): authenticate will time out at 1341.642598s 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140effd640 1 --1- >> v1:10.20.193.10:6789/0 conn(0x7f1410150300 0x7f141006fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.10:6789/0 says I am v1:10.20.193.10:44908/0 (socket says 10.20.193.10:44908) 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140effd640 1 -- 10.20.193.10:0/149745147 learned_addr learned my addr 10.20.193.10:0/149745147 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140f7fe640 1 --2- 10.20.193.10:0/149745147 >> v2:10.20.193.153:3300/0 conn(0x7f14100c4780 0x7f14100c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140f7fe640 10 monclient(hunting): get_auth_request con 0x7f14100c4780 auth_method 0 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.921+0000 7f140f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.923+0000 7f140f7fe640 10 monclient(hunting): handle_auth_done global_id 5285 payload 274 2026-02-17T12:01:11.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.923+0000 7f140f7fe640 1 -- 10.20.193.10:0/149745147 >> v1:10.20.193.153:6789/0 conn(0x7f14101506e0 legacy=0x7f141015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.923+0000 7f140f7fe640 1 -- 10.20.193.10:0/149745147 >> v1:10.20.193.10:6789/0 conn(0x7f1410150300 legacy=0x7f141006fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.923+0000 7f140f7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.923+0000 7f140f7fe640 1 monclient: found mon.noname-c 2026-02-17T12:01:11.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.923+0000 7f140f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.923+0000 7f140f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.923+0000 7f140f7fe640 1 -- 10.20.193.10:0/149745147 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1410159f60 con 0x7f14100c4780 2026-02-17T12:01:11.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.924+0000 7f140f7fe640 1 --2- 10.20.193.10:0/149745147 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14100c4780 0x7f14100c4bf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1400009d90 tx=0x7f140002f2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baccdcf6544ccf8e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 1 -- 10.20.193.10:0/149745147 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140003c070 con 0x7f14100c4780 2026-02-17T12:01:11.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:11.933 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 10 monclient: dump: 2026-02-17T12:01:11.933 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.934 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 1 -- 10.20.193.10:0/149745147 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1400037440 con 0x7f14100c4780 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f14154fa640 5 monclient: authenticate success, global_id 5285 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f14154fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 1 -- 10.20.193.10:0/149745147 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400037810 con 0x7f14100c4780 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f14154fa640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f14154fa640 4 set_mon_vals no callback set 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.926+0000 7f140dffb640 10 monclient: dump: 2026-02-17T12:01:11.935 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 10 monclient: shutdown 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:11.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 -- 10.20.193.10:0/149745147 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14100c4780 msgr2=0x7f14100c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 --2- 10.20.193.10:0/149745147 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14100c4780 0x7f14100c4bf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1400009d90 tx=0x7f140002f2c0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 -- 10.20.193.10:0/149745147 shutdown_connections 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 --2- 10.20.193.10:0/149745147 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14100c4780 0x7f14100c4bf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 -- 10.20.193.10:0/149745147 >> 10.20.193.10:0/149745147 conn(0x7f14100cd560 msgr2=0x7f14100cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 -- 10.20.193.10:0/149745147 shutdown_connections 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 -- 10.20.193.10:0/149745147 wait complete. 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 10 monclient: build_initial_monmap 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 10 monclient: monmap: 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:11.937 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 librados: starting msgr at 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 librados: starting objecter 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.927+0000 7f14154fa640 1 Processor -- start 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 1 -- start start 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 1 librados: setting wanted keys 2026-02-17T12:01:11.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 1 librados: calling monclient init 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient: init 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14100c4780 0x7f14101f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient(hunting): picked mon.noname-c con 0x7f14100c4780 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1410150300 0x7f14101f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient(hunting): picked mon.noname-a con 0x7f1410150300 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14101506e0 0x7f14101f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient(hunting): picked mon.noname-b con 0x7f14101506e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f1410070510 con 0x7f1410150300 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f141015a520 con 0x7f14101506e0 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f141015d770 con 0x7f14100c4780 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f14154fa640 10 monclient(hunting): authenticate will time out at 1341.650423s 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f140e7fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1410150300 0x7f14101f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f140e7fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1410150300 0x7f14101f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:45036/0 (socket says 10.20.193.10:45036) 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f140e7fc640 1 -- 10.20.193.10:0/2674969455 learned_addr learned my addr 10.20.193.10:0/2674969455 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f140e7fc640 10 monclient(hunting): get_auth_request con 0x7f1410150300 auth_method 0 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f140e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f140e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f140e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.928+0000 7f140effd640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14100c4780 0x7f14101f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140f7fe640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14101506e0 0x7f14101f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140effd640 10 monclient(hunting): get_auth_request con 0x7f14100c4780 auth_method 0 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140f7fe640 10 monclient(hunting): get_auth_request con 0x7f14101506e0 auth_method 0 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:11.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.929+0000 7f140f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 10 monclient(hunting): handle_auth_done global_id 5291 payload 824 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 1 -- 10.20.193.10:0/2674969455 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14101506e0 msgr2=0x7f14101f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f14101506e0 0x7f14101f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 1 -- 10.20.193.10:0/2674969455 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1410150300 msgr2=0x7f14101f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f1410150300 0x7f14101f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:11.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 10 monclient: _finish_hunting 0 2026-02-17T12:01:11.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 1 monclient: found mon.noname-c 2026-02-17T12:01:11.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:11.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.931+0000 7f140effd640 1 -- 10.20.193.10:0/2674969455 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14101e8220 con 0x7f14100c4780 2026-02-17T12:01:11.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.932+0000 7f140effd640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14100c4780 0x7f14101f7780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f140400c440 tx=0x7f140400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.932+0000 7f13ef7fe640 10 client.?.objecter ms_handle_connect 0x7f14100c4780 2026-02-17T12:01:11.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.932+0000 7f13ef7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:11.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 1 -- 10.20.193.10:0/2674969455 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404017070 con 0x7f14100c4780 2026-02-17T12:01:11.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:11.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 10 monclient: dump: 2026-02-17T12:01:11.945 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:11.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 5 monclient: authenticate success, global_id 5291 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 10 monclient: _renew_subs 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14101e8500 con 0x7f14100c4780 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 10 client.5291.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 10 monclient: _renew_subs 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14101e8ac0 con 0x7f14100c4780 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 1 librados: init done 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 1 -- 10.20.193.10:0/2674969455 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1404005de0 con 0x7f14100c4780 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 1 -- 10.20.193.10:0/2674969455 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404021060 con 0x7f14100c4780 2026-02-17T12:01:11.947 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f140d7fa640 4 set_mon_vals no callback set 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f13ef7fe640 10 monclient: dump: 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:11.948 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:11.949 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:11.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 10 client.5291.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:11.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 15 client.5291.objecter _session_command_op_assign -1 1 2026-02-17T12:01:11.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 20 client.5291.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:11.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 10 client.5291.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:11.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:11.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.933+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14100c4bf0 con 0x7f14100c4780 2026-02-17T12:01:11.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.947+0000 7f13ef7fe640 1 -- 10.20.193.10:0/2674969455 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f1404007270 con 0x7f14100c4780 2026-02-17T12:01:11.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.947+0000 7f13ef7fe640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13dc078e00 0x7f13dc07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.947+0000 7f140e7fc640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13dc078e00 0x7f13dc07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.947+0000 7f140e7fc640 10 monclient: get_auth_request con 0x7f13dc078e00 auth_method 0 2026-02-17T12:01:11.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.947+0000 7f13ef7fe640 10 client.5291.objecter ms_handle_connect 0x7f13dc078e00 2026-02-17T12:01:11.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.947+0000 7f140e7fc640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13dc078e00 0x7f13dc07b2c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f14100cdf80 tx=0x7f13f8002990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.982 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 1 -- 10.20.193.10:0/2674969455 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f14040971b0 con 0x7f14100c4780 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 10 client.5291.objecter ms_dispatch2 0x7f1410000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 3 client.5291.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 3 client.5291.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 10 client.5291.objecter checking command 1 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7f13dc081340 0x7f13dc083760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 20 client.5291.objecter _get_session s=0x7f13dc080c70 osd=7 3 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 20 client.5291.objecter put_session s=0x7f13dc080c70 osd=7 3 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 15 client.5291.objecter _session_command_op_remove -1 1 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 20 client.5291.objecter _get_session s=0x7f13dc080c70 osd=7 3 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 20 client.5291.objecter get_session s=0x7f13dc080c70 osd=7 3 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 15 client.5291.objecter _session_command_op_assign 7 1 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 20 client.5291.objecter put_session s=0x7f13dc080c70 osd=7 4 2026-02-17T12:01:11.983 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 10 client.5291.objecter _send_command 1 2026-02-17T12:01:11.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 1 -- 10.20.193.10:0/2674969455 --> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1404016ec0 con 0x7f13dc081340 2026-02-17T12:01:11.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f13ef7fe640 20 client.5291.objecter dump_active .. 0 homeless 2026-02-17T12:01:11.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.980+0000 7f140f7fe640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7f13dc081340 0x7f13dc083760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:11.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.981+0000 7f140f7fe640 10 monclient: get_auth_request con 0x7f13dc081340 auth_method 0 2026-02-17T12:01:11.984 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.982+0000 7f13ef7fe640 10 client.5291.objecter ms_handle_connect 0x7f13dc081340 2026-02-17T12:01:11.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.982+0000 7f140f7fe640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7f13dc081340 0x7f13dc083760 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:11.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.982+0000 7f13ef7fe640 1 -- 10.20.193.10:0/2674969455 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f140405dd80 con 0x7f14100c4780 2026-02-17T12:01:11.985 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.982+0000 7f13ef7fe640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:11.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.993+0000 7f13ef7fe640 1 -- 10.20.193.10:0/2674969455 <== osd.7 v2:10.20.193.174:6808/561251262 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f1404016ec0 con 0x7f13dc081340 2026-02-17T12:01:11.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.993+0000 7f13ef7fe640 10 client.5291.objecter ms_dispatch2 0x7f1410000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:11.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.993+0000 7f13ef7fe640 10 client.5291.objecter _finish_command 1 = system:0 2026-02-17T12:01:11.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.993+0000 7f13ef7fe640 20 client.5291.objecter put_session s=0x7f13dc080c70 osd=7 4 2026-02-17T12:01:11.995 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.993+0000 7f13ef7fe640 15 client.5291.objecter _session_command_op_remove 7 1 2026-02-17T12:01:12.001 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 10 client.5291.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 15 client.5291.objecter _session_command_op_assign -1 2 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 20 client.5291.objecter _get_session s=0x7f13dc080c70 osd=7 3 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 20 client.5291.objecter put_session s=0x7f13dc080c70 osd=7 3 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 20 client.5291.objecter _get_session s=0x7f13dc080c70 osd=7 3 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 15 client.5291.objecter _session_command_op_remove -1 2 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 20 client.5291.objecter get_session s=0x7f13dc080c70 osd=7 3 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 15 client.5291.objecter _session_command_op_assign 7 2 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 20 client.5291.objecter put_session s=0x7f13dc080c70 osd=7 4 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 10 client.5291.objecter _send_command 2 2026-02-17T12:01:12.002 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:11.999+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 --> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f14100c86a0 con 0x7f13dc081340 2026-02-17T12:01:12.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f13ef7fe640 1 -- 10.20.193.10:0/2674969455 <== osd.7 v2:10.20.193.174:6808/561251262 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f14100c86a0 con 0x7f13dc081340 2026-02-17T12:01:12.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f13ef7fe640 10 client.5291.objecter ms_dispatch2 0x7f1410000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:12.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f13ef7fe640 10 client.5291.objecter _finish_command 2 = system:0 2026-02-17T12:01:12.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f13ef7fe640 20 client.5291.objecter put_session s=0x7f13dc080c70 osd=7 4 2026-02-17T12:01:12.008 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f13ef7fe640 15 client.5291.objecter _session_command_op_remove 7 2 2026-02-17T12:01:12.009 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:12.009 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:12.009 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:12.010 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 10 librados: watch_flush enter 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 10 librados: watch_flush exit 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 10 client.5291.objecter close_session for osd.7 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7f13dc081340 msgr2=0x7f13dc083760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.174:6808/561251262,v1:10.20.193.174:6809/561251262] conn(0x7f13dc081340 0x7f13dc083760 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 20 client.5291.objecter put_session s=0x7f13dc080c70 osd=7 1 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 20 client.5291.objecter shutdown clearing up homeless session... 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 10 client.5291.objecter successfully canceled tick 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13dc078e00 msgr2=0x7f13dc07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f13dc078e00 0x7f13dc07b2c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f14100cdf80 tx=0x7f13f8002990 comp rx=0 tx=0).stop 2026-02-17T12:01:12.011 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 10 monclient: shutdown 2026-02-17T12:01:12.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14100c4780 msgr2=0x7f14101f7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 --2- 10.20.193.10:0/2674969455 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f14100c4780 0x7f14101f7780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f140400c440 tx=0x7f140400c910 comp rx=0 tx=0).stop 2026-02-17T12:01:12.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f140f7fe640 1 -- 10.20.193.10:0/2674969455 reap_dead start 2026-02-17T12:01:12.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 shutdown_connections 2026-02-17T12:01:12.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 >> 10.20.193.10:0/2674969455 conn(0x7f14100cd560 msgr2=0x7f141014f040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 shutdown_connections 2026-02-17T12:01:12.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.006+0000 7f14154fa640 1 -- 10.20.193.10:0/2674969455 wait complete. 2026-02-17T12:01:12.012 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.007+0000 7f14154fa640 1 librados: shutdown 2026-02-17T12:01:12.017 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.084+0000 7f455f85b640 10 monclient: get_monmap_and_config 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.084+0000 7f455f85b640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.084+0000 7f455f85b640 10 monclient: monmap: 2026-02-17T12:01:12.086 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:12.085342+0000 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:12.085342+0000 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:12.087 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.084+0000 7f455f85b640 1 Processor -- start 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.084+0000 7f455f85b640 1 -- start start 2026-02-17T12:01:12.088 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.084+0000 7f455f85b640 10 monclient: init 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.084+0000 7f455f85b640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 10 monclient: _add_conns ranks=[0,3,5,2,4,1] 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f455815d220 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f45580c92f0 0x7f455815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 10 monclient(hunting): picked mon.noname-a con 0x7f45580c92f0 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f4558074920 0x7f4558153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 10 monclient(hunting): picked mon.noname-c con 0x7f4558074920 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45580c58a0 con 0x7f455815d220 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.091 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f45580c55c0 con 0x7f45580c92f0 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f45580c7e20 con 0x7f4558074920 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455f85b640 10 monclient(hunting): authenticate will time out at 1341.807064s 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455ddd1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f4558074920 0x7f4558153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455cdcf640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f45580c92f0 0x7f455815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455ddd1640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f4558074920 0x7f4558153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36584/0 (socket says 10.20.193.10:36584) 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455ddd1640 1 -- 10.20.193.10:0/3771141885 learned_addr learned my addr 10.20.193.10:0/3771141885 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455ddd1640 10 monclient(hunting): get_auth_request con 0x7f4558074920 auth_method 0 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455ddd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455ddd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.092 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455ddd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455cdcf640 10 monclient(hunting): get_auth_request con 0x7f45580c92f0 auth_method 0 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455cdcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455cdcf640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.085+0000 7f455cdcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.086+0000 7f455ddd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.086+0000 7f455ddd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.086+0000 7f455ddd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.086+0000 7f455cdcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.086+0000 7f455cdcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.086+0000 7f455cdcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.087+0000 7f455cdcf640 10 monclient(hunting): handle_auth_done global_id 5229 payload 274 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.087+0000 7f455cdcf640 1 -- 10.20.193.10:0/3771141885 >> v2:10.20.193.153:3300/0 conn(0x7f4558074920 msgr2=0x7f4558153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:12.093 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.087+0000 7f455cdcf640 1 --2- 10.20.193.10:0/3771141885 >> v2:10.20.193.153:3300/0 conn(0x7f4558074920 0x7f4558153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.087+0000 7f455cdcf640 1 -- 10.20.193.10:0/3771141885 >> v1:10.20.193.10:6789/0 conn(0x7f455815d220 legacy=0x7f45580c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:12.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.087+0000 7f455cdcf640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.087+0000 7f455cdcf640 1 monclient: found mon.noname-a 2026-02-17T12:01:12.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.087+0000 7f455cdcf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.087+0000 7f455cdcf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:12.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.087+0000 7f455cdcf640 1 -- 10.20.193.10:0/3771141885 --> v2:10.20.193.10:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45580c8100 con 0x7f45580c92f0 2026-02-17T12:01:12.094 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.088+0000 7f455cdcf640 1 --2- 10.20.193.10:0/3771141885 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f45580c92f0 0x7f455815d600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f454c0098a0 tx=0x7f454c02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec202f0cb96dfed server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 1 -- 10.20.193.10:0/3771141885 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c03c070 con 0x7f45580c92f0 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 10 monclient: dump: 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.101 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 5 monclient: authenticate success, global_id 5229 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 1 -- 10.20.193.10:0/3771141885 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c02fa40 con 0x7f45580c92f0 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.102 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 1 -- 10.20.193.10:0/3771141885 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c02fe10 con 0x7f45580c92f0 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 4 set_mon_vals no callback set 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f4547fff640 10 monclient: dump: 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.103 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 10 monclient: shutdown 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 1 -- 10.20.193.10:0/3771141885 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f45580c92f0 msgr2=0x7f455815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 1 --2- 10.20.193.10:0/3771141885 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f45580c92f0 0x7f455815d600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f454c0098a0 tx=0x7f454c02ee10 comp rx=0 tx=0).stop 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 1 -- 10.20.193.10:0/3771141885 shutdown_connections 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 1 --2- 10.20.193.10:0/3771141885 >> v2:10.20.193.153:3300/0 conn(0x7f4558074920 0x7f4558153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 1 --2- 10.20.193.10:0/3771141885 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f45580c92f0 0x7f455815d600 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 1 -- 10.20.193.10:0/3771141885 >> 10.20.193.10:0/3771141885 conn(0x7f45580c9d80 msgr2=0x7f45580ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.104 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 1 -- 10.20.193.10:0/3771141885 shutdown_connections 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.090+0000 7f455f85b640 1 -- 10.20.193.10:0/3771141885 wait complete. 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.091+0000 7f455f85b640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.091+0000 7f455f85b640 10 monclient: monmap: 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:12.105 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.091+0000 7f455f85b640 1 librados: starting msgr at 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.091+0000 7f455f85b640 1 librados: starting objecter 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.091+0000 7f455f85b640 1 Processor -- start 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.091+0000 7f455f85b640 1 -- start start 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.091+0000 7f455f85b640 1 librados: setting wanted keys 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.091+0000 7f455f85b640 1 librados: calling monclient init 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.091+0000 7f455f85b640 10 monclient: init 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:12.106 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4558074920 0x7f455806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient(hunting): picked mon.noname-c con 0x7f4558074920 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f45580c92f0 0x7f45581f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient(hunting): picked mon.noname-b con 0x7f45580c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f455815d220 0x7f45581e6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient(hunting): picked mon.noname-a con 0x7f455815d220 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f4558074d70 con 0x7f455815d220 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45580c86c0 con 0x7f45580c92f0 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4558153b90 con 0x7f4558074920 2026-02-17T12:01:12.107 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455f85b640 10 monclient(hunting): authenticate will time out at 1341.814095s 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f455815d220 0x7f45581e6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455d5d0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4558074920 0x7f455806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455cdcf640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f45580c92f0 0x7f45581f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f455815d220 0x7f45581e6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.10:3300/0 says I am v2:10.20.193.10:45052/0 (socket says 10.20.193.10:45052) 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 1 -- 10.20.193.10:0/2080750145 learned_addr learned my addr 10.20.193.10:0/2080750145 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 10 monclient(hunting): get_auth_request con 0x7f455815d220 auth_method 0 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455d5d0640 10 monclient(hunting): get_auth_request con 0x7f4558074920 auth_method 0 2026-02-17T12:01:12.108 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455d5d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455d5d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455d5d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455cdcf640 10 monclient(hunting): get_auth_request con 0x7f45580c92f0 auth_method 0 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455cdcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455cdcf640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455cdcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455ddd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455d5d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455d5d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.109 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455d5d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455cdcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455cdcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.092+0000 7f455cdcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 10 monclient(hunting): handle_auth_done global_id 5232 payload 824 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 1 -- 10.20.193.10:0/2080750145 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4558074920 msgr2=0x7f455806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4558074920 0x7f455806fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 1 -- 10.20.193.10:0/2080750145 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f45580c92f0 msgr2=0x7f45581f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f45580c92f0 0x7f45581f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 1 monclient: found mon.noname-a 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.110 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.10:3300/0 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.094+0000 7f455ddd1640 1 -- 10.20.193.10:0/2080750145 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45581f4240 con 0x7f455815d220 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.095+0000 7f455ddd1640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f455815d220 0x7f45581e6cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4554009d90 tx=0x7f455400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.095+0000 7f4545ffb640 10 client.?.objecter ms_handle_connect 0x7f455815d220 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.095+0000 7f4545ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 1 -- 10.20.193.10:0/2080750145 <== mon.0 v2:10.20.193.10:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455400cd30 con 0x7f455815d220 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 10 monclient: dump: 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.111 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 1 -- 10.20.193.10:0/2080750145 <== mon.0 v2:10.20.193.10:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4554003a90 con 0x7f455815d220 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 5 monclient: authenticate success, global_id 5232 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 10 monclient: _renew_subs 2026-02-17T12:01:12.112 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45581f4520 con 0x7f455815d220 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 1 -- 10.20.193.10:0/2080750145 <== mon.0 v2:10.20.193.10:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554003e60 con 0x7f455815d220 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f45477fe640 4 set_mon_vals no callback set 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f4545ffb640 10 monclient: dump: 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.113 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 10 client.5232.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 10 monclient: _renew_subs 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45581e64c0 con 0x7f455815d220 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 1 librados: init done 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.114 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.10:3300/0 2026-02-17T12:01:12.115 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.097+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4558050a50 con 0x7f455815d220 2026-02-17T12:01:12.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.109+0000 7f4545ffb640 1 -- 10.20.193.10:0/2080750145 <== mon.0 v2:10.20.193.10:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f4554004030 con 0x7f455815d220 2026-02-17T12:01:12.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.110+0000 7f4545ffb640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4528078e00 0x7f452807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.110+0000 7f455d5d0640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4528078e00 0x7f452807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.110+0000 7f455d5d0640 10 monclient: get_auth_request con 0x7f4528078e00 auth_method 0 2026-02-17T12:01:12.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.110+0000 7f455d5d0640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4528078e00 0x7f452807b2c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4548004660 tx=0x7f4548009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.110+0000 7f4545ffb640 10 client.5232.objecter ms_handle_connect 0x7f4528078e00 2026-02-17T12:01:12.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.111+0000 7f4545ffb640 1 -- 10.20.193.10:0/2080750145 <== mon.0 v2:10.20.193.10:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f455405ee70 con 0x7f455815d220 2026-02-17T12:01:12.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.111+0000 7f4545ffb640 10 client.5232.objecter ms_dispatch2 0x7f4558000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:12.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.111+0000 7f4545ffb640 3 client.5232.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:12.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.111+0000 7f4545ffb640 3 client.5232.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:12.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.112+0000 7f4545ffb640 20 client.5232.objecter dump_active .. 0 homeless 2026-02-17T12:01:12.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.212+0000 7f4545ffb640 1 -- 10.20.193.10:0/2080750145 <== mon.0 v2:10.20.193.10:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4558050a50 con 0x7f455815d220 2026-02-17T12:01:12.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.212+0000 7f4545ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.214 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.212+0000 7f4545ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:12.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.294+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f4558070ba0 con 0x7f4528078e00 2026-02-17T12:01:12.296 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.294+0000 7f4545ffb640 1 -- 10.20.193.10:0/2080750145 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4558070ba0 con 0x7f4528078e00 2026-02-17T12:01:12.296 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 7 to deep-scrub 2026-02-17T12:01:12.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 10 librados: watch_flush enter 2026-02-17T12:01:12.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 10 librados: watch_flush exit 2026-02-17T12:01:12.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 20 client.5232.objecter shutdown clearing up homeless session... 2026-02-17T12:01:12.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 10 client.5232.objecter successfully canceled tick 2026-02-17T12:01:12.298 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4528078e00 msgr2=0x7f452807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4528078e00 0x7f452807b2c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4548004660 tx=0x7f4548009110 comp rx=0 tx=0).stop 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 10 monclient: shutdown 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f455815d220 msgr2=0x7f45581e6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f455815d220 0x7f45581e6cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4554009d90 tx=0x7f455400c490 comp rx=0 tx=0).stop 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 shutdown_connections 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f4528078e00 0x7f452807b2c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f455815d220 0x7f45581e6cc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f45580c92f0 0x7f45581f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 --2- 10.20.193.10:0/2080750145 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4558074920 0x7f455806fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.299 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 >> 10.20.193.10:0/2080750145 conn(0x7f45580c9d80 msgr2=0x7f4558153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 shutdown_connections 2026-02-17T12:01:12.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 -- 10.20.193.10:0/2080750145 wait complete. 2026-02-17T12:01:12.300 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.295+0000 7f455f85b640 1 librados: shutdown 2026-02-17T12:01:12.305 INFO:tasks.ceph:Scrubbing osd.11 2026-02-17T12:01:12.306 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:12.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.373+0000 7fc927f8f640 10 monclient: get_monmap_and_config 2026-02-17T12:01:12.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.373+0000 7fc927f8f640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.375 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.373+0000 7fc927f8f640 10 monclient: monmap: 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:12.374393+0000 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:12.374393+0000 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:12.376 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:12.377 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:12.377 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.373+0000 7fc927f8f640 1 Processor -- start 2026-02-17T12:01:12.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.373+0000 7fc927f8f640 1 -- start start 2026-02-17T12:01:12.377 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.373+0000 7fc927f8f640 10 monclient: init 2026-02-17T12:01:12.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient: _add_conns ranks=[3,4,5,2,0,1] 2026-02-17T12:01:12.385 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc920150300 0x7fc92006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient(hunting): picked mon.noname-a con 0x7fc920150300 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fc9201506e0 0x7fc92015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient(hunting): picked mon.noname-b con 0x7fc9201506e0 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc920070340 0x7fc92015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient(hunting): picked mon.noname-c con 0x7fc920070340 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7fc9200c55e0 con 0x7fc920150300 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc9200c5300 con 0x7fc9201506e0 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc920159c80 con 0x7fc920070340 2026-02-17T12:01:12.386 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc927f8f640 10 monclient(hunting): authenticate will time out at 1342.096204s 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925d04640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7fc920150300 0x7fc92006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925503640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fc9201506e0 0x7fc92015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc926505640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7fc920070340 0x7fc92015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925503640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fc9201506e0 0x7fc92015d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59808/0 (socket says 10.20.193.10:59808) 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925503640 1 -- 10.20.193.10:0/978025805 learned_addr learned my addr 10.20.193.10:0/978025805 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925503640 10 monclient(hunting): get_auth_request con 0x7fc9201506e0 auth_method 0 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925503640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925503640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925503640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925d04640 10 monclient(hunting): get_auth_request con 0x7fc920150300 auth_method 0 2026-02-17T12:01:12.387 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925d04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925d04640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc925d04640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc926505640 10 monclient(hunting): get_auth_request con 0x7fc920070340 auth_method 0 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc926505640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc926505640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.374+0000 7fc926505640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc925503640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc925503640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc925503640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.388 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc925d04640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc925d04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc925d04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 10 monclient(hunting): handle_auth_done global_id 5300 payload 274 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 1 -- 10.20.193.10:0/978025805 >> v2:10.20.193.71:3300/0 conn(0x7fc9201506e0 msgr2=0x7fc92015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 1 --2- 10.20.193.10:0/978025805 >> v2:10.20.193.71:3300/0 conn(0x7fc9201506e0 0x7fc92015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 1 -- 10.20.193.10:0/978025805 >> v2:10.20.193.10:3300/0 conn(0x7fc920150300 msgr2=0x7fc92006fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 1 --2- 10.20.193.10:0/978025805 >> v2:10.20.193.10:3300/0 conn(0x7fc920150300 0x7fc92006fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 1 monclient: found mon.noname-c 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:12.389 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.375+0000 7fc926505640 1 -- 10.20.193.10:0/978025805 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc920159f60 con 0x7fc920070340 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.376+0000 7fc926505640 1 --2- 10.20.193.10:0/978025805 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc920070340 0x7fc92015d5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc92006f440 tx=0x7fc91c02f250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aae9a91ef91b0d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 1 -- 10.20.193.10:0/978025805 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c03c070 con 0x7fc920070340 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 10 monclient: dump: 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.390 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 5 monclient: authenticate success, global_id 5300 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 1 -- 10.20.193.10:0/978025805 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c037440 con 0x7fc920070340 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.391 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 1 -- 10.20.193.10:0/978025805 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c037810 con 0x7fc920070340 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 4 set_mon_vals no callback set 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc924d02640 10 monclient: dump: 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.392 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 10 monclient: shutdown 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 1 -- 10.20.193.10:0/978025805 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc920070340 msgr2=0x7fc92015d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 1 --2- 10.20.193.10:0/978025805 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc920070340 0x7fc92015d5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc92006f440 tx=0x7fc91c02f250 comp rx=0 tx=0).stop 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 1 -- 10.20.193.10:0/978025805 shutdown_connections 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 1 --2- 10.20.193.10:0/978025805 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc920070340 0x7fc92015d5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 1 --2- 10.20.193.10:0/978025805 >> v2:10.20.193.71:3300/0 conn(0x7fc9201506e0 0x7fc92015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 1 --2- 10.20.193.10:0/978025805 >> v2:10.20.193.10:3300/0 conn(0x7fc920150300 0x7fc92006fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.393 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 1 -- 10.20.193.10:0/978025805 >> 10.20.193.10:0/978025805 conn(0x7fc9200cd560 msgr2=0x7fc9200cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 1 -- 10.20.193.10:0/978025805 shutdown_connections 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.378+0000 7fc927f8f640 1 -- 10.20.193.10:0/978025805 wait complete. 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.379+0000 7fc927f8f640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.379+0000 7fc927f8f640 10 monclient: monmap: 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:12.394 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.379+0000 7fc927f8f640 1 librados: starting msgr at 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.379+0000 7fc927f8f640 1 librados: starting objecter 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.379+0000 7fc927f8f640 1 Processor -- start 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.379+0000 7fc927f8f640 1 -- start start 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.379+0000 7fc927f8f640 1 librados: setting wanted keys 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.379+0000 7fc927f8f640 1 librados: calling monclient init 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.379+0000 7fc927f8f640 10 monclient: init 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:12.395 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc920070340 0x7fc9201f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient(hunting): picked mon.noname-c con 0x7fc920070340 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc920150300 0x7fc9200c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient(hunting): picked mon.noname-b con 0x7fc920150300 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9201506e0 0x7fc9201f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient(hunting): picked mon.noname-a con 0x7fc9201506e0 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc9200c4780 con 0x7fc9201506e0 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc92015a520 con 0x7fc920150300 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9200c4900 con 0x7fc920070340 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.396 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc927f8f640 10 monclient(hunting): authenticate will time out at 1342.102210s 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc926505640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9201506e0 0x7fc9201f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc920150300 0x7fc9200c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925d04640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc920070340 0x7fc9201f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc920150300 0x7fc9200c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59820/0 (socket says 10.20.193.10:59820) 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 1 -- 10.20.193.10:0/1694196230 learned_addr learned my addr 10.20.193.10:0/1694196230 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 10 monclient(hunting): get_auth_request con 0x7fc920150300 auth_method 0 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925d04640 10 monclient(hunting): get_auth_request con 0x7fc920070340 auth_method 0 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925d04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.397 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925d04640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925d04640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc926505640 10 monclient(hunting): get_auth_request con 0x7fc9201506e0 auth_method 0 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc926505640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc926505640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc926505640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925503640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925d04640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925d04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc925d04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.398 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc926505640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc926505640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.380+0000 7fc926505640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 10 monclient(hunting): handle_auth_done global_id 5303 payload 824 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 1 -- 10.20.193.10:0/1694196230 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc920150300 msgr2=0x7fc9200c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc920150300 0x7fc9200c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 1 -- 10.20.193.10:0/1694196230 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9201506e0 msgr2=0x7fc9201f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc9201506e0 0x7fc9201f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 1 monclient: found mon.noname-c 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.382+0000 7fc925d04640 1 -- 10.20.193.10:0/1694196230 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc920158b00 con 0x7fc920070340 2026-02-17T12:01:12.399 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.383+0000 7fc925d04640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc920070340 0x7fc9201f7280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc91000e8d0 tx=0x7fc91000eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.383+0000 7fc90e7fc640 10 client.?.objecter ms_handle_connect 0x7fc920070340 2026-02-17T12:01:12.400 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.383+0000 7fc90e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:12.403 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 1 -- 10.20.193.10:0/1694196230 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910017070 con 0x7fc920070340 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 10 monclient: dump: 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.404 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 5 monclient: authenticate success, global_id 5303 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 10 monclient: _renew_subs 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc920158de0 con 0x7fc920070340 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 10 client.5303.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 10 monclient: _renew_subs 2026-02-17T12:01:12.405 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9201593a0 con 0x7fc920070340 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 1 librados: init done 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 1 -- 10.20.193.10:0/1694196230 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91000c940 con 0x7fc920070340 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 1 -- 10.20.193.10:0/1694196230 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910021060 con 0x7fc920070340 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90ffff640 4 set_mon_vals no callback set 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc90e7fc640 10 monclient: dump: 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.406 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 10 client.5303.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 15 client.5303.objecter _session_command_op_assign -1 1 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 20 client.5303.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 10 client.5303.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.384+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc92006fe00 con 0x7fc920070340 2026-02-17T12:01:12.407 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.395+0000 7fc90e7fc640 1 -- 10.20.193.10:0/1694196230 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc910013470 con 0x7fc920070340 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.396+0000 7fc90e7fc640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc8f0078e00 0x7fc8f007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.396+0000 7fc925503640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc8f0078e00 0x7fc8f007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.396+0000 7fc925503640 10 monclient: get_auth_request con 0x7fc8f0078e00 auth_method 0 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.396+0000 7fc90e7fc640 10 client.5303.objecter ms_handle_connect 0x7fc8f0078e00 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.396+0000 7fc925503640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc8f0078e00 0x7fc8f007b2c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9200cdec0 tx=0x7fc914009340 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 1 -- 10.20.193.10:0/1694196230 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc91000ccf0 con 0x7fc920070340 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 10 client.5303.objecter ms_dispatch2 0x7fc920000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 3 client.5303.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 3 client.5303.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 10 client.5303.objecter checking command 1 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7fc8f00812e0 0x7fc8f0083700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 20 client.5303.objecter _get_session s=0x7fc8f0080c10 osd=11 3 2026-02-17T12:01:12.408 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 20 client.5303.objecter put_session s=0x7fc8f0080c10 osd=11 3 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 15 client.5303.objecter _session_command_op_remove -1 1 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 20 client.5303.objecter _get_session s=0x7fc8f0080c10 osd=11 3 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 20 client.5303.objecter get_session s=0x7fc8f0080c10 osd=11 3 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 15 client.5303.objecter _session_command_op_assign 11 1 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 20 client.5303.objecter put_session s=0x7fc8f0080c10 osd=11 4 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 10 client.5303.objecter _send_command 1 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 1 -- 10.20.193.10:0/1694196230 --> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc910004570 con 0x7fc8f00812e0 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 20 client.5303.objecter dump_active .. 0 homeless 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 1 -- 10.20.193.10:0/1694196230 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc91005e910 con 0x7fc920070340 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc90e7fc640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc926505640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7fc8f00812e0 0x7fc8f0083700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.398+0000 7fc926505640 10 monclient: get_auth_request con 0x7fc8f00812e0 auth_method 0 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.400+0000 7fc926505640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7fc8f00812e0 0x7fc8f0083700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.409 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.400+0000 7fc90e7fc640 10 client.5303.objecter ms_handle_connect 0x7fc8f00812e0 2026-02-17T12:01:12.412 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.411+0000 7fc90e7fc640 1 -- 10.20.193.10:0/1694196230 <== osd.11 v2:10.20.193.174:6800/4034633078 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc910004570 con 0x7fc8f00812e0 2026-02-17T12:01:12.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.411+0000 7fc90e7fc640 10 client.5303.objecter ms_dispatch2 0x7fc920000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:12.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.411+0000 7fc90e7fc640 10 client.5303.objecter _finish_command 1 = system:0 2026-02-17T12:01:12.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.411+0000 7fc90e7fc640 20 client.5303.objecter put_session s=0x7fc8f0080c10 osd=11 4 2026-02-17T12:01:12.413 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.411+0000 7fc90e7fc640 15 client.5303.objecter _session_command_op_remove 11 1 2026-02-17T12:01:12.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 10 client.5303.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:12.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 15 client.5303.objecter _session_command_op_assign -1 2 2026-02-17T12:01:12.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 20 client.5303.objecter _get_session s=0x7fc8f0080c10 osd=11 3 2026-02-17T12:01:12.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 20 client.5303.objecter put_session s=0x7fc8f0080c10 osd=11 3 2026-02-17T12:01:12.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 20 client.5303.objecter _get_session s=0x7fc8f0080c10 osd=11 3 2026-02-17T12:01:12.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 15 client.5303.objecter _session_command_op_remove -1 2 2026-02-17T12:01:12.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 20 client.5303.objecter get_session s=0x7fc8f0080c10 osd=11 3 2026-02-17T12:01:12.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 15 client.5303.objecter _session_command_op_assign 11 2 2026-02-17T12:01:12.419 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 20 client.5303.objecter put_session s=0x7fc8f0080c10 osd=11 4 2026-02-17T12:01:12.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 10 client.5303.objecter _send_command 2 2026-02-17T12:01:12.420 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.416+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 --> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc9200c8d50 con 0x7fc8f00812e0 2026-02-17T12:01:12.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc90e7fc640 1 -- 10.20.193.10:0/1694196230 <== osd.11 v2:10.20.193.174:6800/4034633078 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc9200c8d50 con 0x7fc8f00812e0 2026-02-17T12:01:12.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc90e7fc640 10 client.5303.objecter ms_dispatch2 0x7fc920000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:12.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc90e7fc640 10 client.5303.objecter _finish_command 2 = system:0 2026-02-17T12:01:12.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc90e7fc640 20 client.5303.objecter put_session s=0x7fc8f0080c10 osd=11 4 2026-02-17T12:01:12.425 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc90e7fc640 15 client.5303.objecter _session_command_op_remove 11 2 2026-02-17T12:01:12.426 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:12.426 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:12.426 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 10 librados: watch_flush enter 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 10 librados: watch_flush exit 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 10 client.5303.objecter close_session for osd.11 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7fc8f00812e0 msgr2=0x7fc8f0083700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.174:6800/4034633078,v1:10.20.193.174:6801/4034633078] conn(0x7fc8f00812e0 0x7fc8f0083700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 20 client.5303.objecter put_session s=0x7fc8f0080c10 osd=11 1 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 20 client.5303.objecter shutdown clearing up homeless session... 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 10 client.5303.objecter successfully canceled tick 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc8f0078e00 msgr2=0x7fc8f007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.428 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc8f0078e00 0x7fc8f007b2c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9200cdec0 tx=0x7fc914009340 comp rx=0 tx=0).stop 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 10 monclient: shutdown 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc920070340 msgr2=0x7fc9201f7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 1 --2- 10.20.193.10:0/1694196230 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc920070340 0x7fc9201f7280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc91000e8d0 tx=0x7fc91000eda0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc926505640 1 -- 10.20.193.10:0/1694196230 reap_dead start 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 shutdown_connections 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 >> 10.20.193.10:0/1694196230 conn(0x7fc9200cd560 msgr2=0x7fc92014db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.423+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 shutdown_connections 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.424+0000 7fc927f8f640 1 -- 10.20.193.10:0/1694196230 wait complete. 2026-02-17T12:01:12.429 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.424+0000 7fc927f8f640 1 librados: shutdown 2026-02-17T12:01:12.433 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.501+0000 7fadec2e1640 10 monclient: get_monmap_and_config 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.501+0000 7fadec2e1640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.501+0000 7fadec2e1640 10 monclient: monmap: 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:12.502431+0000 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:12.502431+0000 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:12.503 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:12.504 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.501+0000 7fadec2e1640 1 Processor -- start 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.501+0000 7fadec2e1640 1 -- start start 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.501+0000 7fadec2e1640 10 monclient: init 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 10 monclient: _add_conns ranks=[2,1,4,5,3,0] 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fade415d220 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fade40c92f0 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fade4153d60 0x7fade415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 10 monclient(hunting): picked mon.noname-b con 0x7fade4153d60 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade40c58a0 con 0x7fade40c92f0 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade40c55c0 con 0x7fade415d220 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7fade40c7e20 con 0x7fade4153d60 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadec2e1640 10 monclient(hunting): authenticate will time out at 1342.224224s 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadea857640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7fade4153d60 0x7fade415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.505 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadea056640 1 --1- >> v1:10.20.193.153:6789/0 conn(0x7fade415d220 0x7fade40c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.153:6789/0 says I am v1:10.20.193.10:57552/0 (socket says 10.20.193.10:57552) 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadea056640 1 -- 10.20.193.10:0/4085372977 learned_addr learned my addr 10.20.193.10:0/4085372977 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadea857640 10 monclient(hunting): get_auth_request con 0x7fade4153d60 auth_method 0 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadea857640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadea857640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.502+0000 7fadea857640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.503+0000 7fadea857640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.503+0000 7fadea857640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.503+0000 7fadea857640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.504+0000 7fade9054640 1 -- 10.20.193.10:0/4085372977 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995343277 0 0) 0x7fade40c55c0 con 0x7fade415d220 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.504+0000 7fade9054640 10 monclient(hunting): _negotiate 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.504+0000 7fade9054640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.506 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.504+0000 7fade9054640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.504+0000 7fade9054640 10 monclient(hunting): my global_id is 5306 2026-02-17T12:01:12.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.504+0000 7fade9054640 1 -- 10.20.193.10:0/4085372977 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadcc003620 con 0x7fade415d220 2026-02-17T12:01:12.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.505+0000 7fadea857640 10 monclient(hunting): handle_auth_done global_id 5299 payload 274 2026-02-17T12:01:12.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.505+0000 7fadea857640 1 -- 10.20.193.10:0/4085372977 >> v1:10.20.193.153:6789/0 conn(0x7fade415d220 legacy=0x7fade40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.505+0000 7fadea857640 1 -- 10.20.193.10:0/4085372977 >> v1:10.20.193.71:6789/0 conn(0x7fade40c92f0 legacy=0x7fade4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.505+0000 7fadea857640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.505+0000 7fadea857640 1 monclient: found mon.noname-b 2026-02-17T12:01:12.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.505+0000 7fadea857640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.507 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.505+0000 7fadea857640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.508 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.505+0000 7fadea857640 1 -- 10.20.193.10:0/4085372977 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade40c8100 con 0x7fade4153d60 2026-02-17T12:01:12.508 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.506+0000 7fadea857640 1 --2- 10.20.193.10:0/4085372977 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade4153d60 0x7fade415d600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fade0009dc0 tx=0x7fade002f280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a6658aea118b17 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.507+0000 7fade9054640 1 -- 10.20.193.10:0/4085372977 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade003c070 con 0x7fade4153d60 2026-02-17T12:01:12.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.507+0000 7fade9054640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.507+0000 7fade9054640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:12.509 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.507+0000 7fade9054640 10 monclient: dump: 2026-02-17T12:01:12.509 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.509 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.509 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.509 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.509 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.507+0000 7fade9054640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.507+0000 7fade9054640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.507+0000 7fade9054640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.507+0000 7fadec2e1640 5 monclient: authenticate success, global_id 5299 2026-02-17T12:01:12.510 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.507+0000 7fadec2e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:12.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fade9054640 1 -- 10.20.193.10:0/4085372977 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade0037440 con 0x7fade4153d60 2026-02-17T12:01:12.512 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fade9054640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fade9054640 1 -- 10.20.193.10:0/4085372977 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade00377f0 con 0x7fade4153d60 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fade9054640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fade9054640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fade9054640 10 monclient: dump: 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 4 set_mon_vals no callback set 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 10 monclient: shutdown 2026-02-17T12:01:12.513 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 1 -- 10.20.193.10:0/4085372977 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade4153d60 msgr2=0x7fade415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 1 --2- 10.20.193.10:0/4085372977 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade4153d60 0x7fade415d600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fade0009dc0 tx=0x7fade002f280 comp rx=0 tx=0).stop 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 1 -- 10.20.193.10:0/4085372977 shutdown_connections 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 1 --2- 10.20.193.10:0/4085372977 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade4153d60 0x7fade415d600 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 1 -- 10.20.193.10:0/4085372977 >> 10.20.193.10:0/4085372977 conn(0x7fade40c9d80 msgr2=0x7fade40ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 1 -- 10.20.193.10:0/4085372977 shutdown_connections 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.508+0000 7fadec2e1640 1 -- 10.20.193.10:0/4085372977 wait complete. 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient: monmap: 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.514 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 librados: starting msgr at 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 librados: starting objecter 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 Processor -- start 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 -- start start 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 librados: setting wanted keys 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 librados: calling monclient init 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient: init 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade40c92f0 0x7fade41f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient(hunting): picked mon.noname-b con 0x7fade40c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fade4153d60 0x7fade4073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient(hunting): picked mon.noname-a con 0x7fade4153d60 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fade415d220 0x7fade4073b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient(hunting): picked mon.noname-c con 0x7fade415d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fade4074920 con 0x7fade4153d60 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fade40c86c0 con 0x7fade40c92f0 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.515 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fade4074aa0 con 0x7fade415d220 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.509+0000 7fadec2e1640 10 monclient(hunting): authenticate will time out at 1342.231950s 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade40c92f0 0x7fade41f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fade9855640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fade4153d60 0x7fade4073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea857640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fade415d220 0x7fade4073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade40c92f0 0x7fade41f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59834/0 (socket says 10.20.193.10:59834) 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 1 -- 10.20.193.10:0/3185323671 learned_addr learned my addr 10.20.193.10:0/3185323671 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 10 monclient(hunting): get_auth_request con 0x7fade40c92f0 auth_method 0 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fade9855640 10 monclient(hunting): get_auth_request con 0x7fade4153d60 auth_method 0 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fade9855640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fade9855640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fade9855640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea857640 10 monclient(hunting): get_auth_request con 0x7fade415d220 auth_method 0 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea857640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea857640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea857640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.516 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea056640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fade9855640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fade9855640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fade9855640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea857640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea857640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.517 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.510+0000 7fadea857640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 10 monclient(hunting): handle_auth_done global_id 5305 payload 824 2026-02-17T12:01:12.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 1 -- 10.20.193.10:0/3185323671 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fade415d220 msgr2=0x7fade4073b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.518 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fade415d220 0x7fade4073b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 1 -- 10.20.193.10:0/3185323671 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fade4153d60 msgr2=0x7fade4073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fade4153d60 0x7fade4073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 1 monclient: found mon.noname-b 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.511+0000 7fadea056640 1 -- 10.20.193.10:0/3185323671 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade406dc10 con 0x7fade40c92f0 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.512+0000 7fadea056640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade40c92f0 0x7fade41f4f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fadd400c4d0 tx=0x7fadd400c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.512+0000 7fadcaffd640 10 client.?.objecter ms_handle_connect 0x7fade40c92f0 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.512+0000 7fadcaffd640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 1 -- 10.20.193.10:0/3185323671 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4017070 con 0x7fade40c92f0 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 10 monclient: dump: 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.519 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 1 -- 10.20.193.10:0/3185323671 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd4005e00 con 0x7fade40c92f0 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 1 -- 10.20.193.10:0/3185323671 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd40072b0 con 0x7fade40c92f0 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 5 monclient: authenticate success, global_id 5305 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 10 monclient: _renew_subs 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fade8853640 4 set_mon_vals no callback set 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade406def0 con 0x7fade40c92f0 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadcaffd640 10 monclient: dump: 2026-02-17T12:01:12.520 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 10 client.5305.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 10 monclient: _renew_subs 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade406e4b0 con 0x7fade40c92f0 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 1 librados: init done 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.514+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade415d600 con 0x7fade40c92f0 2026-02-17T12:01:12.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.526+0000 7fadcaffd640 1 -- 10.20.193.10:0/3185323671 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fadd4007450 con 0x7fade40c92f0 2026-02-17T12:01:12.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.526+0000 7fadcaffd640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadb4078e50 0x7fadb407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.526+0000 7fade9855640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadb4078e50 0x7fadb407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.526+0000 7fade9855640 10 monclient: get_auth_request con 0x7fadb4078e50 auth_method 0 2026-02-17T12:01:12.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.526+0000 7fadcaffd640 10 client.5305.objecter ms_handle_connect 0x7fadb4078e50 2026-02-17T12:01:12.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.526+0000 7fade9855640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadb4078e50 0x7fadb407b310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fadd8002410 tx=0x7fadd8007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.527+0000 7fadcaffd640 1 -- 10.20.193.10:0/3185323671 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fadd4007770 con 0x7fade40c92f0 2026-02-17T12:01:12.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.527+0000 7fadcaffd640 10 client.5305.objecter ms_dispatch2 0x7fade4000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:12.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.527+0000 7fadcaffd640 3 client.5305.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:12.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.527+0000 7fadcaffd640 3 client.5305.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:12.529 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.527+0000 7fadcaffd640 20 client.5305.objecter dump_active .. 0 homeless 2026-02-17T12:01:12.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.633+0000 7fadcaffd640 1 -- 10.20.193.10:0/3185323671 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fadd4021020 con 0x7fade40c92f0 2026-02-17T12:01:12.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.633+0000 7fadcaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.635 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.633+0000 7fadcaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:12.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.716+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7fade40c9b60 con 0x7fadb4078e50 2026-02-17T12:01:12.718 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.716+0000 7fadcaffd640 1 -- 10.20.193.10:0/3185323671 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7fade40c9b60 con 0x7fadb4078e50 2026-02-17T12:01:12.718 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 11 to deep-scrub 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 10 librados: watch_flush enter 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 10 librados: watch_flush exit 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 20 client.5305.objecter shutdown clearing up homeless session... 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 10 client.5305.objecter successfully canceled tick 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadb4078e50 msgr2=0x7fadb407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadb4078e50 0x7fadb407b310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fadd8002410 tx=0x7fadd8007ef0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 10 monclient: shutdown 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade40c92f0 msgr2=0x7fade41f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade40c92f0 0x7fade41f4f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fadd400c4d0 tx=0x7fadd400c9a0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 shutdown_connections 2026-02-17T12:01:12.719 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fadb4078e50 0x7fadb407b310 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fade415d220 0x7fade4073b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fade4153d60 0x7fade4073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 --2- 10.20.193.10:0/3185323671 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fade40c92f0 0x7fade41f4f40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 >> 10.20.193.10:0/3185323671 conn(0x7fade40c9d80 msgr2=0x7fade4153420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 shutdown_connections 2026-02-17T12:01:12.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.717+0000 7fadec2e1640 1 -- 10.20.193.10:0/3185323671 wait complete. 2026-02-17T12:01:12.720 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.718+0000 7fadec2e1640 1 librados: shutdown 2026-02-17T12:01:12.727 INFO:tasks.ceph:Scrubbing osd.15 2026-02-17T12:01:12.727 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.793+0000 7efe1d6fa640 10 monclient: get_monmap_and_config 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.793+0000 7efe1d6fa640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.793+0000 7efe1d6fa640 10 monclient: monmap: 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:12.794723+0000 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:12.794723+0000 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:12.795 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.793+0000 7efe1d6fa640 1 Processor -- start 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.793+0000 7efe1d6fa640 1 -- start start 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.793+0000 7efe1d6fa640 10 monclient: init 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 10 monclient: _add_conns ranks=[3,4,0,5,1,2] 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7efe18150300 0x7efe1806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 10 monclient(hunting): picked mon.noname-a con 0x7efe18150300 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7efe181506e0 0x7efe1815d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 10 monclient(hunting): picked mon.noname-b con 0x7efe181506e0 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efe18070340 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe180c55e0 con 0x7efe18070340 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7efe180c5300 con 0x7efe18150300 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7efe18159c80 con 0x7efe181506e0 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.796 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe1d6fa640 10 monclient(hunting): authenticate will time out at 1342.516471s 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe16ffd640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7efe18150300 0x7efe1806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.794+0000 7efe167fc640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7efe181506e0 0x7efe1815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe167fc640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7efe181506e0 0x7efe1815d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59848/0 (socket says 10.20.193.10:59848) 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe167fc640 1 -- 10.20.193.10:0/1539300697 learned_addr learned my addr 10.20.193.10:0/1539300697 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe167fc640 10 monclient(hunting): get_auth_request con 0x7efe181506e0 auth_method 0 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe167fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe16ffd640 10 monclient(hunting): get_auth_request con 0x7efe18150300 auth_method 0 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe16ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe16ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe16ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.795+0000 7efe16ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.797 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.796+0000 7efe167fc640 10 monclient(hunting): handle_auth_done global_id 5308 payload 274 2026-02-17T12:01:12.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.796+0000 7efe167fc640 1 -- 10.20.193.10:0/1539300697 >> v2:10.20.193.10:3300/0 conn(0x7efe18150300 msgr2=0x7efe1806fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:12.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.796+0000 7efe167fc640 1 --2- 10.20.193.10:0/1539300697 >> v2:10.20.193.10:3300/0 conn(0x7efe18150300 0x7efe1806fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.796+0000 7efe167fc640 1 -- 10.20.193.10:0/1539300697 >> v1:10.20.193.10:6789/0 conn(0x7efe18070340 legacy=0x7efe180c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:12.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.796+0000 7efe167fc640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.796+0000 7efe167fc640 1 monclient: found mon.noname-b 2026-02-17T12:01:12.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.796+0000 7efe167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.796+0000 7efe167fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.796+0000 7efe167fc640 1 -- 10.20.193.10:0/1539300697 --> v2:10.20.193.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe18159f60 con 0x7efe181506e0 2026-02-17T12:01:12.798 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.797+0000 7efe167fc640 1 --2- 10.20.193.10:0/1539300697 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 0x7efe1815d060 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efe1806f440 tx=0x7efe0002ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6370fc568fcae2c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 1 -- 10.20.193.10:0/1539300697 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0003c070 con 0x7efe181506e0 2026-02-17T12:01:12.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:12.800 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 10 monclient: dump: 2026-02-17T12:01:12.800 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.800 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 1 -- 10.20.193.10:0/1539300697 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0002fbd0 con 0x7efe181506e0 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 5 monclient: authenticate success, global_id 5308 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 1 -- 10.20.193.10:0/1539300697 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00037440 con 0x7efe181506e0 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe15ffb640 10 monclient: dump: 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:12.801 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 4 set_mon_vals no callback set 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 10 monclient: shutdown 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 1 -- 10.20.193.10:0/1539300697 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 msgr2=0x7efe1815d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 1 --2- 10.20.193.10:0/1539300697 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 0x7efe1815d060 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efe1806f440 tx=0x7efe0002ef60 comp rx=0 tx=0).stop 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 1 -- 10.20.193.10:0/1539300697 shutdown_connections 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 1 --2- 10.20.193.10:0/1539300697 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 0x7efe1815d060 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 1 --2- 10.20.193.10:0/1539300697 >> v2:10.20.193.10:3300/0 conn(0x7efe18150300 0x7efe1806fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 1 -- 10.20.193.10:0/1539300697 >> 10.20.193.10:0/1539300697 conn(0x7efe180cd560 msgr2=0x7efe180cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 1 -- 10.20.193.10:0/1539300697 shutdown_connections 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 1 -- 10.20.193.10:0/1539300697 wait complete. 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.799+0000 7efe1d6fa640 10 monclient: monmap: 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:12.802 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 librados: starting msgr at 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 librados: starting objecter 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 Processor -- start 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 -- start start 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 librados: setting wanted keys 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 librados: calling monclient init 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient: init 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efe18070340 0x7efe180c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient(hunting): picked mon.noname-c con 0x7efe18070340 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe18150300 0x7efe180731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient(hunting): picked mon.noname-a con 0x7efe18150300 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 0x7efe18073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient(hunting): picked mon.noname-b con 0x7efe181506e0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7efe180c4e90 con 0x7efe18150300 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7efe1815a520 con 0x7efe181506e0 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe180c5010 con 0x7efe18070340 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe1d6fa640 10 monclient(hunting): authenticate will time out at 1342.522657s 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe167fc640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe18150300 0x7efe180731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.803 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.800+0000 7efe177fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 0x7efe18073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe177fe640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 0x7efe18073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59850/0 (socket says 10.20.193.10:59850) 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe177fe640 1 -- 10.20.193.10:0/3292628681 learned_addr learned my addr 10.20.193.10:0/3292628681 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe177fe640 10 monclient(hunting): get_auth_request con 0x7efe181506e0 auth_method 0 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe177fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe167fc640 10 monclient(hunting): get_auth_request con 0x7efe18150300 auth_method 0 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe167fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe16ffd640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efe18070340 0x7efe180c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe16ffd640 10 monclient(hunting): get_auth_request con 0x7efe18070340 auth_method 0 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe16ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.804 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe16ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe16ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.801+0000 7efe16ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 10 monclient(hunting): handle_auth_done global_id 5311 payload 824 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 1 -- 10.20.193.10:0/3292628681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efe18070340 msgr2=0x7efe180c0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7efe18070340 0x7efe180c0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 1 -- 10.20.193.10:0/3292628681 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe18150300 msgr2=0x7efe180731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe18150300 0x7efe180731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 1 monclient: found mon.noname-b 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe177fe640 1 -- 10.20.193.10:0/3292628681 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe180bea50 con 0x7efe181506e0 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.802+0000 7efe167fc640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7efe18150300 0x7efe180731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.803+0000 7efe177fe640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 0x7efe18073710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe0800b9c0 tx=0x7efe0800be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.803+0000 7efdf77fe640 10 client.?.objecter ms_handle_connect 0x7efe181506e0 2026-02-17T12:01:12.805 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.803+0000 7efdf77fe640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 1 -- 10.20.193.10:0/3292628681 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0800c790 con 0x7efe181506e0 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 10 monclient: dump: 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 1 -- 10.20.193.10:0/3292628681 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe08010070 con 0x7efe181506e0 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 5 monclient: authenticate success, global_id 5311 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 10 monclient: _renew_subs 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe180bed30 con 0x7efe181506e0 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 1 -- 10.20.193.10:0/3292628681 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0800cb70 con 0x7efe181506e0 2026-02-17T12:01:12.807 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efdf77fe640 10 monclient: dump: 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe157fa640 4 set_mon_vals no callback set 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 10 client.5311.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 10 monclient: _renew_subs 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe180bf2f0 con 0x7efe181506e0 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 1 librados: init done 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 10 client.5311.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 15 client.5311.objecter _session_command_op_assign -1 1 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 20 client.5311.objecter _get_session osd=-1 returning homeless 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 10 client.5311.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.808 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.805+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe180be800 con 0x7efe181506e0 2026-02-17T12:01:12.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.817+0000 7efdf77fe640 1 -- 10.20.193.10:0/3292628681 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7efe08004070 con 0x7efe181506e0 2026-02-17T12:01:12.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.818+0000 7efdf77fe640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efde4078e50 0x7efde407b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.818+0000 7efe16ffd640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efde4078e50 0x7efde407b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.818+0000 7efe16ffd640 10 monclient: get_auth_request con 0x7efde4078e50 auth_method 0 2026-02-17T12:01:12.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.818+0000 7efdf77fe640 10 client.5311.objecter ms_handle_connect 0x7efde4078e50 2026-02-17T12:01:12.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.818+0000 7efe16ffd640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efde4078e50 0x7efde407b310 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009ba0 tx=0x7efe0c009290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 1 -- 10.20.193.10:0/3292628681 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7efe0805dd10 con 0x7efe181506e0 2026-02-17T12:01:12.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 10 client.5311.objecter ms_dispatch2 0x7efe18000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:12.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 3 client.5311.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 3 client.5311.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 10 client.5311.objecter checking command 1 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7efde4081330 0x7efde4083750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 20 client.5311.objecter _get_session s=0x7efde4080c60 osd=15 3 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 20 client.5311.objecter put_session s=0x7efde4080c60 osd=15 3 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 15 client.5311.objecter _session_command_op_remove -1 1 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 20 client.5311.objecter _get_session s=0x7efde4080c60 osd=15 3 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 20 client.5311.objecter get_session s=0x7efde4080c60 osd=15 3 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 15 client.5311.objecter _session_command_op_assign 15 1 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 20 client.5311.objecter put_session s=0x7efde4080c60 osd=15 4 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 10 client.5311.objecter _send_command 1 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 1 -- 10.20.193.10:0/3292628681 --> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe0800ee50 con 0x7efde4081330 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.819+0000 7efdf77fe640 20 client.5311.objecter dump_active .. 0 homeless 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.820+0000 7efdf77fe640 1 -- 10.20.193.10:0/3292628681 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efe0805e0d0 con 0x7efe181506e0 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.820+0000 7efdf77fe640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T12:01:12.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.820+0000 7efe167fc640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7efde4081330 0x7efde4083750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.820+0000 7efe167fc640 10 monclient: get_auth_request con 0x7efde4081330 auth_method 0 2026-02-17T12:01:12.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.822+0000 7efe167fc640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7efde4081330 0x7efde4083750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.822+0000 7efdf77fe640 10 client.5311.objecter ms_handle_connect 0x7efde4081330 2026-02-17T12:01:12.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.834+0000 7efdf77fe640 1 -- 10.20.193.10:0/3292628681 <== osd.15 v2:10.20.193.174:6824/3564494722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7efe0800ee50 con 0x7efde4081330 2026-02-17T12:01:12.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.834+0000 7efdf77fe640 10 client.5311.objecter ms_dispatch2 0x7efe18000b90 command_reply(tid 1: 0 ) 2026-02-17T12:01:12.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.834+0000 7efdf77fe640 10 client.5311.objecter _finish_command 1 = system:0 2026-02-17T12:01:12.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.834+0000 7efdf77fe640 20 client.5311.objecter put_session s=0x7efde4080c60 osd=15 4 2026-02-17T12:01:12.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.834+0000 7efdf77fe640 15 client.5311.objecter _session_command_op_remove 15 1 2026-02-17T12:01:12.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 10 client.5311.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T12:01:12.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 15 client.5311.objecter _session_command_op_assign -1 2 2026-02-17T12:01:12.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 20 client.5311.objecter _get_session s=0x7efde4080c60 osd=15 3 2026-02-17T12:01:12.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 20 client.5311.objecter put_session s=0x7efde4080c60 osd=15 3 2026-02-17T12:01:12.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 20 client.5311.objecter _get_session s=0x7efde4080c60 osd=15 3 2026-02-17T12:01:12.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 15 client.5311.objecter _session_command_op_remove -1 2 2026-02-17T12:01:12.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 20 client.5311.objecter get_session s=0x7efde4080c60 osd=15 3 2026-02-17T12:01:12.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 15 client.5311.objecter _session_command_op_assign 15 2 2026-02-17T12:01:12.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 20 client.5311.objecter put_session s=0x7efde4080c60 osd=15 4 2026-02-17T12:01:12.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 10 client.5311.objecter _send_command 2 2026-02-17T12:01:12.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.840+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 --> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efe180c0d00 con 0x7efde4081330 2026-02-17T12:01:12.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.846+0000 7efdf77fe640 1 -- 10.20.193.10:0/3292628681 <== osd.15 v2:10.20.193.174:6824/3564494722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efe180c0d00 con 0x7efde4081330 2026-02-17T12:01:12.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.846+0000 7efdf77fe640 10 client.5311.objecter ms_dispatch2 0x7efe18000b90 command_reply(tid 2: 0 ) 2026-02-17T12:01:12.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.846+0000 7efdf77fe640 10 client.5311.objecter _finish_command 2 = system:0 2026-02-17T12:01:12.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.846+0000 7efdf77fe640 20 client.5311.objecter put_session s=0x7efde4080c60 osd=15 4 2026-02-17T12:01:12.849 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.846+0000 7efdf77fe640 15 client.5311.objecter _session_command_op_remove 15 2 2026-02-17T12:01:12.849 INFO:teuthology.orchestra.run.trial010.stdout:{ 2026-02-17T12:01:12.849 INFO:teuthology.orchestra.run.trial010.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:01:12.849 INFO:teuthology.orchestra.run.trial010.stdout:} 2026-02-17T12:01:12.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.846+0000 7efe1d6fa640 10 librados: watch_flush enter 2026-02-17T12:01:12.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 10 librados: watch_flush exit 2026-02-17T12:01:12.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 10 client.5311.objecter close_session for osd.15 2026-02-17T12:01:12.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7efde4081330 msgr2=0x7efde4083750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.851 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.174:6824/3564494722,v1:10.20.193.174:6825/3564494722] conn(0x7efde4081330 0x7efde4083750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 20 client.5311.objecter put_session s=0x7efde4080c60 osd=15 1 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 20 client.5311.objecter shutdown clearing up homeless session... 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 10 client.5311.objecter successfully canceled tick 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efde4078e50 msgr2=0x7efde407b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7efde4078e50 0x7efde407b310 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009ba0 tx=0x7efe0c009290 comp rx=0 tx=0).stop 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 10 monclient: shutdown 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 msgr2=0x7efe18073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 --2- 10.20.193.10:0/3292628681 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7efe181506e0 0x7efe18073710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe0800b9c0 tx=0x7efe0800be90 comp rx=0 tx=0).stop 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe177fe640 1 -- 10.20.193.10:0/3292628681 reap_dead start 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 shutdown_connections 2026-02-17T12:01:12.852 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 >> 10.20.193.10:0/3292628681 conn(0x7efe180cd560 msgr2=0x7efe1814e380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 shutdown_connections 2026-02-17T12:01:12.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 -- 10.20.193.10:0/3292628681 wait complete. 2026-02-17T12:01:12.853 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.847+0000 7efe1d6fa640 1 librados: shutdown 2026-02-17T12:01:12.856 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-17T12:01:12.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.923+0000 7f5d465b2640 10 monclient: get_monmap_and_config 2026-02-17T12:01:12.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.923+0000 7f5d465b2640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.925 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.923+0000 7f5d465b2640 10 monclient: monmap: 2026-02-17T12:01:12.925 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.925 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.925 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:12.924731+0000 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:12.924731+0000 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.923+0000 7f5d465b2640 1 Processor -- start 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.923+0000 7f5d465b2640 1 -- start start 2026-02-17T12:01:12.926 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.923+0000 7f5d465b2640 10 monclient: init 2026-02-17T12:01:12.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 10 monclient: _add_conns ranks=[5,1,4,0,2,3] 2026-02-17T12:01:12.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5d40153600 0x7f5d400c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 10 monclient(hunting): picked mon.noname-c con 0x7f5d40153600 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:12.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5d400ca760 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:12.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 1 --2- >> v2:10.20.193.71:3300/0 conn(0x7f5d400c4c60 0x7f5d40159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 10 monclient(hunting): picked mon.noname-b con 0x7f5d400c4c60 addr v2:10.20.193.71:3300/0 2026-02-17T12:01:12.927 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4015a6a0 con 0x7f5d400ca760 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 1 -- --> v2:10.20.193.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5d400c7ad0 con 0x7f5d400c4c60 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5d400c7db0 con 0x7f5d40153600 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.924+0000 7f5d465b2640 10 monclient(hunting): authenticate will time out at 1342.646537s 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d455b0640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f5d40153600 0x7f5d400c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d44daf640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f5d400ca760 0x7f5d400c4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:37840/0 (socket says 10.20.193.10:37840) 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d44daf640 1 -- 10.20.193.10:0/2551972866 learned_addr learned my addr 10.20.193.10:0/2551972866 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d45db1640 1 --2- 10.20.193.10:0/2551972866 >> v2:10.20.193.71:3300/0 conn(0x7f5d400c4c60 0x7f5d40159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d455b0640 10 monclient(hunting): get_auth_request con 0x7f5d40153600 auth_method 0 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d455b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d455b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d455b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d45db1640 10 monclient(hunting): get_auth_request con 0x7f5d400c4c60 auth_method 0 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d45db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d45db1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d45db1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d455b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d455b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d455b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d45db1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d45db1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.928 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.925+0000 7f5d45db1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.926+0000 7f5d455b0640 10 monclient(hunting): handle_auth_done global_id 5315 payload 274 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.926+0000 7f5d455b0640 1 -- 10.20.193.10:0/2551972866 >> v2:10.20.193.71:3300/0 conn(0x7f5d400c4c60 msgr2=0x7f5d40159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.926+0000 7f5d455b0640 1 --2- 10.20.193.10:0/2551972866 >> v2:10.20.193.71:3300/0 conn(0x7f5d400c4c60 0x7f5d40159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.926+0000 7f5d455b0640 1 -- 10.20.193.10:0/2551972866 >> v1:10.20.193.71:6789/0 conn(0x7f5d400ca760 legacy=0x7f5d400c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.926+0000 7f5d455b0640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.926+0000 7f5d455b0640 1 monclient: found mon.noname-c 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.926+0000 7f5d455b0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.926+0000 7f5d455b0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.926+0000 7f5d455b0640 1 -- 10.20.193.10:0/2551972866 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d400c8090 con 0x7f5d40153600 2026-02-17T12:01:12.929 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.927+0000 7f5d455b0640 1 --2- 10.20.193.10:0/2551972866 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5d40153600 0x7f5d400c8e50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5d40069280 tx=0x7f5d3002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ba6beed9203f0a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 1 -- 10.20.193.10:0/2551972866 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3003c070 con 0x7f5d40153600 2026-02-17T12:01:12.935 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 10 monclient: dump: 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.936 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 1 -- 10.20.193.10:0/2551972866 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3002fa60 con 0x7f5d40153600 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 5 monclient: authenticate success, global_id 5315 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 1 -- 10.20.193.10:0/2551972866 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3002fe30 con 0x7f5d40153600 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.937 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d2ffff640 10 monclient: dump: 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.938 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 4 set_mon_vals no callback set 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 10 monclient: shutdown 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 1 -- 10.20.193.10:0/2551972866 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5d40153600 msgr2=0x7f5d400c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 1 --2- 10.20.193.10:0/2551972866 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5d40153600 0x7f5d400c8e50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5d40069280 tx=0x7f5d3002ed50 comp rx=0 tx=0).stop 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 1 -- 10.20.193.10:0/2551972866 shutdown_connections 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 1 --2- 10.20.193.10:0/2551972866 >> v2:10.20.193.71:3300/0 conn(0x7f5d400c4c60 0x7f5d40159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 1 --2- 10.20.193.10:0/2551972866 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5d40153600 0x7f5d400c8e50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 1 -- 10.20.193.10:0/2551972866 >> 10.20.193.10:0/2551972866 conn(0x7f5d400c9bd0 msgr2=0x7f5d400c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 1 -- 10.20.193.10:0/2551972866 shutdown_connections 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.929+0000 7f5d465b2640 1 -- 10.20.193.10:0/2551972866 wait complete. 2026-02-17T12:01:12.939 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.930+0000 7f5d465b2640 10 monclient: build_initial_monmap 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.930+0000 7f5d465b2640 10 monclient: monmap: 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.940 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.930+0000 7f5d465b2640 1 librados: starting msgr at 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.930+0000 7f5d465b2640 1 librados: starting objecter 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.930+0000 7f5d465b2640 1 Processor -- start 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.930+0000 7f5d465b2640 1 -- start start 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.930+0000 7f5d465b2640 1 librados: setting wanted keys 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.930+0000 7f5d465b2640 1 librados: calling monclient init 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.930+0000 7f5d465b2640 10 monclient: init 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5d400c4c60 0x7f5d4006ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient(hunting): picked mon.noname-c con 0x7f5d400c4c60 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5d400ca760 0x7f5d400737d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.941 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient(hunting): picked mon.noname-b con 0x7f5d400ca760 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5d40153600 0x7f5d401f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient(hunting): picked mon.noname-a con 0x7f5d40153600 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f5d400c8930 con 0x7f5d40153600 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d400c8650 con 0x7f5d400ca760 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4015ad00 con 0x7f5d400c4c60 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d465b2640 10 monclient(hunting): authenticate will time out at 1342.653231s 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5d400ca760 0x7f5d400737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d45db1640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5d40153600 0x7f5d401f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.942 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d455b0640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5d400c4c60 0x7f5d4006ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5d400ca760 0x7f5d400737d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:59866/0 (socket says 10.20.193.10:59866) 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 1 -- 10.20.193.10:0/719952088 learned_addr learned my addr 10.20.193.10:0/719952088 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 10 monclient(hunting): get_auth_request con 0x7f5d400ca760 auth_method 0 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d45db1640 10 monclient(hunting): get_auth_request con 0x7f5d40153600 auth_method 0 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d45db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d45db1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d45db1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d455b0640 10 monclient(hunting): get_auth_request con 0x7f5d400c4c60 auth_method 0 2026-02-17T12:01:12.943 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d455b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d455b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d455b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.931+0000 7f5d44daf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.932+0000 7f5d455b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.932+0000 7f5d455b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.932+0000 7f5d455b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.932+0000 7f5d45db1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:12.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.932+0000 7f5d45db1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.932+0000 7f5d45db1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 10 monclient(hunting): handle_auth_done global_id 5320 payload 824 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 1 -- 10.20.193.10:0/719952088 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5d400c4c60 msgr2=0x7f5d4006ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5d400c4c60 0x7f5d4006ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 1 -- 10.20.193.10:0/719952088 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5d40153600 msgr2=0x7f5d401f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5d40153600 0x7f5d401f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 10 monclient: _finish_hunting 0 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 1 monclient: found mon.noname-b 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:12.945 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.946 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.933+0000 7f5d44daf640 1 -- 10.20.193.10:0/719952088 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d401f79b0 con 0x7f5d400ca760 2026-02-17T12:01:12.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.934+0000 7f5d44daf640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5d400ca760 0x7f5d400737d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400c4d0 tx=0x7f5d3400c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.934+0000 7f5d2dffb640 10 client.?.objecter ms_handle_connect 0x7f5d400ca760 2026-02-17T12:01:12.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.934+0000 7f5d2dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:12.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 1 -- 10.20.193.10:0/719952088 <== mon.1 v2:10.20.193.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34017070 con 0x7f5d400ca760 2026-02-17T12:01:12.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:01:12.949 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 10 monclient: dump: 2026-02-17T12:01:12.949 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:12.950 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 1 -- 10.20.193.10:0/719952088 <== mon.1 v2:10.20.193.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d34005de0 con 0x7f5d400ca760 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 1 -- 10.20.193.10:0/719952088 <== mon.1 v2:10.20.193.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34007290 con 0x7f5d400ca760 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2dffb640 10 monclient: dump: 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:12.951 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d2f7fe640 4 set_mon_vals no callback set 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 5 monclient: authenticate success, global_id 5320 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 10 monclient: _renew_subs 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d401f4060 con 0x7f5d400ca760 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 10 client.5320.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 10 monclient: _renew_subs 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d401578b0 con 0x7f5d400ca760 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 1 librados: init done 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.952 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:12.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.71:3300/0 2026-02-17T12:01:12.953 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.936+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d401539e0 con 0x7f5d400ca760 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.948+0000 7f5d2dffb640 1 -- 10.20.193.10:0/719952088 <== mon.1 v2:10.20.193.71:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f5d34007430 con 0x7f5d400ca760 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.948+0000 7f5d2dffb640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d10078e00 0x7f5d1007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.949+0000 7f5d455b0640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d10078e00 0x7f5d1007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.949+0000 7f5d455b0640 10 monclient: get_auth_request con 0x7f5d10078e00 auth_method 0 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.949+0000 7f5d455b0640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d10078e00 0x7f5d1007b2c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5d30039000 tx=0x7f5d30033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.949+0000 7f5d2dffb640 10 client.5320.objecter ms_handle_connect 0x7f5d10078e00 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.950+0000 7f5d2dffb640 1 -- 10.20.193.10:0/719952088 <== mon.1 v2:10.20.193.71:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5d34007750 con 0x7f5d400ca760 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.950+0000 7f5d2dffb640 10 client.5320.objecter ms_dispatch2 0x7f5d40000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.950+0000 7f5d2dffb640 3 client.5320.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:12.954 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.950+0000 7f5d2dffb640 3 client.5320.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:12.955 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:12.950+0000 7f5d2dffb640 20 client.5320.objecter dump_active .. 0 homeless 2026-02-17T12:01:13.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.053+0000 7f5d2dffb640 1 -- 10.20.193.10:0/719952088 <== mon.1 v2:10.20.193.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5d34021020 con 0x7f5d400ca760 2026-02-17T12:01:13.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.053+0000 7f5d2dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:13.055 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.053+0000 7f5d2dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:13.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.136+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7f5d40151f90 con 0x7f5d10078e00 2026-02-17T12:01:13.138 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.136+0000 7f5d2dffb640 1 -- 10.20.193.10:0/719952088 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f5d40151f90 con 0x7f5d10078e00 2026-02-17T12:01:13.138 INFO:teuthology.orchestra.run.trial010.stderr:instructed osd(s) 15 to deep-scrub 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 10 librados: watch_flush enter 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 10 librados: watch_flush exit 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 20 client.5320.objecter shutdown clearing up homeless session... 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 10 client.5320.objecter successfully canceled tick 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d10078e00 msgr2=0x7f5d1007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d10078e00 0x7f5d1007b2c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5d30039000 tx=0x7f5d30033000 comp rx=0 tx=0).stop 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 10 monclient: shutdown 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5d400ca760 msgr2=0x7f5d400737d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5d400ca760 0x7f5d400737d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400c4d0 tx=0x7f5d3400c9a0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 shutdown_connections 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f5d10078e00 0x7f5d1007b2c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f5d40153600 0x7f5d401f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f5d400ca760 0x7f5d400737d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 --2- 10.20.193.10:0/719952088 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f5d400c4c60 0x7f5d4006ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 >> 10.20.193.10:0/719952088 conn(0x7f5d400c9bd0 msgr2=0x7f5d4015b000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 shutdown_connections 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 -- 10.20.193.10:0/719952088 wait complete. 2026-02-17T12:01:13.139 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.137+0000 7f5d465b2640 1 librados: shutdown 2026-02-17T12:01:13.147 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:01:13.216 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.214+0000 7fc253a91640 10 monclient: get_monmap_and_config 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.214+0000 7fc253a91640 10 monclient: build_initial_monmap 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.214+0000 7fc253a91640 10 monclient: monmap: 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:13.215955+0000 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:13.215955+0000 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:13.217 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:13.218 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:13.218 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:13.218 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:13.218 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:13.218 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 1 Processor -- start 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 1 -- start start 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 10 monclient: init 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 10 monclient: _add_conns ranks=[2,1,0,5,4,3] 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc24c0c3e80 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc24c15f920 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc24c06d1b0 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c0c7c80 con 0x7fc24c06d1b0 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c0c7f60 con 0x7fc24c15f920 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c0c8240 con 0x7fc24c0c3e80 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.215+0000 7fc253a91640 10 monclient(hunting): authenticate will time out at 1342.937809s 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.216+0000 7fc251005640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7fc24c15f920 0x7fc24c0730a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:34806/0 (socket says 10.20.193.10:34806) 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.216+0000 7fc251005640 1 -- 10.20.193.10:0/1484960015 learned_addr learned my addr 10.20.193.10:0/1484960015 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613061357 0 0) 0x7fc24c0c8240 con 0x7fc24c0c3e80 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): _negotiate 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:13.219 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): my global_id is 5321 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc234003620 con 0x7fc24c0c3e80 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 <== mon.0 v1:10.20.193.10:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874094681 0 0) 0x7fc24c0c7c80 con 0x7fc24c06d1b0 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): _negotiate 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): my global_id is 5253 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 --> v1:10.20.193.10:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc24c0c8240 con 0x7fc24c06d1b0 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920721366 0 0) 0x7fc24c0c7f60 con 0x7fc24c15f920 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): _negotiate 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 10 monclient(hunting): my global_id is 5323 2026-02-17T12:01:13.220 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.217+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc24c0c7c80 con 0x7fc24c15f920 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 <== mon.1 v1:10.20.193.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2195222150 0 0) 0x7fc24c0c7c80 con 0x7fc24c15f920 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 >> v1:10.20.193.153:6789/0 conn(0x7fc24c0c3e80 legacy=0x7fc24c15f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 >> v1:10.20.193.10:6789/0 conn(0x7fc24c06d1b0 legacy=0x7fc24c0737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient: _finish_hunting 0 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 monclient: found mon.noname-b-legacy 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.71:6789/0 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 --> v1:10.20.193.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c0c8520 con 0x7fc24c15f920 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient: _finish_auth 0 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient: _check_auth_tickets 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc253a91640 5 monclient: authenticate success, global_id 5323 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc253a91640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 <== mon.1 v1:10.20.193.71:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2798500735 0 0) 0x7fc240002e20 con 0x7fc24c15f920 2026-02-17T12:01:13.221 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient: dump: 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] but i'm connected to v1:10.20.193.71:6789/0, reconnecting 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 >> v1:10.20.193.71:6789/0 conn(0x7fc24c15f920 legacy=0x7fc24c0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc234003fe0 0x7fc234004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient(hunting): picked mon.c con 0x7fc234003fe0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc234004e40 0x7fc2340052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient(hunting): picked mon.a con 0x7fc234004e40 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234009ab0 0x7fc23400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient(hunting): picked mon.b con 0x7fc234009ab0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc23400c570 con 0x7fc234004e40 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc23400c6f0 con 0x7fc234009ab0 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc23400c8f0 con 0x7fc234003fe0 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc250804640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:01:13.222 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.219+0000 7fc253a91640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251806640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc234003fe0 0x7fc234004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251806640 10 monclient(hunting): get_auth_request con 0x7fc234003fe0 auth_method 0 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251806640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251806640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251806640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251005640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc234004e40 0x7fc2340052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc252007640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234009ab0 0x7fc23400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251806640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251806640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251806640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251005640 10 monclient(hunting): get_auth_request con 0x7fc234004e40 auth_method 0 2026-02-17T12:01:13.223 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251005640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251005640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251005640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc252007640 10 monclient(hunting): get_auth_request con 0x7fc234009ab0 auth_method 0 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc252007640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc252007640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc252007640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251005640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251005640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc251005640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc252007640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc252007640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.220+0000 7fc252007640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 10 monclient(hunting): handle_auth_done global_id 5323 payload 293 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 1 -- 10.20.193.10:0/1484960015 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234009ab0 msgr2=0x7fc23400bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234009ab0 0x7fc23400bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 1 -- 10.20.193.10:0/1484960015 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc234004e40 msgr2=0x7fc2340052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc234004e40 0x7fc2340052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 10 monclient: _finish_hunting 0 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 1 monclient: found mon.c 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc252007640 1 -- 10.20.193.10:0/1484960015 reap_dead start 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 1 -- 10.20.193.10:0/1484960015 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c0c7c80 con 0x7fc234003fe0 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 10 monclient: _finish_auth 0 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 10 monclient: _check_auth_tickets 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.221+0000 7fc251806640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:13.224 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.222+0000 7fc251806640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc234003fe0 0x7fc234004900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc23c003290 tx=0x7fc23c02ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5f3b1fd8c8997ba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.223+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c002eb0 con 0x7fc234003fe0 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.223+0000 7fc250804640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.223+0000 7fc250804640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.223+0000 7fc250804640 10 monclient: dump: 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:13.225 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.223+0000 7fc253a91640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23c0052d0 con 0x7fc234003fe0 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc250804640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc250804640 1 -- 10.20.193.10:0/1484960015 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c02f7a0 con 0x7fc234003fe0 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc250804640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc250804640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc250804640 10 monclient: dump: 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 4 set_mon_vals no callback set 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 10 monclient: shutdown 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 1 -- 10.20.193.10:0/1484960015 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc234003fe0 msgr2=0x7fc234004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc234003fe0 0x7fc234004900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc23c003290 tx=0x7fc23c02ef40 comp rx=0 tx=0).stop 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 1 -- 10.20.193.10:0/1484960015 shutdown_connections 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 1 --2- 10.20.193.10:0/1484960015 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc234003fe0 0x7fc234004900 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.226 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 1 -- 10.20.193.10:0/1484960015 >> 10.20.193.10:0/1484960015 conn(0x7fc24c0c9d80 msgr2=0x7fc24c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:13.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 1 -- 10.20.193.10:0/1484960015 shutdown_connections 2026-02-17T12:01:13.227 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 1 -- 10.20.193.10:0/1484960015 wait complete. 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 10 monclient: build_initial_monmap 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.224+0000 7fc253a91640 10 monclient: monmap: 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 librados: starting msgr at 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 librados: starting objecter 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 Processor -- start 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 -- start start 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 librados: setting wanted keys 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 librados: calling monclient init 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient: init 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234003fe0 0x7fc24c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient(hunting): picked mon.noname-b con 0x7fc234003fe0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc24c1f3880 0x7fc24c0cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient(hunting): picked mon.noname-c con 0x7fc24c1f3880 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc24c0ccb30 0x7fc24c15c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient(hunting): picked mon.noname-a con 0x7fc24c0ccb30 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c0c8ae0 con 0x7fc24c0ccb30 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c0c8e50 con 0x7fc234003fe0 2026-02-17T12:01:13.228 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c070d90 con 0x7fc24c1f3880 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc253a91640 10 monclient(hunting): authenticate will time out at 1342.947596s 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc251806640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234003fe0 0x7fc24c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc252007640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc24c0ccb30 0x7fc24c15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc251005640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc24c1f3880 0x7fc24c0cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc251806640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234003fe0 0x7fc24c15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.71:3300/0 says I am v2:10.20.193.10:51338/0 (socket says 10.20.193.10:51338) 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc251806640 1 -- 10.20.193.10:0/2200662114 learned_addr learned my addr 10.20.193.10:0/2200662114 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc251806640 10 monclient(hunting): get_auth_request con 0x7fc234003fe0 auth_method 0 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc251806640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc251806640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc251806640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc252007640 10 monclient(hunting): get_auth_request con 0x7fc24c0ccb30 auth_method 0 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc252007640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc252007640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.225+0000 7fc252007640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251005640 10 monclient(hunting): get_auth_request con 0x7fc24c1f3880 auth_method 0 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251005640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251005640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251005640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251806640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251806640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251806640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc252007640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc252007640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc252007640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251005640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251005640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:13.229 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.226+0000 7fc251005640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 10 monclient(hunting): handle_auth_done global_id 5324 payload 824 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 1 -- 10.20.193.10:0/2200662114 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234003fe0 msgr2=0x7fc24c15a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234003fe0 0x7fc24c15a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 1 -- 10.20.193.10:0/2200662114 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc24c0ccb30 msgr2=0x7fc24c15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc24c0ccb30 0x7fc24c15c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 10 monclient: _finish_hunting 0 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 1 monclient: found mon.noname-c 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251005640 1 -- 10.20.193.10:0/2200662114 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c1f4780 con 0x7fc24c1f3880 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.227+0000 7fc251806640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234003fe0 0x7fc24c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.228+0000 7fc251005640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc24c1f3880 0x7fc24c0cc5f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc24c064280 tx=0x7fc240007730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.228+0000 7fc23a7fc640 10 client.?.objecter ms_handle_connect 0x7fc24c1f3880 2026-02-17T12:01:13.230 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.228+0000 7fc23a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 1 -- 10.20.193.10:0/2200662114 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240007870 con 0x7fc24c1f3880 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 10 monclient: dump: 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 1 -- 10.20.193.10:0/2200662114 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc240018070 con 0x7fc24c1f3880 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 5 monclient: authenticate success, global_id 5324 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 10 monclient: _renew_subs 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24c159bc0 con 0x7fc24c1f3880 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 1 -- 10.20.193.10:0/2200662114 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24000fbd0 con 0x7fc24c1f3880 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23bfff640 4 set_mon_vals no callback set 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc23a7fc640 10 monclient: dump: 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:13.232 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 10 client.5324.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 10 monclient: _renew_subs 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24c1f44a0 con 0x7fc24c1f3880 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 1 librados: init done 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:13.233 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.230+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24c0c4260 con 0x7fc24c1f3880 2026-02-17T12:01:13.242 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.241+0000 7fc23a7fc640 1 -- 10.20.193.10:0/2200662114 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7fc24001d460 con 0x7fc24c1f3880 2026-02-17T12:01:13.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.241+0000 7fc23a7fc640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc21c078e80 0x7fc21c07b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:13.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.241+0000 7fc251806640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc21c078e80 0x7fc21c07b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:13.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.241+0000 7fc251806640 10 monclient: get_auth_request con 0x7fc21c078e80 auth_method 0 2026-02-17T12:01:13.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.242+0000 7fc23a7fc640 10 client.5324.objecter ms_handle_connect 0x7fc21c078e80 2026-02-17T12:01:13.243 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.242+0000 7fc251806640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc21c078e80 0x7fc21c07b340 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc23c003290 tx=0x7fc23c033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:13.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.243+0000 7fc23a7fc640 1 -- 10.20.193.10:0/2200662114 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc24000fd70 con 0x7fc24c1f3880 2026-02-17T12:01:13.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.243+0000 7fc23a7fc640 10 client.5324.objecter ms_dispatch2 0x7fc24c000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:13.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.243+0000 7fc23a7fc640 3 client.5324.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:13.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.243+0000 7fc23a7fc640 3 client.5324.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:13.244 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.243+0000 7fc23a7fc640 20 client.5324.objecter dump_active .. 0 homeless 2026-02-17T12:01:13.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.347+0000 7fc23a7fc640 1 -- 10.20.193.10:0/2200662114 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc240062270 con 0x7fc24c1f3880 2026-02-17T12:01:13.348 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.347+0000 7fc23a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:13.349 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.347+0000 7fc23a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:13.430 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.428+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc24c0cc0a0 con 0x7fc21c078e80 2026-02-17T12:01:13.432 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.429+0000 7fc23a7fc640 1 -- 10.20.193.10:0/2200662114 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44313 (secure 0 0 0) 0x7fc24c0cc0a0 con 0x7fc21c078e80 2026-02-17T12:01:13.432 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:01:13.434 INFO:teuthology.orchestra.run.trial010.stderr:dumped all 2026-02-17T12:01:13.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 10 librados: watch_flush enter 2026-02-17T12:01:13.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 10 librados: watch_flush exit 2026-02-17T12:01:13.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 20 client.5324.objecter shutdown clearing up homeless session... 2026-02-17T12:01:13.434 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 10 client.5324.objecter successfully canceled tick 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc21c078e80 msgr2=0x7fc21c07b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc21c078e80 0x7fc21c07b340 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc23c003290 tx=0x7fc23c033000 comp rx=0 tx=0).stop 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 10 monclient: shutdown 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc24c1f3880 msgr2=0x7fc24c0cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc24c1f3880 0x7fc24c0cc5f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc24c064280 tx=0x7fc240007730 comp rx=0 tx=0).stop 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 shutdown_connections 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7fc21c078e80 0x7fc21c07b340 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7fc24c0ccb30 0x7fc24c15c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc24c1f3880 0x7fc24c0cc5f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 --2- 10.20.193.10:0/2200662114 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7fc234003fe0 0x7fc24c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:13.435 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 >> 10.20.193.10:0/2200662114 conn(0x7fc24c0c9d80 msgr2=0x7fc24c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:13.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 shutdown_connections 2026-02-17T12:01:13.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 -- 10.20.193.10:0/2200662114 wait complete. 2026-02-17T12:01:13.436 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:13.430+0000 7fc253a91640 1 librados: shutdown 2026-02-17T12:01:13.440 INFO:teuthology.orchestra.run.trial010.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2026-02-17T12:01:11.811258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438228,"kb_used_data":6808,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511212,"statfs":{"total":1546188226560,"available":1545739481088,"internally_reserved":0,"allocated":6971392,"data_stored":3471254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25500,"internal_metadata":441424996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":84,"apply_latency_ms":84,"commit_latency_ns":84000000,"apply_latency_ns":84000000},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001696"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:07.916577+0000","last_change":"2026-02-17T11:55:57.532493+0000","last_active":"2026-02-17T11:58:07.916577+0000","last_peered":"2026-02-17T11:58:07.916577+0000","last_clean":"2026-02-17T11:58:07.916577+0000","last_became_active":"2026-02-17T11:55:55.658594+0000","last_became_peered":"2026-02-17T11:55:55.658594+0000","last_unstale":"2026-02-17T11:58:07.916577+0000","last_undegraded":"2026-02-17T11:58:07.916577+0000","last_fullsized":"2026-02-17T11:58:07.916577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:26:38.378508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042345316000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:07.933381+0000","last_change":"2026-02-17T12:01:07.938122+0000","last_active":"2026-02-17T12:01:07.933381+0000","last_peered":"2026-02-17T12:01:07.933381+0000","last_clean":"2026-02-17T12:01:07.933381+0000","last_became_active":"2026-02-17T11:55:55.781344+0000","last_became_peered":"2026-02-17T11:55:55.781344+0000","last_unstale":"2026-02-17T12:01:07.933381+0000","last_undegraded":"2026-02-17T12:01:07.933381+0000","last_fullsized":"2026-02-17T12:01:07.933381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:01:07.930319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:01:07.930319+0000","last_clean_scrub_stamp":"2026-02-17T12:01:07.930319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:50:58.995945+0000","scrub_duration":196,"objects_trimmed":0,"snaptrim_duration":0.037397883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:02.969298+0000","last_change":"2026-02-17T11:55:57.503086+0000","last_active":"2026-02-17T11:58:02.969298+0000","last_peered":"2026-02-17T11:58:02.969298+0000","last_clean":"2026-02-17T11:58:02.969298+0000","last_became_active":"2026-02-17T11:55:55.451241+0000","last_became_peered":"2026-02-17T11:55:55.451241+0000","last_unstale":"2026-02-17T11:58:02.969298+0000","last_undegraded":"2026-02-17T11:58:02.969298+0000","last_fullsized":"2026-02-17T11:58:02.969298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:35:03.971846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037882574000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:07.719252+0000","last_change":"2026-02-17T12:01:07.723920+0000","last_active":"2026-02-17T12:01:07.719252+0000","last_peered":"2026-02-17T12:01:07.719252+0000","last_clean":"2026-02-17T12:01:07.719252+0000","last_became_active":"2026-02-17T11:55:55.648482+0000","last_became_peered":"2026-02-17T11:55:55.648482+0000","last_unstale":"2026-02-17T12:01:07.719252+0000","last_undegraded":"2026-02-17T12:01:07.719252+0000","last_fullsized":"2026-02-17T12:01:07.719252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:01:07.715770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:01:07.715770+0000","last_clean_scrub_stamp":"2026-02-17T12:01:07.715770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:11:37.696516+0000","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0.037738756999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:02.524969+0000","last_change":"2026-02-17T11:55:57.569398+0000","last_active":"2026-02-17T11:58:02.524969+0000","last_peered":"2026-02-17T11:58:02.524969+0000","last_clean":"2026-02-17T11:58:02.524969+0000","last_became_active":"2026-02-17T11:55:55.640831+0000","last_became_peered":"2026-02-17T11:55:55.640831+0000","last_unstale":"2026-02-17T11:58:02.524969+0000","last_undegraded":"2026-02-17T11:58:02.524969+0000","last_fullsized":"2026-02-17T11:58:02.524969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:53:48.237641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056907020000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,12],"acting":[2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:00.462505+0000","last_change":"2026-02-17T11:55:57.578304+0000","last_active":"2026-02-17T11:58:00.462505+0000","last_peered":"2026-02-17T11:58:00.462505+0000","last_clean":"2026-02-17T11:58:00.462505+0000","last_became_active":"2026-02-17T11:55:55.453952+0000","last_became_peered":"2026-02-17T11:55:55.453952+0000","last_unstale":"2026-02-17T11:58:00.462505+0000","last_undegraded":"2026-02-17T11:58:00.462505+0000","last_fullsized":"2026-02-17T11:58:00.462505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:34:50.379105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034638460000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:57:57.522955+0000","last_change":"2026-02-17T11:55:57.561696+0000","last_active":"2026-02-17T11:57:57.522955+0000","last_peered":"2026-02-17T11:57:57.522955+0000","last_clean":"2026-02-17T11:57:57.522955+0000","last_became_active":"2026-02-17T11:55:55.508618+0000","last_became_peered":"2026-02-17T11:55:55.508618+0000","last_unstale":"2026-02-17T11:57:57.522955+0000","last_undegraded":"2026-02-17T11:57:57.522955+0000","last_fullsized":"2026-02-17T11:57:57.522955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:29:21.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055960348,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"32'1","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:58:03.767027+0000","last_change":"2026-02-17T11:55:57.580322+0000","last_active":"2026-02-17T11:58:03.767027+0000","last_peered":"2026-02-17T11:58:03.767027+0000","last_clean":"2026-02-17T11:58:03.767027+0000","last_became_active":"2026-02-17T11:55:55.408633+0000","last_became_peered":"2026-02-17T11:55:55.408633+0000","last_unstale":"2026-02-17T11:58:03.767027+0000","last_undegraded":"2026-02-17T11:58:03.767027+0000","last_fullsized":"2026-02-17T11:58:03.767027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:54.164155+0000","last_clean_scrub_stamp":"2026-02-17T11:55:54.164155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:37:04.068558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027166316999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"29'32","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:57:43.759185+0000","last_change":"2026-02-17T11:55:50.153568+0000","last_active":"2026-02-17T11:57:43.759185+0000","last_peered":"2026-02-17T11:57:43.759185+0000","last_clean":"2026-02-17T11:57:43.759185+0000","last_became_active":"2026-02-17T11:55:49.807188+0000","last_became_peered":"2026-02-17T11:55:49.807188+0000","last_unstale":"2026-02-17T11:57:43.759185+0000","last_undegraded":"2026-02-17T11:57:43.759185+0000","last_fullsized":"2026-02-17T11:57:43.759185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:55:42.183447+0000","last_clean_scrub_stamp":"2026-02-17T11:55:42.183447+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:38:58.356098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[2,4,5,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":28,"seq":120259084354,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,5,6,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":28,"seq":120259084356,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313286,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280581,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":22,"seq":94489280581,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,6,7,8,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":25,"seq":107374182468,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,4,5,6,7,8,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":24,"seq":103079215172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":24,"seq":103079215172,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[2,4,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":27,"seq":115964117061,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,5,6,7,8,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,3,5,6,7,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":27,"seq":115964117062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":27,"seq":115964117064,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":27,"seq":115964117061,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,2,4,6,7,8,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":27,"seq":115964117063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,2,3,4,5,7,9,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:01:13.448 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-17T11:55:54.164155+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=55, tm_sec=54, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=1, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:01:13.448 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-17T11:55:54.164155+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=55, tm_sec=54, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=1, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:01:13.448 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-17T11:55:54.164155+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=55, tm_sec=54, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=1, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:01:13.448 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-17T11:55:54.164155+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=55, tm_sec=54, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=1, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:01:13.449 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-17T11:55:54.164155+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=55, tm_sec=54, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=1, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:01:13.449 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-17T11:55:54.164155+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=55, tm_sec=54, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=1, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:01:13.449 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T11:55:42.183447+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=55, tm_sec=42, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=1, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:01:13.449 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T12:01:15.536 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:07:32.705 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:15.538 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:07:32.706 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:15.547 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:07:32.716 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:15.565 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:07:32.728 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:15.566 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:07:32.729 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:15.569 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:07:32.697 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:15.569 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:07:32.698 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:15.575 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:07:32.738 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:15.578 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:07:32.707 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:33.450 DEBUG:teuthology.orchestra.run.trial010:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:01:33.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.517+0000 7f9007753640 10 monclient: get_monmap_and_config 2026-02-17T12:01:33.521 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.517+0000 7f9007753640 10 monclient: build_initial_monmap 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.517+0000 7f9007753640 10 monclient: monmap: 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:33.518810+0000 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:33.518810+0000 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:33.522 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.517+0000 7f9007753640 1 Processor -- start 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 1 -- start start 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 10 monclient: init 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 10 monclient: _add_conns ranks=[2,5,1,4,3,0] 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f900015d220 addr v1:10.20.193.153:6789/0 2026-02-17T12:01:33.523 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f90000c92f0 0x7f900015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 10 monclient(hunting): picked mon.noname-c con 0x7f90000c92f0 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9000074920 addr v1:10.20.193.71:6789/0 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 1 -- --> v1:10.20.193.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90000c58a0 con 0x7f9000074920 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 1 -- --> v1:10.20.193.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90000c55c0 con 0x7f900015d220 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f90000c7e20 con 0x7f90000c92f0 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.518+0000 7f9007753640 10 monclient(hunting): authenticate will time out at 1363.240548s 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.519+0000 7f9005cc9640 1 --1- >> v1:10.20.193.71:6789/0 conn(0x7f9000074920 0x7f9000153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.71:6789/0 says I am v1:10.20.193.10:34606/0 (socket says 10.20.193.10:34606) 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.519+0000 7f9005cc9640 1 -- 10.20.193.10:0/853159548 learned_addr learned my addr 10.20.193.10:0/853159548 (peer_addr_for_me v1:10.20.193.10:0/0) 2026-02-17T12:01:33.524 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.519+0000 7f9004cc7640 1 --2- 10.20.193.10:0/853159548 >> v2:10.20.193.153:3300/0 conn(0x7f90000c92f0 0x7f900015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.519+0000 7f9004cc7640 10 monclient(hunting): get_auth_request con 0x7f90000c92f0 auth_method 0 2026-02-17T12:01:33.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.519+0000 7f9004cc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.519+0000 7f9004cc7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.525 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.519+0000 7f9004cc7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.520+0000 7f9004cc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.526 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.520+0000 7f9004cc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.520+0000 7f9004cc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.520+0000 7f8feffff640 1 -- 10.20.193.10:0/853159548 <== mon.1 v1:10.20.193.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983546601 0 0) 0x7f90000c58a0 con 0x7f9000074920 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.520+0000 7f8feffff640 10 monclient(hunting): _negotiate 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.520+0000 7f8feffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.520+0000 7f8feffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.520+0000 7f8feffff640 10 monclient(hunting): my global_id is 5329 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.520+0000 7f8feffff640 1 -- 10.20.193.10:0/853159548 --> v1:10.20.193.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fe8003620 con 0x7f9000074920 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.521+0000 7f8feffff640 1 -- 10.20.193.10:0/853159548 <== mon.2 v1:10.20.193.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772887913 0 0) 0x7f90000c55c0 con 0x7f900015d220 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.521+0000 7f8feffff640 10 monclient(hunting): _negotiate 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.521+0000 7f8feffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.527 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.521+0000 7f8feffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.521+0000 7f8feffff640 10 monclient(hunting): my global_id is 5330 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.521+0000 7f8feffff640 1 -- 10.20.193.10:0/853159548 --> v1:10.20.193.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90000c58a0 con 0x7f900015d220 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.522+0000 7f9004cc7640 10 monclient(hunting): handle_auth_done global_id 5327 payload 274 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.522+0000 7f9004cc7640 1 -- 10.20.193.10:0/853159548 >> v1:10.20.193.153:6789/0 conn(0x7f900015d220 legacy=0x7f90000c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.522+0000 7f9004cc7640 1 -- 10.20.193.10:0/853159548 >> v1:10.20.193.71:6789/0 conn(0x7f9000074920 legacy=0x7f9000153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.522+0000 7f9004cc7640 10 monclient: _finish_hunting 0 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.522+0000 7f9004cc7640 1 monclient: found mon.noname-c 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.522+0000 7f9004cc7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.522+0000 7f9004cc7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.522+0000 7f9004cc7640 1 -- 10.20.193.10:0/853159548 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90000c8100 con 0x7f90000c92f0 2026-02-17T12:01:33.528 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.525+0000 7f9004cc7640 1 --2- 10.20.193.10:0/853159548 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90000c92f0 0x7f900015d600 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40098d0 tx=0x7f8ff402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a083230180d5dd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 1 -- 10.20.193.10:0/853159548 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff403c070 con 0x7f90000c92f0 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 10 monclient: dump: 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.530 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 10 monclient: _finish_auth 0 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 1 -- 10.20.193.10:0/853159548 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff402fba0 con 0x7f90000c92f0 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f9007753640 5 monclient: authenticate success, global_id 5327 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 1 -- 10.20.193.10:0/853159548 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4037440 con 0x7f90000c92f0 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f9007753640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f9007753640 4 set_mon_vals no callback set 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.527+0000 7f8feffff640 10 monclient: dump: 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 10 monclient: shutdown 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 1 -- 10.20.193.10:0/853159548 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90000c92f0 msgr2=0x7f900015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 1 --2- 10.20.193.10:0/853159548 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90000c92f0 0x7f900015d600 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40098d0 tx=0x7f8ff402eed0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 1 -- 10.20.193.10:0/853159548 shutdown_connections 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 1 --2- 10.20.193.10:0/853159548 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90000c92f0 0x7f900015d600 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 1 -- 10.20.193.10:0/853159548 >> 10.20.193.10:0/853159548 conn(0x7f90000c9d80 msgr2=0x7f90000ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 1 -- 10.20.193.10:0/853159548 shutdown_connections 2026-02-17T12:01:33.531 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 1 -- 10.20.193.10:0/853159548 wait complete. 2026-02-17T12:01:33.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 10 monclient: build_initial_monmap 2026-02-17T12:01:33.533 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.528+0000 7f9007753640 10 monclient: monmap: 2026-02-17T12:01:33.533 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:33.533 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:33.533 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:33.533 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:33.533 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:33.533 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 librados: starting msgr at 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 librados: starting objecter 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 Processor -- start 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 -- start start 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 librados: setting wanted keys 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 librados: calling monclient init 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient: init 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9000074920 0x7f9000145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient(hunting): picked mon.noname-a con 0x7f9000074920 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f90000c92f0 0x7f900015bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient(hunting): picked mon.noname-b con 0x7f90000c92f0 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f900015d220 0x7f900015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient(hunting): picked mon.noname-c con 0x7f900015d220 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f9000074d70 con 0x7f9000074920 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f90000c86c0 con 0x7f90000c92f0 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9000153d60 con 0x7f900015d220 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9007753640 10 monclient(hunting): authenticate will time out at 1363.251571s 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9004cc7640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f90000c92f0 0x7f900015bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.529+0000 7f9005cc9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f900015d220 0x7f900015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f90054c8640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9000074920 0x7f9000145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.534 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9005cc9640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f900015d220 0x7f900015c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36868/0 (socket says 10.20.193.10:36868) 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9005cc9640 1 -- 10.20.193.10:0/3471787386 learned_addr learned my addr 10.20.193.10:0/3471787386 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9005cc9640 10 monclient(hunting): get_auth_request con 0x7f900015d220 auth_method 0 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9005cc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9005cc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9005cc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9004cc7640 10 monclient(hunting): get_auth_request con 0x7f90000c92f0 auth_method 0 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9004cc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9004cc7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9004cc7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f90054c8640 10 monclient(hunting): get_auth_request con 0x7f9000074920 auth_method 0 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f90054c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f90054c8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f90054c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9005cc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9005cc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9005cc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9004cc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9004cc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f9004cc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f90054c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f90054c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.530+0000 7f90054c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 10 monclient(hunting): handle_auth_done global_id 5333 payload 824 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 1 -- 10.20.193.10:0/3471787386 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f90000c92f0 msgr2=0x7f900015bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f90000c92f0 0x7f900015bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 1 -- 10.20.193.10:0/3471787386 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9000074920 msgr2=0x7f9000145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9000074920 0x7f9000145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 10 monclient: _finish_hunting 0 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 1 monclient: found mon.noname-c 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.535 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.531+0000 7f9005cc9640 1 -- 10.20.193.10:0/3471787386 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90001f4f00 con 0x7f900015d220 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.532+0000 7f9005cc9640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f900015d220 0x7f900015c4a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00cb40 tx=0x7f8ffc00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.532+0000 7f8fedffb640 10 client.?.objecter ms_handle_connect 0x7f900015d220 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.532+0000 7f8fedffb640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f8fedffb640 1 -- 10.20.193.10:0/3471787386 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00ad50 con 0x7f900015d220 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f8fedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f8fedffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f8fedffb640 10 monclient: dump: 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.536 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f8fedffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f8fedffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f8fedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f9007753640 5 monclient: authenticate success, global_id 5333 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f9007753640 10 monclient: _renew_subs 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f9007753640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90001f4380 con 0x7f900015d220 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f9007753640 10 client.5333.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f9007753640 10 monclient: _renew_subs 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f9007753640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90001f4940 con 0x7f900015d220 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.533+0000 7f9007753640 1 librados: init done 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f8fedffb640 1 -- 10.20.193.10:0/3471787386 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ffc01b400 con 0x7f900015d220 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f8fedffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f8fedffb640 1 -- 10.20.193.10:0/3471787386 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc01b830 con 0x7f900015d220 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f8fedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f8fedffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f8fef7fe640 4 set_mon_vals no callback set 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f8fedffb640 10 monclient: dump: 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:33.537 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:33.538 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f9007753640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:33.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f9007753640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:33.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f9007753640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.538 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.534+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f900015d600 con 0x7f900015d220 2026-02-17T12:01:33.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.545+0000 7f8fedffb640 1 -- 10.20.193.10:0/3471787386 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f8ffc025430 con 0x7f900015d220 2026-02-17T12:01:33.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.546+0000 7f8fedffb640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fd0078e00 0x7f8fd007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.546+0000 7f90054c8640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fd0078e00 0x7f8fd007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.546+0000 7f90054c8640 10 monclient: get_auth_request con 0x7f8fd0078e00 auth_method 0 2026-02-17T12:01:33.547 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.546+0000 7f90054c8640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fd0078e00 0x7f8fd007b2c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0002410 tx=0x7f8ff0002a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:33.548 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.546+0000 7f8fedffb640 10 client.5333.objecter ms_handle_connect 0x7f8fd0078e00 2026-02-17T12:01:33.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.547+0000 7f8fedffb640 1 -- 10.20.193.10:0/3471787386 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f8ffc025de0 con 0x7f900015d220 2026-02-17T12:01:33.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.547+0000 7f8fedffb640 10 client.5333.objecter ms_dispatch2 0x7f9000000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:33.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.547+0000 7f8fedffb640 3 client.5333.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:33.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.547+0000 7f8fedffb640 3 client.5333.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:33.549 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.547+0000 7f8fedffb640 20 client.5333.objecter dump_active .. 0 homeless 2026-02-17T12:01:33.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.650+0000 7f8fedffb640 1 -- 10.20.193.10:0/3471787386 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8ffc0628c0 con 0x7f900015d220 2026-02-17T12:01:33.652 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.650+0000 7f8fedffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:33.653 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.650+0000 7f8fedffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:33.735 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.733+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 --> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90000c4be0 con 0x7f8fd0078e00 2026-02-17T12:01:33.736 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.734+0000 7f8fedffb640 1 -- 10.20.193.10:0/3471787386 <== mgr.4107 v2:10.20.193.10:6800/3440664462 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44274 (secure 0 0 0) 0x7f90000c4be0 con 0x7f8fd0078e00 2026-02-17T12:01:33.736 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-17T12:01:33.737 INFO:teuthology.orchestra.run.trial010.stderr:dumped all 2026-02-17T12:01:33.737 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 10 librados: watch_flush enter 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 10 librados: watch_flush exit 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 20 client.5333.objecter shutdown clearing up homeless session... 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 10 client.5333.objecter successfully canceled tick 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fd0078e00 msgr2=0x7f8fd007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fd0078e00 0x7f8fd007b2c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0002410 tx=0x7f8ff0002a40 comp rx=0 tx=0).stop 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 10 monclient: shutdown 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f900015d220 msgr2=0x7f900015c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f900015d220 0x7f900015c4a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00cb40 tx=0x7f8ffc00a430 comp rx=0 tx=0).stop 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 shutdown_connections 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f8fd0078e00 0x7f8fd007b2c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f900015d220 0x7f900015c4a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f90000c92f0 0x7f900015bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 --2- 10.20.193.10:0/3471787386 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9000074920 0x7f9000145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 >> 10.20.193.10:0/3471787386 conn(0x7f90000c9d80 msgr2=0x7f900014db60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:33.738 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 shutdown_connections 2026-02-17T12:01:33.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 -- 10.20.193.10:0/3471787386 wait complete. 2026-02-17T12:01:33.739 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.735+0000 7f9007753640 1 librados: shutdown 2026-02-17T12:01:33.745 INFO:teuthology.orchestra.run.trial010.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2026-02-17T12:01:31.813987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438196,"kb_used_data":6808,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511244,"statfs":{"total":1546188226560,"available":1545739513856,"internally_reserved":0,"allocated":6971392,"data_stored":3471254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25500,"internal_metadata":441424996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001586"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:11.217108+0000","last_change":"2026-02-17T12:01:11.222171+0000","last_active":"2026-02-17T12:01:11.217108+0000","last_peered":"2026-02-17T12:01:11.217108+0000","last_clean":"2026-02-17T12:01:11.217108+0000","last_became_active":"2026-02-17T11:55:55.658594+0000","last_became_peered":"2026-02-17T11:55:55.658594+0000","last_unstale":"2026-02-17T12:01:11.217108+0000","last_undegraded":"2026-02-17T12:01:11.217108+0000","last_fullsized":"2026-02-17T12:01:11.217108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:01:11.211521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:01:11.211521+0000","last_clean_scrub_stamp":"2026-02-17T12:01:11.211521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:15:47.683589+0000","scrub_duration":194,"objects_trimmed":0,"snaptrim_duration":0.042345316000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:07.933381+0000","last_change":"2026-02-17T12:01:07.938122+0000","last_active":"2026-02-17T12:01:07.933381+0000","last_peered":"2026-02-17T12:01:07.933381+0000","last_clean":"2026-02-17T12:01:07.933381+0000","last_became_active":"2026-02-17T11:55:55.781344+0000","last_became_peered":"2026-02-17T11:55:55.781344+0000","last_unstale":"2026-02-17T12:01:07.933381+0000","last_undegraded":"2026-02-17T12:01:07.933381+0000","last_fullsized":"2026-02-17T12:01:07.933381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:01:07.930319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:01:07.930319+0000","last_clean_scrub_stamp":"2026-02-17T12:01:07.930319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:50:58.995945+0000","scrub_duration":196,"objects_trimmed":0,"snaptrim_duration":0.037397883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:10.063377+0000","last_change":"2026-02-17T12:01:10.068367+0000","last_active":"2026-02-17T12:01:10.063377+0000","last_peered":"2026-02-17T12:01:10.063377+0000","last_clean":"2026-02-17T12:01:10.063377+0000","last_became_active":"2026-02-17T11:55:55.451241+0000","last_became_peered":"2026-02-17T11:55:55.451241+0000","last_unstale":"2026-02-17T12:01:10.063377+0000","last_undegraded":"2026-02-17T12:01:10.063377+0000","last_fullsized":"2026-02-17T12:01:10.063377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:01:10.060223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:01:10.060223+0000","last_clean_scrub_stamp":"2026-02-17T12:01:10.060223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:12:33.419185+0000","scrub_duration":158,"objects_trimmed":0,"snaptrim_duration":0.037882574000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:07.719252+0000","last_change":"2026-02-17T12:01:07.723920+0000","last_active":"2026-02-17T12:01:07.719252+0000","last_peered":"2026-02-17T12:01:07.719252+0000","last_clean":"2026-02-17T12:01:07.719252+0000","last_became_active":"2026-02-17T11:55:55.648482+0000","last_became_peered":"2026-02-17T11:55:55.648482+0000","last_unstale":"2026-02-17T12:01:07.719252+0000","last_undegraded":"2026-02-17T12:01:07.719252+0000","last_fullsized":"2026-02-17T12:01:07.719252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:01:07.715770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:01:07.715770+0000","last_clean_scrub_stamp":"2026-02-17T12:01:07.715770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:11:37.696516+0000","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0.037738756999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"35'3","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:11.995988+0000","last_change":"2026-02-17T12:01:11.996850+0000","last_active":"2026-02-17T12:01:11.995988+0000","last_peered":"2026-02-17T12:01:11.995988+0000","last_clean":"2026-02-17T12:01:11.995988+0000","last_became_active":"2026-02-17T11:55:55.640831+0000","last_became_peered":"2026-02-17T11:55:55.640831+0000","last_unstale":"2026-02-17T12:01:11.995988+0000","last_undegraded":"2026-02-17T12:01:11.995988+0000","last_fullsized":"2026-02-17T12:01:11.995988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2026-02-17T12:01:11.994724+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2026-02-17T12:01:11.994724+0000","last_clean_scrub_stamp":"2026-02-17T12:01:11.994724+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:25:01.566019+0000","scrub_duration":159,"objects_trimmed":0,"snaptrim_duration":0.056907020000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,12],"acting":[2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:13.548606+0000","last_change":"2026-02-17T12:01:13.553283+0000","last_active":"2026-02-17T12:01:13.548606+0000","last_peered":"2026-02-17T12:01:13.548606+0000","last_clean":"2026-02-17T12:01:13.548606+0000","last_became_active":"2026-02-17T11:55:55.453952+0000","last_became_peered":"2026-02-17T11:55:55.453952+0000","last_unstale":"2026-02-17T12:01:13.548606+0000","last_undegraded":"2026-02-17T12:01:13.548606+0000","last_fullsized":"2026-02-17T12:01:13.548606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:01:13.545523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:01:13.545523+0000","last_clean_scrub_stamp":"2026-02-17T12:01:13.545523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:05:15.820904+0000","scrub_duration":143,"objects_trimmed":0,"snaptrim_duration":0.034638460000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:11.010165+0000","last_change":"2026-02-17T12:01:11.015296+0000","last_active":"2026-02-17T12:01:11.010165+0000","last_peered":"2026-02-17T12:01:11.010165+0000","last_clean":"2026-02-17T12:01:11.010165+0000","last_became_active":"2026-02-17T11:55:55.508618+0000","last_became_peered":"2026-02-17T11:55:55.508618+0000","last_unstale":"2026-02-17T12:01:11.010165+0000","last_undegraded":"2026-02-17T12:01:11.010165+0000","last_fullsized":"2026-02-17T12:01:11.010165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:01:11.006810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:01:11.006810+0000","last_clean_scrub_stamp":"2026-02-17T12:01:11.006810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:19:03.242381+0000","scrub_duration":164,"objects_trimmed":0,"snaptrim_duration":0.055960348,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"35'2","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:13.852852+0000","last_change":"2026-02-17T12:01:13.853234+0000","last_active":"2026-02-17T12:01:13.852852+0000","last_peered":"2026-02-17T12:01:13.852852+0000","last_clean":"2026-02-17T12:01:13.852852+0000","last_became_active":"2026-02-17T11:55:55.408633+0000","last_became_peered":"2026-02-17T11:55:55.408633+0000","last_unstale":"2026-02-17T12:01:13.852852+0000","last_undegraded":"2026-02-17T12:01:13.852852+0000","last_fullsized":"2026-02-17T12:01:13.852852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2026-02-17T12:01:13.852111+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2026-02-17T12:01:13.852111+0000","last_clean_scrub_stamp":"2026-02-17T12:01:13.852111+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:34:48.313025+0000","scrub_duration":64,"objects_trimmed":0,"snaptrim_duration":0.027166316999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"35'34","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T12:01:13.035164+0000","last_change":"2026-02-17T12:01:13.038021+0000","last_active":"2026-02-17T12:01:13.035164+0000","last_peered":"2026-02-17T12:01:13.035164+0000","last_clean":"2026-02-17T12:01:13.035164+0000","last_became_active":"2026-02-17T11:55:49.807188+0000","last_became_peered":"2026-02-17T11:55:49.807188+0000","last_unstale":"2026-02-17T12:01:13.035164+0000","last_undegraded":"2026-02-17T12:01:13.035164+0000","last_fullsized":"2026-02-17T12:01:13.035164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'34","last_scrub_stamp":"2026-02-17T12:01:13.032272+0000","last_deep_scrub":"35'34","last_deep_scrub_stamp":"2026-02-17T12:01:13.032272+0000","last_clean_scrub_stamp":"2026-02-17T12:01:13.032272+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:07:09.871686+0000","scrub_duration":204,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051657,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[2,4,5,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":28,"seq":120259084358,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,5,6,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":28,"seq":120259084360,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313290,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280585,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":22,"seq":94489280585,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247879,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":389120,"data_stored":167240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,6,7,8,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":25,"seq":107374182472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,4,5,6,7,8,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":24,"seq":103079215176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":24,"seq":103079215176,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[2,4,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":27,"seq":115964117065,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,5,6,7,8,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117066,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,3,5,6,7,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":27,"seq":115964117066,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":786432,"data_stored":565061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":27,"seq":115964117068,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":27,"seq":115964117065,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,2,4,6,7,8,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":27,"seq":115964117067,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":167221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,2,3,4,5,7,9,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:01:33.746 DEBUG:teuthology.orchestra.run.trial010:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T12:01:33.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.813+0000 7f9b935ba640 10 monclient: get_monmap_and_config 2026-02-17T12:01:33.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.813+0000 7f9b935ba640 10 monclient: build_initial_monmap 2026-02-17T12:01:33.815 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.813+0000 7f9b935ba640 10 monclient: monmap: 2026-02-17T12:01:33.815 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:33.815 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.815 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T12:01:33.814365+0000 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T12:01:33.814365+0000 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr:0: v1:10.20.193.10:6789/0 mon.noname-a-legacy 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr:1: v1:10.20.193.71:6789/0 mon.noname-b-legacy 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr:2: v1:10.20.193.153:6789/0 mon.noname-c-legacy 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr:3: v2:10.20.193.10:3300/0 mon.noname-a 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr:4: v2:10.20.193.71:3300/0 mon.noname-b 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr:5: v2:10.20.193.153:3300/0 mon.noname-c 2026-02-17T12:01:33.816 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.813+0000 7f9b935ba640 1 Processor -- start 2026-02-17T12:01:33.819 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.813+0000 7f9b935ba640 1 -- start start 2026-02-17T12:01:33.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.813+0000 7f9b935ba640 10 monclient: init 2026-02-17T12:01:33.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:33.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 10 monclient: _add_conns ranks=[0,5,3,4,2,1] 2026-02-17T12:01:33.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9b8c155e80 addr v1:10.20.193.10:6789/0 2026-02-17T12:01:33.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f9b8c074cd0 0x7f9b8c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 10 monclient(hunting): picked mon.noname-c con 0x7f9b8c074cd0 addr v2:10.20.193.153:3300/0 2026-02-17T12:01:33.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 1 --2- >> v2:10.20.193.10:3300/0 conn(0x7f9b8c156260 0x7f9b8c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 10 monclient(hunting): picked mon.noname-a con 0x7f9b8c156260 addr v2:10.20.193.10:3300/0 2026-02-17T12:01:33.820 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 1 -- --> v1:10.20.193.10:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b8c073520 con 0x7f9b8c155e80 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 1 -- --> v2:10.20.193.10:3300/0 -- mon_getmap magic: 0 -- 0x7f9b8c0cd840 con 0x7f9b8c156260 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 1 -- --> v2:10.20.193.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9b8c073800 con 0x7f9b8c074cd0 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b935ba640 10 monclient(hunting): authenticate will time out at 1363.536286s 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.814+0000 7f9b90b2e640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f9b8c074cd0 0x7f9b8c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.815+0000 7f9b90b2e640 1 --2- >> v2:10.20.193.153:3300/0 conn(0x7f9b8c074cd0 0x7f9b8c0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36880/0 (socket says 10.20.193.10:36880) 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.815+0000 7f9b90b2e640 1 -- 10.20.193.10:0/326254067 learned_addr learned my addr 10.20.193.10:0/326254067 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.815+0000 7f9b90b2e640 10 monclient(hunting): get_auth_request con 0x7f9b8c074cd0 auth_method 0 2026-02-17T12:01:33.821 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.815+0000 7f9b90b2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.815+0000 7f9b90b2e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.815+0000 7f9b90b2e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.815+0000 7f9b90b2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.815+0000 7f9b90b2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.815+0000 7f9b90b2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.816+0000 7f9b90b2e640 10 monclient(hunting): handle_auth_done global_id 5336 payload 274 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.816+0000 7f9b90b2e640 1 -- 10.20.193.10:0/326254067 >> v2:10.20.193.10:3300/0 conn(0x7f9b8c156260 msgr2=0x7f9b8c0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.816+0000 7f9b90b2e640 1 --2- 10.20.193.10:0/326254067 >> v2:10.20.193.10:3300/0 conn(0x7f9b8c156260 0x7f9b8c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.816+0000 7f9b90b2e640 1 -- 10.20.193.10:0/326254067 >> v1:10.20.193.10:6789/0 conn(0x7f9b8c155e80 legacy=0x7f9b8c0745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.816+0000 7f9b90b2e640 10 monclient: _finish_hunting 0 2026-02-17T12:01:33.822 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.816+0000 7f9b90b2e640 1 monclient: found mon.noname-c 2026-02-17T12:01:33.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.816+0000 7f9b90b2e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:33.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.816+0000 7f9b90b2e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.816+0000 7f9b90b2e640 1 -- 10.20.193.10:0/326254067 --> v2:10.20.193.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8c073ae0 con 0x7f9b8c074cd0 2026-02-17T12:01:33.823 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.817+0000 7f9b90b2e640 1 --2- 10.20.193.10:0/326254067 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 0x7f9b8c0ccbc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c08f5e0 tx=0x7f9b8002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95258f51d534c83c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:33.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 1 -- 10.20.193.10:0/326254067 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8003c070 con 0x7f9b8c074cd0 2026-02-17T12:01:33.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:33.830 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 10 monclient: dump: 2026-02-17T12:01:33.830 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:33.830 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.830 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.830 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 10 monclient: _finish_auth 0 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:33.831 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 1 -- 10.20.193.10:0/326254067 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8002fb40 con 0x7f9b8c074cd0 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b935ba640 5 monclient: authenticate success, global_id 5336 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b935ba640 10 monclient: get_monmap_and_config success 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 1 -- 10.20.193.10:0/326254067 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80037440 con 0x7f9b8c074cd0 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b935ba640 4 set_mon_vals no callback set 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.819+0000 7f9b7bfff640 10 monclient: dump: 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.832 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 10 monclient: shutdown 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:33.833 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 -- 10.20.193.10:0/326254067 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 msgr2=0x7f9b8c0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 --2- 10.20.193.10:0/326254067 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 0x7f9b8c0ccbc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c08f5e0 tx=0x7f9b8002eed0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 -- 10.20.193.10:0/326254067 shutdown_connections 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 --2- 10.20.193.10:0/326254067 >> v2:10.20.193.10:3300/0 conn(0x7f9b8c156260 0x7f9b8c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 --2- 10.20.193.10:0/326254067 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 0x7f9b8c0ccbc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 -- 10.20.193.10:0/326254067 >> 10.20.193.10:0/326254067 conn(0x7f9b8c0ce2b0 msgr2=0x7f9b8c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 -- 10.20.193.10:0/326254067 shutdown_connections 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 -- 10.20.193.10:0/326254067 wait complete. 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 10 monclient: build_initial_monmap 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 10 monclient: monmap: 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:epoch 0 2026-02-17T12:01:33.834 INFO:teuthology.orchestra.run.trial010.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 0.000000 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr:created 0.000000 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 0 (unknown) 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.noname-a 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.noname-b 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.noname-c 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 librados: starting msgr at 2026-02-17T12:01:33.835 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 librados: starting objecter 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.820+0000 7f9b935ba640 1 Processor -- start 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 1 -- start start 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 1 librados: setting wanted keys 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 1 librados: calling monclient init 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient: init 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient: _reopen_session rank -1 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 0x7f9b8c0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient(hunting): picked mon.noname-c con 0x7f9b8c074cd0 addr [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 1 --2- >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9b8c155e80 0x7f9b8c1f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.836 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient(hunting): picked mon.noname-a con 0x7f9b8c155e80 addr [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b8c156260 0x7f9b8c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient(hunting): picked mon.noname-b con 0x7f9b8c156260 addr [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 1 -- --> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c0c4870 con 0x7f9b8c155e80 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 1 -- --> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c0740a0 con 0x7f9b8c156260 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient(hunting): start opening mon connection 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c0c49f0 con 0x7f9b8c074cd0 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient(hunting): _renew_subs 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b935ba640 10 monclient(hunting): authenticate will time out at 1363.543414s 2026-02-17T12:01:33.837 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b9132f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 0x7f9b8c0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b91b30640 1 --2- >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b8c156260 0x7f9b8c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b9132f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 0x7f9b8c0c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.10:36884/0 (socket says 10.20.193.10:36884) 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b9132f640 1 -- 10.20.193.10:0/3987709073 learned_addr learned my addr 10.20.193.10:0/3987709073 (peer_addr_for_me v2:10.20.193.10:0/0) 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b9132f640 10 monclient(hunting): get_auth_request con 0x7f9b8c074cd0 auth_method 0 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b9132f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b9132f640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.821+0000 7f9b9132f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b91b30640 10 monclient(hunting): get_auth_request con 0x7f9b8c156260 auth_method 0 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b91b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.838 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b91b30640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b91b30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b9132f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b9132f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b9132f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b90b2e640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9b8c155e80 0x7f9b8c1f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b90b2e640 10 monclient(hunting): get_auth_request con 0x7f9b8c155e80 auth_method 0 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b90b2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b90b2e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b90b2e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b91b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b91b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.839 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b91b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b90b2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b90b2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.822+0000 7f9b90b2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 10 monclient(hunting): handle_auth_done global_id 5339 payload 824 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 1 -- 10.20.193.10:0/3987709073 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b8c156260 msgr2=0x7f9b8c158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b8c156260 0x7f9b8c158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 1 -- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9b8c155e80 msgr2=0x7f9b8c1f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9b8c155e80 0x7f9b8c1f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 10 monclient: _finish_hunting 0 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 1 monclient: found mon.noname-c 2026-02-17T12:01:33.840 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.823+0000 7f9b9132f640 1 -- 10.20.193.10:0/3987709073 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8c0cb1e0 con 0x7f9b8c074cd0 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.824+0000 7f9b9132f640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 0x7f9b8c0c8130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00b570 tx=0x7f9b7c00ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.824+0000 7f9b79ffb640 10 client.?.objecter ms_handle_connect 0x7f9b8c074cd0 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.824+0000 7f9b79ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b79ffb640 1 -- 10.20.193.10:0/3987709073 <== mon.2 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c013020 con 0x7f9b8c074cd0 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b79ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b79ffb640 10 monclient: dump: 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:33.841 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b79ffb640 10 monclient: _finish_auth 0 2026-02-17T12:01:33.842 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b79ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b935ba640 5 monclient: authenticate success, global_id 5339 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b935ba640 10 monclient: _renew_subs 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b935ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b8c0c9b80 con 0x7f9b8c074cd0 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b935ba640 10 client.5339.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b935ba640 10 monclient: _renew_subs 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b935ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b8c0ca140 con 0x7f9b8c074cd0 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.825+0000 7f9b935ba640 1 librados: init done 2026-02-17T12:01:33.843 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b79ffb640 1 -- 10.20.193.10:0/3987709073 <== mon.2 v2:10.20.193.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7c004480 con 0x7f9b8c074cd0 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b79ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b79ffb640 1 -- 10.20.193.10:0/3987709073 <== mon.2 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c002980 con 0x7f9b8c074cd0 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b79ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b7b7fe640 4 set_mon_vals no callback set 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b79ffb640 10 monclient: dump: 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:epoch 1 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:fsid e6846c4e-39d4-4411-a0f7-efd9dc941974 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:last_changed 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:created 2026-02-17T11:52:21.129219+0000 2026-02-17T12:01:33.844 INFO:teuthology.orchestra.run.trial010.stderr:min_mon_release 19 (squid) 2026-02-17T12:01:33.845 INFO:teuthology.orchestra.run.trial010.stderr:election_strategy: 1 2026-02-17T12:01:33.845 INFO:teuthology.orchestra.run.trial010.stderr:0: [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] mon.a 2026-02-17T12:01:33.845 INFO:teuthology.orchestra.run.trial010.stderr:1: [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] mon.b 2026-02-17T12:01:33.845 INFO:teuthology.orchestra.run.trial010.stderr:2: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.c 2026-02-17T12:01:33.845 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:01:33.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b935ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:33.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b935ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:33.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b935ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:33.845 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.826+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8c150ff0 con 0x7f9b8c074cd0 2026-02-17T12:01:33.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.837+0000 7f9b79ffb640 1 -- 10.20.193.10:0/3987709073 <== mon.2 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 5) ==== 99901+0+0 (secure 0 0 0) 0x7f9b7c002b20 con 0x7f9b8c074cd0 2026-02-17T12:01:33.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.837+0000 7f9b79ffb640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b5c078e00 0x7f9b5c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:01:33.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.837+0000 7f9b90b2e640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b5c078e00 0x7f9b5c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:01:33.847 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.837+0000 7f9b90b2e640 10 monclient: get_auth_request con 0x7f9b5c078e00 auth_method 0 2026-02-17T12:01:33.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.838+0000 7f9b90b2e640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b5c078e00 0x7f9b5c07b2c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c06cfa0 tx=0x7f9b80033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:01:33.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.838+0000 7f9b79ffb640 10 client.5339.objecter ms_handle_connect 0x7f9b5c078e00 2026-02-17T12:01:33.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.839+0000 7f9b79ffb640 1 -- 10.20.193.10:0/3987709073 <== mon.2 v2:10.20.193.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f9b7c05dfe0 con 0x7f9b8c074cd0 2026-02-17T12:01:33.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.839+0000 7f9b79ffb640 10 client.5339.objecter ms_dispatch2 0x7f9b8c000b90 osd_map(35..35 src has 1..35) 2026-02-17T12:01:33.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.839+0000 7f9b79ffb640 3 client.5339.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T12:01:33.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.839+0000 7f9b79ffb640 3 client.5339.objecter handle_osd_map decoding full epoch 35 2026-02-17T12:01:33.848 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.839+0000 7f9b79ffb640 20 client.5339.objecter dump_active .. 0 homeless 2026-02-17T12:01:33.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.942+0000 7f9b79ffb640 1 -- 10.20.193.10:0/3987709073 <== mon.2 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9b8c150ff0 con 0x7f9b8c074cd0 2026-02-17T12:01:33.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.942+0000 7f9b79ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:01:33.944 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:33.942+0000 7f9b79ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:01:34.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.026+0000 7f9b935ba640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T12:01:34.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.026+0000 7f9b935ba640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T12:01:34.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.026+0000 7f9b935ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.153:3300/0 2026-02-17T12:01:34.028 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.026+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9b8c0745c0 con 0x7f9b8c074cd0 2026-02-17T12:01:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.114+0000 7f9b79ffb640 1 -- 10.20.193.10:0/3987709073 <== mon.2 v2:10.20.193.153:3300/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9b7c061fa0 con 0x7f9b8c074cd0 2026-02-17T12:01:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.114+0000 7f9b79ffb640 10 monclient: handle_config config(1 keys) 2026-02-17T12:01:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.114+0000 7f9b7b7fe640 4 set_mon_vals no callback set 2026-02-17T12:01:34.116 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.114+0000 7f9b7b7fe640 10 set_mon_vals mon_health_to_clog = false 2026-02-17T12:01:34.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.114+0000 7f9b79ffb640 1 -- 10.20.193.10:0/3987709073 <== mon.2 v2:10.20.193.153:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7f9b7c01d020 con 0x7f9b8c074cd0 2026-02-17T12:01:34.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.114+0000 7f9b79ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T12:01:34.117 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.114+0000 7f9b79ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 10 librados: watch_flush enter 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 10 librados: watch_flush exit 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 20 client.5339.objecter shutdown clearing up homeless session... 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 10 client.5339.objecter successfully canceled tick 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b5c078e00 msgr2=0x7f9b5c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b5c078e00 0x7f9b5c07b2c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c06cfa0 tx=0x7f9b80033000 comp rx=0 tx=0).stop 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 10 monclient: shutdown 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 msgr2=0x7f9b8c0c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 0x7f9b8c0c8130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00b570 tx=0x7f9b7c00ba40 comp rx=0 tx=0).stop 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 shutdown_connections 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:6800/3440664462,v1:10.20.193.10:6801/3440664462] conn(0x7f9b5c078e00 0x7f9b5c07b2c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.71:3300/0,v1:10.20.193.71:6789/0] conn(0x7f9b8c156260 0x7f9b8c158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:34.118 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.10:3300/0,v1:10.20.193.10:6789/0] conn(0x7f9b8c155e80 0x7f9b8c1f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:34.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 --2- 10.20.193.10:0/3987709073 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9b8c074cd0 0x7f9b8c0c8130 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:01:34.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 >> 10.20.193.10:0/3987709073 conn(0x7f9b8c0ce2b0 msgr2=0x7f9b8c151800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:01:34.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 shutdown_connections 2026-02-17T12:01:34.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 -- 10.20.193.10:0/3987709073 wait complete. 2026-02-17T12:01:34.119 INFO:teuthology.orchestra.run.trial010.stderr:2026-02-17T12:01:34.116+0000 7f9b935ba640 1 librados: shutdown 2026-02-17T12:01:34.127 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-17T12:01:34.129 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T12:01:34.130 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T12:01:34.130 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T12:01:34.130 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:01:34.137 INFO:tasks.ceph.osd.0.trial010.stderr:2026-02-17T12:01:34.130+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 45092) UID: 0 2026-02-17T12:01:34.137 INFO:tasks.ceph.osd.0.trial010.stderr:2026-02-17T12:01:34.131+0000 c69c640 -1 osd.0 35 *** Got signal Terminated *** 2026-02-17T12:01:35.539 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:07:52.707 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:35.565 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:07:52.733 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:35.573 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:07:52.741 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:35.592 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:07:52.721 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:35.593 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:07:52.756 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:35.594 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:07:52.722 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:35.594 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:07:52.758 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:35.601 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:07:52.730 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:35.602 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:07:52.765 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:40.231 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T12:01:40.232 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-17T12:01:40.232 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:01:40.239 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T12:01:40.233+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 45094) UID: 0 2026-02-17T12:01:40.239 INFO:tasks.ceph.osd.4.trial010.stderr:2026-02-17T12:01:40.233+0000 c69c640 -1 osd.4 37 *** Got signal Terminated *** 2026-02-17T12:01:41.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-17T12:01:46.334 INFO:tasks.ceph.osd.4:Stopped 2026-02-17T12:01:46.334 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-17T12:01:46.335 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:01:46.341 INFO:tasks.ceph.osd.8.trial010.stderr:2026-02-17T12:01:46.335+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 45098) UID: 0 2026-02-17T12:01:46.342 INFO:tasks.ceph.osd.8.trial010.stderr:2026-02-17T12:01:46.336+0000 c69c640 -1 osd.8 39 *** Got signal Terminated *** 2026-02-17T12:01:48.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2026-02-17T12:01:48.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-17T12:01:52.437 INFO:tasks.ceph.osd.8:Stopped 2026-02-17T12:01:52.437 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-17T12:01:52.438 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:01:52.445 INFO:tasks.ceph.osd.12.trial010.stderr:2026-02-17T12:01:52.439+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 45100) UID: 0 2026-02-17T12:01:52.445 INFO:tasks.ceph.osd.12.trial010.stderr:2026-02-17T12:01:52.440+0000 c69c640 -1 osd.12 41 *** Got signal Terminated *** 2026-02-17T12:01:54.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2026-02-17T12:01:55.578 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:08:12.747 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:55.608 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:08:12.776 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:55.619 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:08:12.787 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:55.634 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:08:12.762 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:55.634 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:08:12.798 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:55.636 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:08:12.800 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:55.636 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:08:12.765 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:55.647 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:08:12.776 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:55.647 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:08:12.811 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:01:58.540 INFO:tasks.ceph.osd.12:Stopped 2026-02-17T12:01:58.541 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T12:01:58.541 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:01:58.548 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T12:01:58.542+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 44575) UID: 0 2026-02-17T12:01:58.548 INFO:tasks.ceph.osd.1.trial071.stderr:2026-02-17T12:01:58.543+0000 c69c640 -1 osd.1 43 *** Got signal Terminated *** 2026-02-17T12:02:04.643 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T12:02:04.643 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-17T12:02:04.643 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:04.651 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T12:02:04.645+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 44578) UID: 0 2026-02-17T12:02:04.652 INFO:tasks.ceph.osd.5.trial071.stderr:2026-02-17T12:02:04.646+0000 c69c640 -1 osd.5 44 *** Got signal Terminated *** 2026-02-17T12:02:10.745 INFO:tasks.ceph.osd.5:Stopped 2026-02-17T12:02:10.745 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-17T12:02:10.746 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:10.753 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T12:02:10.747+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 44580) UID: 0 2026-02-17T12:02:10.753 INFO:tasks.ceph.osd.9.trial071.stderr:2026-02-17T12:02:10.747+0000 c69c640 -1 osd.9 46 *** Got signal Terminated *** 2026-02-17T12:02:15.642 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:08:32.810 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:15.645 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:08:32.813 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:15.654 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:08:32.822 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:15.668 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:08:32.831 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:15.670 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:08:32.834 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:15.673 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:08:32.802 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:15.674 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:08:32.803 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:15.679 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:08:32.843 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:15.683 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:08:32.812 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:16.848 INFO:tasks.ceph.osd.9:Stopped 2026-02-17T12:02:16.848 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-17T12:02:16.848 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:16.856 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T12:02:16.850+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 44609) UID: 0 2026-02-17T12:02:16.856 INFO:tasks.ceph.osd.13.trial071.stderr:2026-02-17T12:02:16.851+0000 c69c640 -1 osd.13 47 *** Got signal Terminated *** 2026-02-17T12:02:21.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-17T12:02:22.950 INFO:tasks.ceph.osd.13:Stopped 2026-02-17T12:02:22.950 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T12:02:22.950 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:22.958 INFO:tasks.ceph.osd.2.trial153.stderr:2026-02-17T12:02:22.952+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 44846) UID: 0 2026-02-17T12:02:22.959 INFO:tasks.ceph.osd.2.trial153.stderr:2026-02-17T12:02:22.952+0000 c69c640 -1 osd.2 48 *** Got signal Terminated *** 2026-02-17T12:02:27.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-17T12:02:27.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-17T12:02:29.052 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T12:02:29.052 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-17T12:02:29.053 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:29.060 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T12:02:29.054+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 44848) UID: 0 2026-02-17T12:02:29.060 INFO:tasks.ceph.osd.6.trial153.stderr:2026-02-17T12:02:29.054+0000 c69c640 -1 osd.6 50 *** Got signal Terminated *** 2026-02-17T12:02:33.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-17T12:02:35.154 INFO:tasks.ceph.osd.6:Stopped 2026-02-17T12:02:35.155 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-17T12:02:35.155 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:35.162 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T12:02:35.156+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 44851) UID: 0 2026-02-17T12:02:35.162 INFO:tasks.ceph.osd.10.trial153.stderr:2026-02-17T12:02:35.157+0000 c69c640 -1 osd.10 52 *** Got signal Terminated *** 2026-02-17T12:02:35.650 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:08:52.818 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:35.676 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:08:52.844 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:35.679 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:08:52.808 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:35.681 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:08:52.810 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:35.687 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:08:52.855 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:35.693 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:08:52.821 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:35.701 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:08:52.865 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:35.703 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:08:52.866 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:35.713 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:08:52.877 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:02:39.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 is failed for ~0s 2026-02-17T12:02:41.257 INFO:tasks.ceph.osd.10:Stopped 2026-02-17T12:02:41.257 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-17T12:02:41.257 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:41.265 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T12:02:41.258+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 44852) UID: 0 2026-02-17T12:02:41.265 INFO:tasks.ceph.osd.14.trial153.stderr:2026-02-17T12:02:41.259+0000 c69c640 -1 osd.14 53 *** Got signal Terminated *** 2026-02-17T12:02:45.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2026-02-17T12:02:45.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 has been restored 2026-02-17T12:02:47.358 INFO:tasks.ceph.osd.14:Stopped 2026-02-17T12:02:47.358 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T12:02:47.358 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:47.376 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T12:02:47.370+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 45085) UID: 0 2026-02-17T12:02:47.377 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-17T12:02:47.371+0000 c69c640 -1 osd.3 54 *** Got signal Terminated *** 2026-02-17T12:02:51.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-17T12:02:51.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2026-02-17T12:02:53.460 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T12:02:53.460 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-17T12:02:53.460 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:53.467 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-17T12:02:53.462+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 45089) UID: 0 2026-02-17T12:02:53.467 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-17T12:02:53.463+0000 c69c640 -1 osd.7 54 *** Got signal Terminated *** 2026-02-17T12:02:56.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2026-02-17T12:02:56.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-17T12:02:59.561 INFO:tasks.ceph.osd.7:Stopped 2026-02-17T12:02:59.561 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-17T12:02:59.561 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:02:59.568 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-17T12:02:59.563+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 45088) UID: 0 2026-02-17T12:02:59.568 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-17T12:02:59.564+0000 c69c640 -1 osd.11 54 *** Got signal Terminated *** 2026-02-17T12:03:00.711 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:09:17.880 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:03:00.714 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:09:17.882 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:03:00.722 INFO:tasks.ceph.mon.a.trial010.stderr:==00:00:09:17.891 44673== Warning: unimplemented fcntl command: 1036 2026-02-17T12:03:00.739 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:09:17.903 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:03:00.741 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:09:17.869 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:03:00.741 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:09:17.905 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:03:00.741 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:09:17.870 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:03:00.750 INFO:tasks.ceph.mon.b.trial071.stderr:==00:00:09:17.913 44365== Warning: unimplemented fcntl command: 1036 2026-02-17T12:03:00.750 INFO:tasks.ceph.mon.c.trial153.stderr:==00:00:09:17.879 44611== Warning: unimplemented fcntl command: 1036 2026-02-17T12:03:02.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 is failed for ~0s 2026-02-17T12:03:02.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2026-02-17T12:03:05.663 INFO:tasks.ceph.osd.11:Stopped 2026-02-17T12:03:05.663 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-17T12:03:05.664 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:03:05.671 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-17T12:03:05.664+0000 c69c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 45090) UID: 0 2026-02-17T12:03:05.672 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-17T12:03:05.665+0000 c69c640 -1 osd.15 54 *** Got signal Terminated *** 2026-02-17T12:03:08.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 is failed for ~0s 2026-02-17T12:03:08.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 has been restored 2026-02-17T12:03:11.766 INFO:tasks.ceph.osd.15:Stopped 2026-02-17T12:03:11.766 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T12:03:11.766 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-17T12:03:11.766 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:03:11.766 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T12:03:11.765+0000 7f39f3bd4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 44721) UID: 0 2026-02-17T12:03:11.766 INFO:tasks.ceph.mgr.y.trial010.stderr:2026-02-17T12:03:11.765+0000 7f39f3bd4640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-17T12:03:11.800 INFO:tasks.ceph.mgr.y:Stopped 2026-02-17T12:03:11.800 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T12:03:11.800 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:03:11.830 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T12:03:11.830 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T12:03:11.830 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T12:03:11.830 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:03:11.848 INFO:tasks.ceph.mon.a.trial010.stderr:2026-02-17T12:03:11.841+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 44671) UID: 0 2026-02-17T12:03:11.849 INFO:tasks.ceph.mon.a.trial010.stderr:2026-02-17T12:03:11.841+0000 aca4640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T12:03:13.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-17T12:03:13.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 has been restored 2026-02-17T12:03:17.932 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T12:03:17.932 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T12:03:17.932 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:03:17.941 INFO:tasks.ceph.mon.b.trial071.stderr:2026-02-17T12:03:17.933+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 44363) UID: 0 2026-02-17T12:03:17.942 INFO:tasks.ceph.mon.b.trial071.stderr:2026-02-17T12:03:17.933+0000 aca4640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-17T12:03:18.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-17T12:03:18.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-17T12:03:23.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2026-02-17T12:03:24.034 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T12:03:24.034 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:03:24.034 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:03:24.042 INFO:tasks.ceph.mon.c.trial153.stderr:2026-02-17T12:03:24.035+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 44609) UID: 0 2026-02-17T12:03:24.043 INFO:tasks.ceph.mon.c.trial153.stderr:2026-02-17T12:03:24.036+0000 aca4640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-17T12:03:28.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-17T12:03:28.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-17T12:03:30.136 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:03:30.137 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T12:03:30.138 DEBUG:teuthology.orchestra.run.trial010:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T12:03:30.168 INFO:teuthology.orchestra.run.trial010.stdout:2026-02-17T11:55:42.442868+0000 mon.a (mon.0) 338 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-17T12:03:30.168 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2026-02-17T12:03:30.168 DEBUG:teuthology.orchestra.run.trial010:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T12:03:30.234 DEBUG:teuthology.orchestra.run.trial010:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T12:03:30.300 DEBUG:teuthology.orchestra.run.trial010:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T12:03:30.366 INFO:teuthology.orchestra.run.trial010.stdout:2026-02-17T11:55:42.442868+0000 mon.a (mon.0) 338 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-17T12:03:30.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial010.front.sepia.ceph.com 2026-02-17T12:03:30.367 DEBUG:teuthology.orchestra.run.trial010:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T12:03:30.435 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial010.front.sepia.ceph.com 2026-02-17T12:03:30.435 DEBUG:teuthology.orchestra.run.trial010:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-17T12:03:30.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial010.front.sepia.ceph.com 2026-02-17T12:03:30.504 DEBUG:teuthology.orchestra.run.trial010:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-17T12:03:30.570 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial010.front.sepia.ceph.com 2026-02-17T12:03:30.571 DEBUG:teuthology.orchestra.run.trial010:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-17T12:03:30.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial071.front.sepia.ceph.com 2026-02-17T12:03:30.638 DEBUG:teuthology.orchestra.run.trial071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T12:03:30.679 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial071.front.sepia.ceph.com 2026-02-17T12:03:30.679 DEBUG:teuthology.orchestra.run.trial071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-17T12:03:30.746 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial071.front.sepia.ceph.com 2026-02-17T12:03:30.747 DEBUG:teuthology.orchestra.run.trial071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-17T12:03:30.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial071.front.sepia.ceph.com 2026-02-17T12:03:30.814 DEBUG:teuthology.orchestra.run.trial071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-17T12:03:30.881 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial153.front.sepia.ceph.com 2026-02-17T12:03:30.882 DEBUG:teuthology.orchestra.run.trial153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T12:03:30.922 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial153.front.sepia.ceph.com 2026-02-17T12:03:30.923 DEBUG:teuthology.orchestra.run.trial153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-17T12:03:30.997 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial153.front.sepia.ceph.com 2026-02-17T12:03:30.997 DEBUG:teuthology.orchestra.run.trial153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-17T12:03:31.065 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial153.front.sepia.ceph.com 2026-02-17T12:03:31.066 DEBUG:teuthology.orchestra.run.trial153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-17T12:03:31.137 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial174.front.sepia.ceph.com 2026-02-17T12:03:31.137 DEBUG:teuthology.orchestra.run.trial174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T12:03:31.176 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial174.front.sepia.ceph.com 2026-02-17T12:03:31.177 DEBUG:teuthology.orchestra.run.trial174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-17T12:03:31.245 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial174.front.sepia.ceph.com 2026-02-17T12:03:31.245 DEBUG:teuthology.orchestra.run.trial174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-17T12:03:31.313 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial174.front.sepia.ceph.com 2026-02-17T12:03:31.313 DEBUG:teuthology.orchestra.run.trial174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-17T12:03:31.382 INFO:tasks.ceph:Archiving mon data... 2026-02-17T12:03:31.383 DEBUG:teuthology.misc:Transferring archived files from trial010:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/data/mon.a.tgz 2026-02-17T12:03:31.383 DEBUG:teuthology.orchestra.run.trial010:> mktemp 2026-02-17T12:03:31.400 INFO:teuthology.orchestra.run.trial010.stdout:/tmp/tmp.BLVmsypn68 2026-02-17T12:03:31.400 DEBUG:teuthology.orchestra.run.trial010:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BLVmsypn68 2026-02-17T12:03:31.511 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod 0666 /tmp/tmp.BLVmsypn68 2026-02-17T12:03:31.593 DEBUG:teuthology.orchestra.remote:trial010:/tmp/tmp.BLVmsypn68 is 407KB 2026-02-17T12:03:31.691 DEBUG:teuthology.orchestra.run.trial010:> rm -fr /tmp/tmp.BLVmsypn68 2026-02-17T12:03:31.708 DEBUG:teuthology.misc:Transferring archived files from trial071:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/data/mon.b.tgz 2026-02-17T12:03:31.709 DEBUG:teuthology.orchestra.run.trial071:> mktemp 2026-02-17T12:03:31.726 INFO:teuthology.orchestra.run.trial071.stdout:/tmp/tmp.S3B5RT091Q 2026-02-17T12:03:31.727 DEBUG:teuthology.orchestra.run.trial071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.S3B5RT091Q 2026-02-17T12:03:31.836 DEBUG:teuthology.orchestra.run.trial071:> sudo chmod 0666 /tmp/tmp.S3B5RT091Q 2026-02-17T12:03:31.917 DEBUG:teuthology.orchestra.remote:trial071:/tmp/tmp.S3B5RT091Q is 408KB 2026-02-17T12:03:32.012 DEBUG:teuthology.orchestra.run.trial071:> rm -fr /tmp/tmp.S3B5RT091Q 2026-02-17T12:03:32.029 DEBUG:teuthology.misc:Transferring archived files from trial153:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/data/mon.c.tgz 2026-02-17T12:03:32.030 DEBUG:teuthology.orchestra.run.trial153:> mktemp 2026-02-17T12:03:32.048 INFO:teuthology.orchestra.run.trial153.stdout:/tmp/tmp.NUL27UpIZN 2026-02-17T12:03:32.049 DEBUG:teuthology.orchestra.run.trial153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.NUL27UpIZN 2026-02-17T12:03:32.159 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod 0666 /tmp/tmp.NUL27UpIZN 2026-02-17T12:03:32.240 DEBUG:teuthology.orchestra.remote:trial153:/tmp/tmp.NUL27UpIZN is 408KB 2026-02-17T12:03:32.337 DEBUG:teuthology.orchestra.run.trial153:> rm -fr /tmp/tmp.NUL27UpIZN 2026-02-17T12:03:32.356 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T12:03:32.356 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T12:03:32.358 DEBUG:teuthology.orchestra.run.trial071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T12:03:32.360 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T12:03:32.397 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T12:03:32.633 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-17T12:03:33.232 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T12:03:33.233 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T12:03:33.234 DEBUG:teuthology.misc:Transferring archived files from trial010:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial010/crash 2026-02-17T12:03:33.235 DEBUG:teuthology.orchestra.run.trial010:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T12:03:33.260 DEBUG:teuthology.misc:Transferring archived files from trial071:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial071/crash 2026-02-17T12:03:33.261 DEBUG:teuthology.orchestra.run.trial071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T12:03:33.287 DEBUG:teuthology.misc:Transferring archived files from trial153:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial153/crash 2026-02-17T12:03:33.288 DEBUG:teuthology.orchestra.run.trial153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T12:03:33.313 DEBUG:teuthology.misc:Transferring archived files from trial174:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial174/crash 2026-02-17T12:03:33.314 DEBUG:teuthology.orchestra.run.trial174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T12:03:33.341 INFO:tasks.ceph:Compressing logs... 2026-02-17T12:03:33.341 DEBUG:teuthology.orchestra.run.trial010:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:03:33.344 DEBUG:teuthology.orchestra.run.trial071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:03:33.346 DEBUG:teuthology.orchestra.run.trial153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:03:33.357 DEBUG:teuthology.orchestra.run.trial174:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:03:33.366 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54538.log 2026-02-17T12:03:33.377 INFO:teuthology.orchestra.run.trial071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-17T12:03:33.377 INFO:teuthology.orchestra.run.trial071.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-17T12:03:33.377 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-17T12:03:33.378 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-17T12:03:33.378 INFO:teuthology.orchestra.run.trial071.stderr: 68.4% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-17T12:03:33.378 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/valgrind/osd.13.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-17T12:03:33.378 INFO:teuthology.orchestra.run.trial071.stderr: 67.8% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-17T12:03:33.378 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-17T12:03:33.378 INFO:teuthology.orchestra.run.trial071.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/valgrind/osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/ceph-mon.b.log: 94.2% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/ceph-osd.13.log: /var/log/ceph/ceph-osd.1.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-17T12:03:33.379 INFO:teuthology.orchestra.run.trial071.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T12:03:33.388 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T12:03:33.388 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T12:03:33.388 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-17T12:03:33.388 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-17T12:03:33.388 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-17T12:03:33.388 INFO:teuthology.orchestra.run.trial153.stderr: 68.0% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-17T12:03:33.388 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr: 68.1% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr: 67.8% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/valgrind/osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr: 67.8% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/ceph-osd.14.log: 94.2%gzip -- replaced with /var/log/ceph/valgrind/mon.c.log.gz -5 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr: --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T12:03:33.389 INFO:teuthology.orchestra.run.trial153.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T12:03:33.417 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44403.log 2026-02-17T12:03:33.417 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44920.log 2026-02-17T12:03:33.417 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44967.log 2026-02-17T12:03:33.417 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44920.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44403.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44356.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44920.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:gzip/var/log/ceph/ceph-client.admin.44967.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44544.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44356.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44967.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44873.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44356.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr: 87.5%/var/log/ceph/ceph-osd.3.log: -- replaced with /var/log/ceph/ceph-client.admin.44544.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44591.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44779.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44591.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44873.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44685.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44591.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44779.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44685.log: /var/log/ceph/ceph-osd.7.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44779.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44685.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/valgrind/osd.7.log: 67.9% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/valgrind/osd.11.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/valgrind/osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44826.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr: 68.1% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-17T12:03:33.418 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44251.log 2026-02-17T12:03:33.419 INFO:teuthology.orchestra.run.trial174.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44826.log.gz 2026-02-17T12:03:33.419 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44497.log 2026-02-17T12:03:33.419 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44638.log 2026-02-17T12:03:33.419 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44497.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.44251.log.gz -5 2026-02-17T12:03:33.419 INFO:teuthology.orchestra.run.trial174.stderr: --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T12:03:33.419 INFO:teuthology.orchestra.run.trial174.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44497.log.gz 2026-02-17T12:03:33.419 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2026-02-17T12:03:33.420 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-mgr.x.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44638.log.gz 2026-02-17T12:03:33.420 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44732.log 2026-02-17T12:03:33.420 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44302.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-17T12:03:33.420 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44450.log 2026-02-17T12:03:33.420 INFO:teuthology.orchestra.run.trial174.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2026-02-17T12:03:33.420 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-osd.15.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44732.log.gz 2026-02-17T12:03:33.420 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.44450.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44450.log.gz 2026-02-17T12:03:33.425 INFO:teuthology.orchestra.run.trial174.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T12:03:33.425 INFO:teuthology.orchestra.run.trial071.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T12:03:33.425 INFO:teuthology.orchestra.run.trial071.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52610.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51183.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52610.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54538.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53296.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51183.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52610.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49877.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53296.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51183.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49877.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53296.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55273.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5/var/log/ceph/ceph-osd.0.log: --verbose -- /var/log/ceph/ceph-client.admin.52512.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49877.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51278.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55273.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54587.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:gzip/var/log/ceph/ceph-client.admin.51278.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50508.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52512.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51360.log 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51278.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50508.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54587.log.gz 2026-02-17T12:03:33.427 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51360.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50508.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55666.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-mgr.y.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51360.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54340.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52463.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51088.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55666.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54340.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56906.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55519.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51088.log: 88.8%/var/log/ceph/ceph-client.admin.56906.log: -- replaced with /var/log/ceph/ceph-client.admin.52463.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50900.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51088.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56906.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55764.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50900.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55519.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52168.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53884.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50900.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55764.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50613.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52217.log/var/log/ceph/ceph-client.admin.53884.log: 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52168.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49856.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53884.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50613.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50577.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50608.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52217.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50577.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49856.log.gz 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55224.log 2026-02-17T12:03:33.428 INFO:teuthology.orchestra.run.trial010.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50577.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57494.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46289.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50608.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57494.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55224.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55911.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.46289.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57494.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55470.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46289.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55960.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55470.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55911.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53051.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55960.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55470.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58230.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53051.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55960.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51285.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53051.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.58230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53688.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58033.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58230.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51285.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54685.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.58033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56612.log 88.2% 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53688.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54685.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58033.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56514.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56612.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54685.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58082.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49835.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56612.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.58082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53639.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56514.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49835.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58082.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54440.log 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53639.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49835.log.gz 2026-02-17T12:03:33.429 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56107.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53639.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45355.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54440.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49846.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56107.log: /var/log/ceph/ceph-client.admin.45355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51470.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56107.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49846.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45355.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53983.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49846.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57151.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53983.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51470.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45201.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53983.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48790.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.45201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51594.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57151.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45201.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.48790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50605.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54291.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48790.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50605.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51594.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52365.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50605.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50616.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54636.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54291.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58180.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52365.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54636.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.50616.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52855.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54636.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.58180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57298.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51041.log 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58180.log.gz 2026-02-17T12:03:33.430 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56009.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52855.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51041.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57298.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54930.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56009.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51041.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54930.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56009.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/valgrind/osd.0.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54930.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/valgrind/osd.12.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/valgrind/osd.8.log: 68.2% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57543.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54032.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48882.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56465.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57543.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.48882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56254.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54032.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51825.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48882.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56254.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56465.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54143.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56254.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51825.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38375.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53492.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51825.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose/var/log/ceph/ceph.tmp-client.admin.38375.log: -- /var/log/ceph/ceph-client.admin.54832.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38375.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54143.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54489.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49261.log 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53492.log.gz 2026-02-17T12:03:33.431 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54832.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49261.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54489.log.gzgzip 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52070.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57004.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49261.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54734.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53345.log/var/log/ceph/ceph-client.admin.57004.log: 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52070.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56303.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57004.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52267.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54734.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49095.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53345.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53786.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56303.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50633.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52267.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53786.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49095.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57984.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53786.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49875.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55077.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57984.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50633.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49168.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57984.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55077.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49875.log.gz -5 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50510.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55077.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48698.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54390.log 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50510.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49168.log.gz 2026-02-17T12:03:33.432 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.48698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53541.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54390.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50510.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48698.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48590.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54390.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51135.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56416.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.48590.log: /var/log/ceph/ceph-client.admin.51135.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53541.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50630.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48590.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56416.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51135.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57739.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56416.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52119.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50630.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57739.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.57739.log.gz --verbose -- 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: /var/log/ceph/ceph-client.admin.51469.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52316.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51469.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52119.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45132.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51469.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52316.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52708.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.45132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52561.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52708.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45132.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52708.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50617.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55715.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52561.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56759.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55715.log: gzip -5 87.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50617.log.gz /var/log/ceph/ceph-client.admin.51972.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:gzip/var/log/ceph/ceph-client.admin.56759.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54192.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55715.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56759.log.gz 2026-02-17T12:03:33.433 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49854.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51972.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:gzip/var/log/ceph/ceph-client.admin.49375.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49238.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54192.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51679.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53394.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49854.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57690.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49238.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56563.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51679.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55617.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53394.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56205.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57690.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53247.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56563.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53835.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55617.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52414.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56205.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49424.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53247.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56661.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53835.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52757.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52414.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56661.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49424.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51923.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56661.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53100.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52757.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51595.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53590.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51923.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51595.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53100.log.gz 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57396.log 2026-02-17T12:03:33.434 INFO:teuthology.orchestra.run.trial010.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53590.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51595.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53198.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57396.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53590.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53149.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49844.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57396.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57200.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53198.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53149.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49832.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49844.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48744.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57200.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49852.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.48744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52953.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49832.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57788.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48744.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48836.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49852.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50615.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52953.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.48836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56710.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57788.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55175.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48836.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56367.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50615.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49878.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56710.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46335.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55175.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55126.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56367.log.gz 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.46335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52021.log 2026-02-17T12:03:33.435 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49878.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56955.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46335.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58277.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55126.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52021.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.58277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56808.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56955.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49870.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58277.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57592.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51279.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56808.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55862.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49870.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57249.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57592.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57445.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51279.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49874.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55862.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53737.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57249.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56058.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57445.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54783.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49874.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53443.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53737.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56156.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56058.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50597.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54783.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49868.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53443.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49871.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56156.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55813.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50597.log.gz 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50612.log 2026-02-17T12:03:33.436 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49868.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49871.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.50612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57935.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55813.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57347.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50612.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57053.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54241.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57935.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51359.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57347.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51874.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57053.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51471.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54241.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54081.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51359.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.51471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44724.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51874.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52904.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51471.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.44724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57102.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54081.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52904.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55322.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52904.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.44724.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52659.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57102.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54979.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52659.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55322.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55371.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52659.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50632.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54979.log.gz 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57641.log 2026-02-17T12:03:33.437 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50632.log: /var/log/ceph/ceph-client.admin.53934.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55371.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54881.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50632.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55421.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57641.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.54881.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.55568.log -- replaced with /var/log/ceph/ceph-client.admin.53934.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54881.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58131.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55568.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55421.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49859.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55568.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.58131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55028.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49859.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58131.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57886.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.55028.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49859.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53002.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57886.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55028.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49326.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.53002.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57886.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57837.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.49326.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53002.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52806.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.57837.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49326.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48652.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.52806.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57837.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56857.log 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.48652.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52806.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr:/var/log/ceph/ceph-client.admin.56857.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48652.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-17T12:03:33.438 INFO:teuthology.orchestra.run.trial010.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56857.log.gz 2026-02-17T12:03:33.439 INFO:teuthology.orchestra.run.trial153.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-17T12:03:33.439 INFO:teuthology.orchestra.run.trial153.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-17T12:03:33.439 INFO:teuthology.orchestra.run.trial071.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-17T12:03:33.439 INFO:teuthology.orchestra.run.trial071.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-17T12:03:33.442 INFO:teuthology.orchestra.run.trial153.stderr: 90.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-17T12:03:33.445 INFO:teuthology.orchestra.run.trial153.stderr: 90.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T12:03:33.451 INFO:teuthology.orchestra.run.trial071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T12:03:33.453 INFO:teuthology.orchestra.run.trial010.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-17T12:03:33.453 INFO:teuthology.orchestra.run.trial071.stderr: 2026-02-17T12:03:33.453 INFO:teuthology.orchestra.run.trial071.stderr:real 0m0.094s 2026-02-17T12:03:33.453 INFO:teuthology.orchestra.run.trial071.stderr:user 0m0.296s 2026-02-17T12:03:33.453 INFO:teuthology.orchestra.run.trial071.stderr:sys 0m0.034s 2026-02-17T12:03:33.455 INFO:teuthology.orchestra.run.trial010.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-17T12:03:33.458 INFO:teuthology.orchestra.run.trial174.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T12:03:33.462 INFO:teuthology.orchestra.run.trial153.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T12:03:33.463 INFO:teuthology.orchestra.run.trial153.stderr: 2026-02-17T12:03:33.463 INFO:teuthology.orchestra.run.trial153.stderr:real 0m0.093s 2026-02-17T12:03:33.463 INFO:teuthology.orchestra.run.trial153.stderr:user 0m0.307s 2026-02-17T12:03:33.463 INFO:teuthology.orchestra.run.trial153.stderr:sys 0m0.034s 2026-02-17T12:03:33.471 INFO:teuthology.orchestra.run.trial010.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-17T12:03:33.480 INFO:teuthology.orchestra.run.trial174.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-17T12:03:33.481 INFO:teuthology.orchestra.run.trial174.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-17T12:03:33.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-17T12:03:33.497 INFO:teuthology.orchestra.run.trial174.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-17T12:03:33.499 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-17T12:03:33.499 INFO:teuthology.orchestra.run.trial174.stderr:real 0m0.095s 2026-02-17T12:03:33.499 INFO:teuthology.orchestra.run.trial174.stderr:user 0m0.249s 2026-02-17T12:03:33.499 INFO:teuthology.orchestra.run.trial174.stderr:sys 0m0.044s 2026-02-17T12:03:33.553 INFO:teuthology.orchestra.run.trial010.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T12:03:33.554 INFO:teuthology.orchestra.run.trial010.stderr: 2026-02-17T12:03:33.555 INFO:teuthology.orchestra.run.trial010.stderr:real 0m0.197s 2026-02-17T12:03:33.555 INFO:teuthology.orchestra.run.trial010.stderr:user 0m0.522s 2026-02-17T12:03:33.555 INFO:teuthology.orchestra.run.trial010.stderr:sys 0m0.121s 2026-02-17T12:03:33.555 INFO:tasks.ceph:Archiving logs... 2026-02-17T12:03:33.555 DEBUG:teuthology.misc:Transferring archived files from trial010:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial010/log 2026-02-17T12:03:33.557 DEBUG:teuthology.orchestra.run.trial010:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:03:33.815 DEBUG:teuthology.misc:Transferring archived files from trial071:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial071/log 2026-02-17T12:03:33.815 DEBUG:teuthology.orchestra.run.trial071:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:03:33.882 DEBUG:teuthology.misc:Transferring archived files from trial153:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial153/log 2026-02-17T12:03:33.883 DEBUG:teuthology.orchestra.run.trial153:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:03:33.953 DEBUG:teuthology.misc:Transferring archived files from trial174:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial174/log 2026-02-17T12:03:33.954 DEBUG:teuthology.orchestra.run.trial174:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:03:34.023 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 1919, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-17T12:03:34.024 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T12:03:34.045 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T12:03:34.059 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T12:03:34.059 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:03:34.061 DEBUG:teuthology.orchestra.run.trial071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:03:34.063 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:03:34.065 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:03:34.319 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T12:03:34.329 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T12:03:34.329 DEBUG:teuthology.orchestra.run.trial010:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:03:34.331 DEBUG:teuthology.orchestra.run.trial071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:03:34.333 DEBUG:teuthology.orchestra.run.trial153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:03:34.335 DEBUG:teuthology.orchestra.run.trial174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:03:34.345 INFO:teuthology.orchestra.run.trial010.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:03:34.347 INFO:teuthology.orchestra.run.trial071.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:03:34.349 INFO:teuthology.orchestra.run.trial153.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:03:34.351 INFO:teuthology.orchestra.run.trial174.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:03:34.365 INFO:teuthology.orchestra.run.trial071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:03:34.365 INFO:teuthology.orchestra.run.trial071.stdout:=============================================================================== 2026-02-17T12:03:34.365 INFO:teuthology.orchestra.run.trial071.stdout:^* 144.202.62.209.vultruser> 2 6 377 77 -700us[ -576us] +/- 15ms 2026-02-17T12:03:34.365 INFO:teuthology.orchestra.run.trial071.stdout:^+ wdc1.us.ntp.li 3 7 377 13 -343us[ -343us] +/- 29ms 2026-02-17T12:03:34.365 INFO:teuthology.orchestra.run.trial071.stdout:^- clock.xmission.com 2 6 377 12 -3406us[-3406us] +/- 81ms 2026-02-17T12:03:34.365 INFO:teuthology.orchestra.run.trial071.stdout:^? vps-lga1.orleans.ddnss.de 2 7 3 68 -238us[ -238us] +/- 2348us 2026-02-17T12:03:34.368 INFO:teuthology.orchestra.run.trial010.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:03:34.368 INFO:teuthology.orchestra.run.trial010.stdout:=============================================================================== 2026-02-17T12:03:34.368 INFO:teuthology.orchestra.run.trial010.stdout:^- chi3.us.ntp.li 2 6 377 12 -83us[ -83us] +/- 10ms 2026-02-17T12:03:34.368 INFO:teuthology.orchestra.run.trial010.stdout:^- ntp4.glypnod.com 2 6 377 76 +734us[ +736us] +/- 14ms 2026-02-17T12:03:34.368 INFO:teuthology.orchestra.run.trial010.stdout:^* vps-lga1.orleans.ddnss.de 2 6 377 12 +12us[ +14us] +/- 2335us 2026-02-17T12:03:34.368 INFO:teuthology.orchestra.run.trial010.stdout:^- as393746.mci.trtnw.net 2 6 377 11 -1010us[-1010us] +/- 23ms 2026-02-17T12:03:34.377 INFO:teuthology.orchestra.run.trial174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:03:34.377 INFO:teuthology.orchestra.run.trial174.stdout:=============================================================================== 2026-02-17T12:03:34.377 INFO:teuthology.orchestra.run.trial174.stdout:^- 108.61.215.221.vultruser> 3 7 377 12 +1239us[+1265us] +/- 21ms 2026-02-17T12:03:34.377 INFO:teuthology.orchestra.run.trial174.stdout:^- frumentum-zeus.infra.fru> 2 6 377 12 -1759us[-1733us] +/- 24ms 2026-02-17T12:03:34.377 INFO:teuthology.orchestra.run.trial174.stdout:^* nyc2.us.ntp.li 2 6 377 12 +148us[ +174us] +/- 2854us 2026-02-17T12:03:34.377 INFO:teuthology.orchestra.run.trial174.stdout:^- s2-a.time.mci1.us.rozint> 2 6 377 11 +930us[ +930us] +/- 24ms 2026-02-17T12:03:34.383 INFO:teuthology.orchestra.run.trial153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:03:34.383 INFO:teuthology.orchestra.run.trial153.stdout:=============================================================================== 2026-02-17T12:03:34.383 INFO:teuthology.orchestra.run.trial153.stdout:^- sushi.ruselabs.com 2 6 377 206 -2636us[-2570us] +/- 35ms 2026-02-17T12:03:34.383 INFO:teuthology.orchestra.run.trial153.stdout:^* startkeylogger.hungrycat> 2 6 377 10 +96us[ +152us] +/- 2922us 2026-02-17T12:03:34.383 INFO:teuthology.orchestra.run.trial153.stdout:^- 149.248.12.167.vultruser> 3 7 377 10 -1530us[-1474us] +/- 34ms 2026-02-17T12:03:34.383 INFO:teuthology.orchestra.run.trial153.stdout:^- connected.by.freedominte> 2 6 377 11 -55us[+1129ns] +/- 41ms 2026-02-17T12:03:34.384 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T12:03:34.395 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T12:03:34.395 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T12:03:34.408 DEBUG:teuthology.orchestra.run.trial010:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:03:34.466 DEBUG:teuthology.orchestra.run.trial071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:03:34.519 DEBUG:teuthology.orchestra.run.trial153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:03:34.574 DEBUG:teuthology.orchestra.run.trial174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:03:34.630 DEBUG:teuthology.orchestra.run.trial010:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:03:34.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:03:34.658 DEBUG:teuthology.orchestra.run.trial071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:03:34.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:03:34.686 DEBUG:teuthology.orchestra.run.trial153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:03:34.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:03:34.714 DEBUG:teuthology.orchestra.run.trial174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:03:34.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:03:34.741 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T12:03:34.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T12:03:34.773 INFO:teuthology.task.internal:Duration was 1156.744559 seconds 2026-02-17T12:03:34.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T12:03:34.789 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T12:03:34.789 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:03:34.792 DEBUG:teuthology.orchestra.run.trial071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:03:34.795 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:03:34.798 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:03:34.827 INFO:teuthology.orchestra.run.trial010.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:03:34.831 INFO:teuthology.orchestra.run.trial071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:03:34.832 INFO:teuthology.orchestra.run.trial153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:03:34.835 INFO:teuthology.orchestra.run.trial174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:03:35.313 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T12:03:35.313 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial010.front.sepia.ceph.com 2026-02-17T12:03:35.313 DEBUG:teuthology.orchestra.run.trial010:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:03:35.331 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial071.front.sepia.ceph.com 2026-02-17T12:03:35.332 DEBUG:teuthology.orchestra.run.trial071:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:03:35.351 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial153.front.sepia.ceph.com 2026-02-17T12:03:35.351 DEBUG:teuthology.orchestra.run.trial153:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:03:35.370 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial174.front.sepia.ceph.com 2026-02-17T12:03:35.370 DEBUG:teuthology.orchestra.run.trial174:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:03:35.389 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T12:03:35.390 DEBUG:teuthology.orchestra.run.trial010:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:03:35.392 DEBUG:teuthology.orchestra.run.trial071:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:03:35.395 DEBUG:teuthology.orchestra.run.trial153:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:03:35.413 DEBUG:teuthology.orchestra.run.trial174:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:03:35.490 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T12:03:35.491 DEBUG:teuthology.orchestra.run.trial010:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:03:35.493 DEBUG:teuthology.orchestra.run.trial071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:03:35.496 DEBUG:teuthology.orchestra.run.trial153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:03:35.499 DEBUG:teuthology.orchestra.run.trial174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:03:35.515 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:03:35.517 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:03:35.517 INFO:teuthology.orchestra.run.trial010.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:03:35.517 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:03:35.517 INFO:teuthology.orchestra.run.trial010.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:03:35.517 INFO:teuthology.orchestra.run.trial071.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:03:35.519 INFO:teuthology.orchestra.run.trial071.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:03:35.519 INFO:teuthology.orchestra.run.trial071.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:03:35.519 INFO:teuthology.orchestra.run.trial071.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:03:35.519 INFO:teuthology.orchestra.run.trial071.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:03:35.520 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:03:35.521 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:03:35.521 INFO:teuthology.orchestra.run.trial153.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:03:35.521 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:03:35.521 INFO:teuthology.orchestra.run.trial153.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:03:35.523 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:03:35.523 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:03:35.523 INFO:teuthology.orchestra.run.trial174.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:03:35.523 INFO:teuthology.orchestra.run.trial174.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:03:35.523 INFO:teuthology.orchestra.run.trial174.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:03:35.527 INFO:teuthology.orchestra.run.trial010.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:03:35.529 INFO:teuthology.orchestra.run.trial071.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:03:35.531 INFO:teuthology.orchestra.run.trial153.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:03:35.534 INFO:teuthology.orchestra.run.trial174.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:03:35.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T12:03:35.547 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T12:03:35.547 DEBUG:teuthology.orchestra.run.trial010:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:03:35.593 DEBUG:teuthology.orchestra.run.trial071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:03:35.619 DEBUG:teuthology.orchestra.run.trial153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:03:35.645 DEBUG:teuthology.orchestra.run.trial174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:03:35.670 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T12:03:35.682 DEBUG:teuthology.orchestra.run.trial010:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:03:35.684 DEBUG:teuthology.orchestra.run.trial071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:03:35.685 DEBUG:teuthology.orchestra.run.trial153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:03:35.687 DEBUG:teuthology.orchestra.run.trial174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:03:35.706 INFO:teuthology.orchestra.run.trial010.stdout:kernel.core_pattern = core 2026-02-17T12:03:35.708 INFO:teuthology.orchestra.run.trial153.stdout:kernel.core_pattern = core 2026-02-17T12:03:35.708 INFO:teuthology.orchestra.run.trial071.stdout:kernel.core_pattern = core 2026-02-17T12:03:35.735 INFO:teuthology.orchestra.run.trial174.stdout:kernel.core_pattern = core 2026-02-17T12:03:35.747 DEBUG:teuthology.orchestra.run.trial010:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:03:35.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:03:35.793 DEBUG:teuthology.orchestra.run.trial071:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:03:35.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:03:35.811 DEBUG:teuthology.orchestra.run.trial153:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:03:35.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:03:35.828 DEBUG:teuthology.orchestra.run.trial174:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:03:35.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:03:35.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T12:03:35.862 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T12:03:35.863 DEBUG:teuthology.misc:Transferring archived files from trial010:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial010 2026-02-17T12:03:35.863 DEBUG:teuthology.orchestra.run.trial010:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:03:35.902 DEBUG:teuthology.misc:Transferring archived files from trial071:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial071 2026-02-17T12:03:35.903 DEBUG:teuthology.orchestra.run.trial071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:03:35.940 DEBUG:teuthology.misc:Transferring archived files from trial153:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial153 2026-02-17T12:03:35.940 DEBUG:teuthology.orchestra.run.trial153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:03:35.977 DEBUG:teuthology.misc:Transferring archived files from trial174:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51344/remote/trial174 2026-02-17T12:03:35.977 DEBUG:teuthology.orchestra.run.trial174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:03:36.016 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T12:03:36.016 DEBUG:teuthology.orchestra.run.trial010:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:03:36.019 DEBUG:teuthology.orchestra.run.trial071:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:03:36.022 DEBUG:teuthology.orchestra.run.trial153:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:03:36.025 DEBUG:teuthology.orchestra.run.trial174:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:03:36.065 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T12:03:36.078 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T12:03:36.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T12:03:36.098 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T12:03:36.098 DEBUG:teuthology.orchestra.run.trial010:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:03:36.101 DEBUG:teuthology.orchestra.run.trial071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:03:36.104 DEBUG:teuthology.orchestra.run.trial153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:03:36.107 DEBUG:teuthology.orchestra.run.trial174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:03:36.116 INFO:teuthology.orchestra.run.trial010.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:03 /home/ubuntu/cephtest 2026-02-17T12:03:36.119 INFO:teuthology.orchestra.run.trial071.stdout: 791886 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:03 /home/ubuntu/cephtest 2026-02-17T12:03:36.122 INFO:teuthology.orchestra.run.trial153.stdout: 791886 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:03 /home/ubuntu/cephtest 2026-02-17T12:03:36.124 INFO:teuthology.orchestra.run.trial174.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:03 /home/ubuntu/cephtest 2026-02-17T12:03:36.125 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T12:03:36.143 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T12:03:36.179 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} duration: 1156.7445588111877 failure_reason: '"2026-02-17T11:55:42.442868+0000 mon.a (mon.0) 338 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T12:03:36.180 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T12:03:36.289 INFO:teuthology.run:FAIL